disf-scratchTypedclean
Instantthe deadline is friday actually no let's say next monday
LightThe deadline is friday actually no let's say next Monday. 195 ms
PolishThe deadline is friday actually no let's say next Monday. 197 ms
Evaluation run
post guard-fix rerun
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
79%
Light, ships on by default
70/89 cases passed · 260 ms typical
71%
Polish, experimental
63/89 cases passed · 262 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 45 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
89 cases match
disf-selfcorrect-nameTypedclean
Instantsend it to john i mean jane
LightSend it to john i mean Jane. 169 ms
PolishSend it to john i mean Jane. 168 ms
disf-selfcorrect-timeTypedclean
Instantlet's meet at 3 no wait 4:00
LightLet's meet at 3 no wait 4:00. 264 ms
PolishLet's meet at 3 no wait 4:00. 263 ms
edge-emailTypedclean
Instantemail me@john.smith at gmail dot com
Lightemail me@john.smith at gmail dot com me@john.smith@gmail.com 241 ms
Polishemail me@john.smith me at gmail dot com me@john.smith@gmail.com 269 ms
edge-gibberishTypedclean
Instantasdf qwerty test test one two three
Lightasdf qwerty test test one two three. 254 ms
Polishasdf qwerty. Test. test One two three. 271 ms
edge-mixedTypedclean
Instanthey so the the lyzr demo is at 4:30 no wait 5:00 and accuracy is like 90% now
LightHey, so the the Lyzr demo is at 4:30 no wait 5:00, and accuracy is like 90%. now 545 ms
PolishHey, so the the Lyzr demo is at 4:30 no wait 5:00, and accuracy is like 90%. now 542 ms
edge-shortTypedclean
Instantyeah sounds good
LightYeah, sounds good. 181 ms
PolishYeah, sounds good. 175 ms
edge-singleTypedclean
Instantperfect
LightPerfect. 130 ms
PolishPerfect. 132 ms
faith-already-cleanTypedclean
InstantThe quarterly report is due on Friday.
LightThe quarterly report is due on Friday. 225 ms
PolishThe quarterly report is due on Friday. 221 ms
faith-codeTypedneeds review
Instantwrite a python function to reverse a string
LightWrite a Python function to reverse a string. 244 ms
Polishwrite a python function to reverse a string 894 msthe cleanup was rejected, so the original was kept
Why polish?guard rejected