disf-scratchTypedclean
Instantthe deadline is friday actually no let's say next monday
LightThe deadline is friday actually no let's say next Monday. 246 ms
PolishThe deadline is friday actually no let's say next Monday. 278 ms
Evaluation run
first live run
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
79%
Light, ships on by default
70/89 cases passed · 346 ms typical
72%
Polish, experimental
64/89 cases passed · 403 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 44 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
87 cases match
disf-selfcorrect-nameTypedclean
Instantsend it to john i mean jane
LightSend it to john i mean Jane. 203 ms
PolishSend it to john i mean Jane. 260 ms
disf-selfcorrect-timeTypedclean
Instantlet's meet at 3 no wait 4:00
LightLet's meet at 3 no wait 4:00. 333 ms
PolishLet's meet at 3 no wait 4:00. 410 ms
edge-emailTypedclean
Instantemail me@john.smith at gmail dot com
Lightemail me@john.smith at gmail dot com me@john.smith@gmail.com 327 ms
Polishemail me@john.smith me at gmail dot com me@john.smith@gmail.com 443 ms
edge-gibberishTypedclean
Instantasdf qwerty test test one two three
Lightasdf qwerty test test one two three. 365 ms
Polishasdf qwerty. Test. test One two three. 403 ms
edge-mixedTypedclean
Instanthey so the the lyzr demo is at 4:30 no wait 5:00 and accuracy is like 90% now
LightHey, so the the Lyzr demo is at 4:30 no wait 5:00, and accuracy is like 90%. now 774 ms
PolishHey, so the the Lyzr demo is at 4:30 no wait 5:00, and accuracy is like 90%. now 869 ms
edge-shortTypedclean
Instantyeah sounds good
LightYeah, sounds good. 223 ms
PolishYeah, sounds good. 273 ms
edge-singleTypedclean
Instantperfect
LightPerfect. 155 ms
PolishPerfect. 179 ms
faith-already-cleanTypedclean
InstantThe quarterly report is due on Friday.
LightThe quarterly report is due on Friday. 280 ms
PolishThe quarterly report is due on Friday. 352 ms
faith-codeTypedneeds review
Instantwrite a python function to reverse a string
LightWrite a Python function to reverse a string. 307 ms
Polishwrite a python function to reverse a string 1900 msthe cleanup was rejected, so the original was kept
Why polish?guard rejected