disf-scratchTypedclean
Instantthe deadline is friday actually no let's say next monday
LightThe deadline is friday actually no let's say next Monday. 202 ms
PolishThe deadline is friday actually no let's say next Monday. 195 ms
Evaluation run
ITN room-number fix
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
83%
Light, ships on by default
74/89 cases passed · 255 ms typical
75%
Polish, experimental
67/89 cases passed · 259 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 37 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
89 cases match
disf-selfcorrect-nameTypedclean
Instantsend it to john i mean jane
LightSend it to john i mean Jane. 174 ms
PolishSend it to john i mean Jane. 194 ms
disf-selfcorrect-timeTypedclean
Instantlet's meet at 3 no wait 4:00
LightLet's meet at 3 no wait 4:00. 265 ms
PolishLet's meet at 3 no wait 4:00. 313 ms
edge-emailTypedclean
Instantemail me@john.smith at gmail dot com
Lightemail me@john.smith at gmail dot com me@john.smith@gmail.com 235 ms
Polishemail me@john.smith me at gmail dot com me@john.smith@gmail.com 307 ms
edge-gibberishTypedclean
Instantasdf qwerty test test one two three
Lightasdf qwerty test test one two three. 281 ms
Polishasdf qwerty. Test. test One two three. 266 ms
edge-mixedTypedclean
Instanthey so the the lyzr demo is at 4:30 no wait 5:00 and accuracy is like 90% now
LightHey, so the the Lyzr demo is at 4:30 no wait 5:00, and accuracy is like 90%. now 574 ms
PolishHey, so the the Lyzr demo is at 4:30 no wait 5:00, and accuracy is like 90%. now 551 ms
edge-shortTypedclean
Instantyeah sounds good
LightYeah, sounds good. 181 ms
PolishYeah, sounds good. 182 ms
edge-singleTypedclean
Instantperfect
LightPerfect. 139 ms
PolishPerfect. 124 ms
faith-already-cleanTypedclean
InstantThe quarterly report is due on Friday.
LightThe quarterly report is due on Friday. 223 ms
PolishThe quarterly report is due on Friday. 243 ms
faith-codeTypedneeds review
Instantwrite a python function to reverse a string
LightWrite a Python function to reverse a string. 239 ms
Polishwrite a python function to reverse a string 889 msthe cleanup was rejected, so the original was kept
Why polish?guard rejected