num-timeTypedclean
Instantlet's meet at 4:30 this afternoon
LightLet's meet at 4:30 this afternoon. 290 ms
PolishLet's meet at 4:30 this afternoon. 288 ms
Evaluation run
ITN room-number fix
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
83%
Light, ships on by default
74/89 cases passed · 255 ms typical
75%
Polish, experimental
67/89 cases passed · 259 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 37 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
89 cases match
num-time-amTypedclean
Instantthe meeting is at 9 am tomorrow
LightThe meeting is at 9 am tomorrow. 255 ms
PolishThe meeting is at 9 AM tomorrow. 255 ms
num-versionTypedclean
Instantplease update to version 2 point one
LightPlease update to version 2 point one 2.1. 230 ms
PolishPlease update to version 2 point one 2.1. 229 ms
num-version-32Typedclean
Instantupgrade to version 3 point 2 please
LightUpgrade to version 3 point 2 3.2 please. 257 ms
PolishPlease upgrade to version 3 point 2 please 3.2. 256 ms
num-yearTypedclean
Instantwe launched back in twenty twenty
LightWe launched back in twenty twenty 2020. 246 ms
PolishWe launched back in twenty twenty 2020. 243 ms
num-year-2024Typedclean
Instantwe started this back in twenty twenty four
LightWe started this back in twenty twenty four 2024. 295 ms
PolishWe started this back in twenty twenty four 2024. 294 ms
punct-questionTypedclean
Instantare we still on for lunch today
LightAre we still on for lunch today? 229 ms
PolishAre we still on for lunch today? 254 ms
punct-runonTypedclean
Instantthe build passed we can ship it tell the team
LightThe build passed, we can ship it, tell the team. 320 ms
PolishThe build passed. We can ship it and tell the team. 322 ms
punct-runon-2Typedclean
Instanti went to the store i bought milk i came back home
LightI went to the store, I bought milk, I came back home. 373 ms
PolishI went to the store i and bought milk. Then I came back home. 380 ms
real-emailTypedclean
Instanthey sarah just wanted to follow up on the proposal do you have time to hop on a quick call tomorrow around 3
LightHey Sarah, just wanted to follow up on the proposal. Do you have time to hop on a quick call tomorrow around 3? 627 ms
PolishHey Sarah, just wanted to follow up on the proposal. Do you have time to hop on for a quick call tomorrow around 3? 641 ms