num-timeTypedclean
Instantlet's meet at 4:30 this afternoon
LightLet's meet at 4:30 this afternoon. 291 ms
PolishLet's meet at 4:30 this afternoon. 285 ms
Evaluation run
faithfulness scoring cleanup
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
94%
Light, ships on by default
84/89 cases passed · 254 ms typical
89%
Polish, experimental
79/89 cases passed · 266 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 15 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
89 cases match
num-time-amTypedclean
Instantthe meeting is at 9 am tomorrow
LightThe meeting is at 9 am tomorrow. 254 ms
PolishThe meeting is at 9 AM tomorrow. 262 ms
num-versionTypedclean
Instantplease update to version 2 point one
LightPlease update to version 2 point one 2.1. 231 ms
PolishPlease update to version 2 point one 2.1. 231 ms
num-version-32Typedclean
Instantupgrade to version 3 point 2 please
LightUpgrade to version 3 point 2 3.2 please. 252 ms
PolishPlease upgrade to version 3 point 2 please 3.2. 266 ms
num-yearTypedclean
Instantwe launched back in twenty twenty
LightWe launched back in twenty twenty 2020. 250 ms
PolishWe launched back in twenty twenty 2020. 245 ms
num-year-2024Typedclean
Instantwe started this back in twenty twenty four
LightWe started this back in twenty twenty four 2024. 291 ms
PolishWe started this back in twenty twenty four 2024. 300 ms
punct-questionTypedclean
Instantare we still on for lunch today
LightAre we still on for lunch today? 224 ms
PolishAre we still on for lunch today? 228 ms
punct-runonTypedclean
Instantthe build passed we can ship it tell the team
LightThe build passed, we can ship it, tell the team. 319 ms
PolishThe build passed. We can ship it and tell the team. 326 ms
punct-runon-2Typedclean
Instanti went to the store i bought milk i came back home
LightI went to the store, I bought milk, I came back home. 380 ms
PolishI went to the store i and bought milk. Then I came back home. 435 ms
real-emailTypedclean
Instanthey sarah just wanted to follow up on the proposal do you have time to hop on a quick call tomorrow around 3
LightHey Sarah, just wanted to follow up on the proposal. Do you have time to hop on a quick call tomorrow around 3? 605 ms
PolishHey Sarah, just wanted to follow up on the proposal. Do you have time to hop on for a quick call tomorrow around 3? 588 ms