← All runs

Evaluation run

post guard-fix rerun

6 July 2026, 11:12 · eval-engine · 54c20aa · 89 cases

Did it hear the words right?

This run graded typed text only, so there is nothing here to have misheard.

Did it clean up correctly and safely?

79%
Light, ships on by default
70/89 cases passed · 260 ms typical
71%
Polish, experimental
63/89 cases passed · 262 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words  ·  45 the cleanup itself slipped

Every case

Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.

89 cases match

real-longTypedclean
Instantso i talked to the team today and we decided that we're going to push the launch to next week because the the testing isn't done and we want to make sure everything is solid
LightSo I talked to the team today and we decided that we're going to push the launch to next week because the the testing isn't done and we want to make sure everything is solid. 784 ms
PolishSo I talked to the team today, and we decided that we're going to push the launch to next week because the the testing isn't done, and we want to make sure everything is solid. 782 ms
real-messageTypedclean
Instantrunning like 10 minutes late traffic is crazy be there as soon as i can
LightRunning like 10 minutes late, traffic is crazy, be there as soon as I can. 480 ms
PolishRunning like 10 minutes late. Traffic is crazy. I'll be there as soon as I can. 472 ms
real-noteTypedclean
Instanttodo for tomorrow finish the report call the bank and pick up groceries
LightTodo for tomorrow: finish the report, call the bank, and pick up groceries. 394 ms
PolishTodo for tomorrow: finish the report, call the bank, and pick up groceries. 480 ms
sens-passwordTypedclean
Instantmy wifi password is hunter two three four
LightMy wifi password is hunter two three four. 245 ms
Polishmy Your Wi-Fi password is "hunter two three four". 295 ms
vocab-acronymTypedneeds review
Instantour a p i is getting rate limited
Lightour a p i is getting rate limited 208 msthe cleanup was rejected, so the original was kept
Polishour a p i is getting rate limited 210 msthe cleanup was rejected, so the original was kept
Why?the result is missing “API”; guard rejected
vocab-namesTypedclean
Instantloop in raj and priya on the nvidia integration
LightLoop in Raj and Priya on the Nvidia integration. 286 ms
PolishLoop in Raj and Priya on the NVIDIA integration. 291 ms
vocab-preserveTypedclean
Instantwe deployed the parakeet model to production
LightWe deployed the parakeet model to production. 261 ms
PolishWe deployed the Parakeet model to production. 261 ms
vocab-ragTypedclean
Instantthe rag pipeline retrieves documents before the model answers
LightThe rag pipeline retrieves documents before the model answers. 261 ms
PolishThe Rag pipeline retrieves documents before the model answers. 261 ms
vocab-techTypedclean
Instantwe deploy with kubernetes and terraform on aws
LightWe deploy with Kubernetes and Terraform on AWS. 316 ms
PolishWe deploy with Kubernetes and Terraform on AWS. 284 ms