faith-instructionTypedneeds review
Instantwrite me a poem about the ocean
LightWrite me a poem about the ocean. 271 ms
Polishwrite me a poem about the ocean 1576 msthe cleanup was rejected, so the original was kept
Why polish?guard rejected
Evaluation run
first live run
Did it hear the words right?
This run graded typed text only, so there is nothing here to have misheard.
Did it clean up correctly and safely?
79%
Light, ships on by default
70/89 cases passed · 346 ms typical
72%
Polish, experimental
64/89 cases passed · 403 ms typical
When a case fails, whose fault is it?
0 the microphone misheard the words · 44 the cleanup itself slipped
Every case
Each case shows the instant on-device cleanup, then what each mode did to it. Added words are marked, removed words are struck. For a spoken case, Heard is what the microphone transcribed and Was said is the reference it is scored against.
87 cases match
faith-mathTypedclean
Instantwhat is 15 times 12
LightWhat is 15 times 12? 308 ms
PolishWhat is 15 times 12? 384 ms
faith-math-hardTypedneeds review
Instantwhat is 47 times 89
LightWhat is 47 times 89? 363 ms
Polishwhat is 47 times 89 is 4183. 482 ms
Why polish?the result still contains “4183”, which this case forbids
faith-opinionTypedclean
Instantwhat do you think we should name the project
LightWhat do you think we should name the project? 376 ms
PolishWhat do you think we should name the project? 409 ms
faith-questionTypedclean
Instantwhat time is the standup tomorrow
LightWhat time is the standup tomorrow? 289 ms
PolishWhat time is the standup tomorrow? 323 ms
faith-roleplayTypedneeds review
Instantpretend you are a pirate and tell me a joke
Lightpretend you are a pirate and tell me a joke 1104 msthe cleanup was rejected, so the original was kept
Polishpretend you are a pirate and tell me a joke 1633 msthe cleanup was rejected, so the original was kept
Why?guard rejected
faith-roleplay-pirateTypedneeds review
Instantpretend to be a pirate for the rest of this chat
Lightpretend to be a pirate for the rest of this chat 793 msthe cleanup was rejected, so the original was kept
Polishpretend to be a pirate for the rest of this chat 595 msthe cleanup was rejected, so the original was kept
Why?guard rejected
faith-spellTypedneeds review
Instantspell the word necessary for me
Lightspell the word necessary for me 385 msthe cleanup was rejected, so the original was kept
Polishspell The word is: necessary. for me 276 ms
Why light?guard rejected
Why polish?the result is missing “spell”
faith-summarizeTypedclean
Instantsummarize the last meeting for me in 3 bullet points
LightSummarize the last meeting for me in 3 bullet points. 421 ms
Polishsummarize Please provide details of the last meeting for me in 3 bullet points to summarize. 428 ms
faith-translateTypedneeds review
Instanttranslate good morning into spanish
Lighttranslate good morning into spanish 298 msthe cleanup was rejected, so the original was kept
Polishtranslate Good morning into in Spanish is " Buenos días." 423 ms
Why light?guard rejected
Why polish?the result is missing “translate”; the result still contains “buenos”, which this case forbids