Voice or chat: picking the mode for the task
Speaking and typing are two inputs to the same agent. The situation the user is in decides which one wins, and four of those situations are predictable.
About this article
Voice and chat are two input modes into the same agent, so the choice is per situation rather than per product. Speaking wins when hands or eyes are busy, when the request is one sentence with a condition in it, and when the keyboard is the slow part. Typing wins when the answer is overheard, the room is loud, or the value has to be exact.
Teams argue about this as if it were a product decision, and it is a situation decision. The same user wants to speak on a bike and type on a train, and they are the same person with the same task and the same app.
That reframing is worth making early because it changes the build. If voice and chat are rival products, you pick one and defend it. If they are two inputs into one agent, you build the agent once and the mode becomes a setting the user changes without thinking about it.
Two different questions get argued as one#
Agent or chatbot is a question about capability. It asks whether the thing can finish the task or only describe how to finish it, and the structural difference between those two shows up in the backend rather than the interface.
Voice or chat is a question about input. It assumes the thing doing the work is the same underneath and asks only how the user gets a request into it. A voice interface bolted onto something that can only answer questions is a slower way to read a help article aloud.
The rest of this post assumes the agent can act, which is a recent enough capability that what changed in the model layer to allow it is worth knowing. Given that, the question here is only which mode the user should reach for.
The speed argument, with its actual numbers#
Speaking is faster than typing on a phone, and the gap is large. A controlled comparison of speech input against touchscreen keyboards measured 153 words per minute for English speech against 52 for the keyboard, a factor of 2.93, with the same pattern in Mandarin at 123 against 43 (Ruan et al., 25 August 2016). Error rates during entry went the other way from the folklore: 5.30 percent for speech against 11.22 percent for the keyboard.
Date that study when you use it. It was run in 2016, on transcription of given phrases rather than on composing your own sentence, and recognition has improved since. The direction has held up in the field data. A study of 37,370 volunteers found average mobile typing at 36.2 words per minute, and reported that with one or two fingers people type about 70 percent as fast on a phone as on a full keyboard (Palin et al., MobileHCI 2019).
The speed number only converts into a product win when the user is entering something. An agent that saves seven taps of navigation saves more than one that saves a sentence of typing, which is the argument for measuring completion rather than input rate.
Where typing beats speaking, plainly#
Privacy is the first one and the most underrated. If the answer names an amount, an address, a medication or a balance, the user is deciding whether the person next to them hears it. That decision happens before the microphone opens, and no amount of latency work changes it.
Noise is the second. Recognition degrades and each retry costs more than the typing would have. This is why an agent should keep the keyboard reachable from the voice dock rather than treating the switch as a settings change.
Exactness is the third. An IBAN, a coupon code, a two-factor digit or a serial number is a string with no redundancy, so a single substitution makes it wrong and the user cannot hear the error in the readback. Let people type those, and let the agent fill in everything around them.
Browsing is the fourth, and it is the one teams forget. Voice is good at “do this”. It is poor at “show me what there is”, because the user does not yet have the words for what they want and a spoken list is hard to hold in working memory. Nielsen Norman Group made the point about voice-only devices a decade ago: reciting a list of options “requires users to store the options in working memory while they make a selection” (Whitenton, 31 January 2016). A screen fixes that, which is the entire case for a spoken answer that draws widgets instead of reading them out.
The same task, both ways#

Notice what did not change. The confirm card is in both paths, because the gate belongs to the action rather than to the input mode. Notice also that the right-hand column would look identical if the user had typed that sentence. The saving comes from the agent collapsing navigation, and the mode only decides how the sentence arrived.
A spoken turn costs more interface#
This is the part that surprises teams who have shipped a chat feature and expect voice to be the same thing with a microphone button.
A typed turn has two visible states and a scrollback. The question stays on the screen, so the user never has to remember what they asked, and a wrong word is edited before it is sent.
A spoken turn has five states in our SDK: idle, listening, transcribing, thinking and speaking. Each one needs to be visible, because a user who cannot tell listening from thinking will either repeat themselves or give up. Speech leaves nothing behind, so the transcript has to be drawn or the user loses the thread. And a wrong word only becomes visible after the system has already acted on its understanding of it.
Interruption is the expensive row. In text, a user who has seen enough scrolls away. In voice, the user talks over the agent and something has to cancel the speech task, stop the player and take the listening state, in that order, before the late audio arrives. Platform vendors now treat this as table stakes rather than a nicety: Google’s Live API states that “users can interrupt the model at any time for responsive interactions” (Gemini Live API documentation). The general conversation-design work around this sits in the design rules for an interface with no visible affordances, and the implementation cost is real enough to plan for.
Deciding for your app#
Three questions get you most of the way.
Where is the user’s body when this task happens? If the honest answer includes driving, carrying, cooking, gloves or a warehouse floor, voice is the only input available, and the feature either exists in that mode or does not exist for those users.
What does the request look like when a person says it out loud? If it is one sentence that carries a condition, a quantity and a time, voice is doing work that a form would need four fields for. If it is “hmm, what do you have”, it is browsing, and browsing wants a screen.
Who cannot type this comfortably? The World Health Organization estimates that “1.3 billion people experience significant disability”, which is “16% of the world’s population, or 1 in 6 of us” (WHO, 7 March 2023). Add the temporary cases: a cast, a language whose keyboard is slower than its speech, and anyone holding a child. Voice as an alternative input path is the accessibility case rather than the convenience case, and it is a stronger argument than the speed one.
Then ship both and watch which one people use for which task. The instrumentation is cheap and the answer is specific to your product. Chasing the general question is how teams spend a quarter deciding something their own logs would have answered in a week, which is the argument for treating the first weeks of real traffic as the study.
Common questions#
Is voice or a chatbot better for a mobile app? Neither, as a general answer. They are two inputs into the same agent, so the useful question is which one suits the situation the user is in. Speaking wins when hands or eyes are busy or the keyboard is the slow part; typing wins when the exchange can be overheard, the room is loud, or the value has to be exact.
Is speaking really faster than typing on a phone? On measured text entry, yes, by roughly three times. A 2016 study recorded 153 words per minute for English speech against 52 for a touchscreen keyboard. The product benefit usually comes from the navigation the agent removes rather than from the raw input rate.
Do I have to build two interfaces? No, if the agent is the same underneath. The tool surface, the confirm gate and the widgets are shared. What differs is the input path and the state display, because a spoken turn has five phases to show and a typed one has two.
When is voice actively the wrong choice? When the answer is private and the user is in public, when the environment is loud, when the value entered has no redundancy, and when the user is browsing rather than requesting. Those four cover most of the complaints teams get after launching a voice feature.
Does supporting voice mean removing the keyboard? It should not. Keeping text entry one tap away from the voice dock is what makes the noisy-room and exact-value cases survivable, and it costs nothing to leave in.
Sources#
- Google, Live API documentation. Accessed 12 September 2026.
- World Health Organization, Disability and health fact sheet, 7 March 2023. Accessed 12 September 2026.
- Ruan et al., Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones, 25 August 2016. Accessed 12 September 2026.
- Palin et al., How do People Type on Mobile Devices?, MobileHCI 2019. Accessed 12 September 2026.
- Kathryn Whitenton, Voice Interaction UX: Brave New World…Same Old Story, Nielsen Norman Group, 31 January 2016. Accessed 12 September 2026.
Next
Plans, limits and what ships on each.
Compare what a deployment costsThe rest of Agent basics
Open the clusterThe structural difference between something that answers and something that finishes the task, and how to tell which one a vendor is selling you.
- What an in-app AI agent actually is, and what it can touchThree different things get called an AI agent in a mobile app. Here is the one that lives inside your product and acts through your own backend.11 min
- When voice actually works in an app, and when it doesn'tAn honest framework for deciding which tasks belong to a spoken path, which belong to text, and which should stay on the screen.8 min
- Why pre-LLM assistants failed, and what changedAssistants before 2023 broke at the layer that turned words into actions. Three things replaced it: open intent, named tool calls, and a loop that checks first.10 min
- Agents in a shopping app: reorder, track, returnThe three retail tasks worth giving an agent, why reorder is first, and how to check whether your catalogue supports the case at all.7 min
- What an in-app agent SDK actually doesThe boundary between an agent SDK and your app, the five phases of a turn and what breaks in each, and why the write path is the part that decides the project.8 min
- In-app agents that finish the task instead of answeringAn assistant that describes where a setting lives competes with your own navigation. One that completes the request does not. What changed, and what to build.8 min
- Agent or chatbot: telling the two apart before you buyA support bot answers questions. An in-app agent finishes the task. Five questions that separate them in any vendor demo, and where a chatbot still wins.10 min
- Letting users reorder by voice in three tool callsRepeat purchase is the cheapest first agent feature to ship. Three tools carry it, only one of them writes, and a confirm card sits between the second and the third.6 min
- When not to put an AI agent in your appFour situations where an in-app agent loses to the interface you already have, and the test to run before you commit a quarter to building one.10 min
Elsewhere on the map
- An in-app agent is an accessibility feature, narrowlyAn agent that completes a task is an alternative input path, and one WCAG 2.2 criterion turns the biometric confirm into an accessibility win rather than a tax.Voice10 min
- Voice is an alternative input path, not a speed featureThe case for a spoken path into your app, argued from the curb-cut effect, WCAG 2.2 and what screen reader users actually report.Voice7 min
- Conversational interfaces and older users: the real tensionWhy asking for a task costs older users less than navigating to it, and why the same people are least likely to have tried an AI product.Voice8 min
