Voice AI in customer service: when callers prefer the machine

SHORT ANSWERVoice AI for customer service uses speech recognition, language models and speech synthesis to handle phone calls end to end. It works when callers would choose it over waiting for a human: fast, accurate, and able to finish the job.

Voice AI for customer service is software that answers and resolves phone calls in natural conversation. It combines speech recognition, a language model that understands the request and decides what to do, integrations that let it take action in the company’s systems, and speech synthesis to respond. The bar it has to clear isn’t “good enough to deflect calls.” It is good enough that callers would rather talk to it than wait for a person.

Why it matters

The phone is still where customers go when something is urgent or complicated, and call centers are expensive, hard to staff and hard to scale up and down. Legacy phone trees (press 1 for billing) solved the cost problem by making the experience worse. Voice AI is worth deploying only if it solves both at once. That was the thesis Sri and Daniel Kwak laid out when Point72 Ventures backed PolyAI in 2019: build voice agents good enough that callers prefer them.

How it differs from nearby ideas

  • IVR phone trees route callers through fixed menus. They sort calls; they rarely resolve them.
  • Chatbots handle text. Voice adds hard real-time constraints: latency, interruptions, accents and noisy lines.
  • Agent-assist tools help a human agent during a call. Voice AI handles the call itself and hands off when it should.
  • Human-in-the-loop systems, like the machine-plus-human translation model behind Unbabel (another Point72 investment Sri led), blend automation with people for quality. Good voice deployments borrow the same idea through clean escalation to humans.

What to evaluate

  1. Resolution, not deflection. What share of calls is fully resolved without a human, and do those customers come back?
  2. Latency and turn-taking. Pauses and talking over the caller destroy trust quickly.
  3. Integration depth. Can the agent actually do things (rebook, refund, update an account), or can it only talk?
  4. Escalation quality. When it hands off, does the human get the full context?
  5. Caller preference. The real test is whether callers choose it, measured in satisfaction and repeat calls.

What changed with large language models

Earlier voice systems depended on hand-built intents and dialogue flows, which were brittle outside the paths designers expected. Large language models handle open-ended requests far better, which widens what can be automated. They also add new risks: confident wrong answers and actions taken on a misunderstanding. The fundamentals (fast turn-taking, deep integrations, clean escalation) matter as much as before.

Limits

Calls involving emotional distress, complex judgment or regulatory risk still need people. Voice AI also inherits the quality of the systems and policies behind it: an agent can’t resolve what the company’s own processes can’t. That links back to enterprise AI starts with the process.

How Sri’s work relates

Sri co-wrote Point72 Ventures’ PolyAI investment thesis in 2019 and served on PolyAI’s board from 2019 to 2025 (UK Companies House). Sri also led Point72’s investment in Unbabel and spoke about automation in the language industry at SlatorCon in 2019. See Writing & talks and About.