AI agents · OpenClaw · self-hosting · automation

Quick Answer

Best Speech-to-Speech AI Models 2026: Top 6 Ranked

Published:

The ranking at a glance

RankModelVendorAA Speech to Speech IndexPrice (audio)Best for
1Gemini 3.8 Live Extended ThinkingGoogle82.6 (#1)$0.005/min in · $0.018/min outComplex agentic voice tasks
2GPT-Live-1 (+ GPT-6 Astra or GPT-5.6 Sol backend)OpenAI81.5 (Astra medium) · 80.1 (Sol low)$0.05/min + backend tokensFull-duplex, interruption-heavy conversations
3Gemini 3.8 LiveGoogle2nd in Speech Agent Arena (index not published at launch)$0.005/min in · $0.018/min outScale, cost, visual grounding
4GPT-Realtime-2.1OpenAIListed (turn-based)$32/$64 per M audio tokens ≈ $0.05/minOne-model, one-bill voice agents
5GPT-Realtime-2.1-miniOpenAIListed (turn-based)$10/$20 per M audio tokens ≈ $0.016/minHigh-volume, budget IVR
6ElevenLabs Agents (platform)ElevenLabsNot a native S2S model≈ $0.08–0.10/min reported, LLM bundledVoice quality, cloning, all-in-one build

Scores are from Artificial Analysis’ Speech to Speech Index, a weighted average of speech reasoning (Big Bench Audio), agentic performance (τ-Voice), human arena preference and task success rate. Verified September 17, 2026; this list will change — re-check the index before committing.

1. Gemini 3.8 Live Extended Thinking — best overall

Released September 15, 2026, Google’s high-complexity live model took the #1 spot on the Speech to Speech Index at 82.6, with 68.6% on τ-Voice, 35.1% on Sierra’s τ-Voice-banking and 97.7% on Big Bench Audio. Its signature trick is reasoning and speaking at once: it acknowledges with “Let me check that…”, narrates progress on multi-step background tasks, and finishes without dead air. It auto-switches among 97 languages, parses alphanumerics (claim numbers, confirmation codes) reliably, and accepts near-real-time visual input. Configurable thinking is exposed in the Live API.

Price: $0.005/min in, $0.018/min out — the same as plain 3.8 Live, which makes it the cheapest frontier voice model on this list per minute. Availability: Gemini Live API, Google AI Studio, private preview in Gemini Enterprise, and consumer surfaces (Gemini Live, Docs for AI Pro/Ultra, Gmail and Keep). Not open-weights.

2. GPT-Live-1 — best full-duplex conversation

OpenAI’s GPT-Live-1 shipped in ChatGPT in July 2026 and in the API on September 10, 2026. It is a true full-duplex model — it listens while it speaks — and OpenAI reports a 30-point lead over GPT-Realtime-2.1 on Full Duplex Bench. It delegates reasoning and tool calls to a backend text model of your choice (GPT-6 Astra, GPT-5.6 Terra or Luna, or third-party), which is why the AA index lists it per configuration: 81.5 with Astra (medium), 80.1 with Sol (low). Before Gemini 3.8 Live Extended Thinking, the Astra configuration was #1.

Price: $0.05/min for the voice layer, billed per second, plus backend tokens — trivial with Luna ($0.20/$1.20 per MTok), material with Astra ($10/$50). Supports telephony, ASR transcripts, keyword biasing and explicit turn detection.

3. Gemini 3.8 Live — best value at scale

The “scale and cost efficiency” sibling, also September 15, 2026. It placed second in the Speech Agent Arena, the blind human-preference test, and shares Extended Thinking’s 97-language switching, background tool calls and visual grounding — without the deep multi-step reasoning. At $0.005/$0.018 per minute it is the model to default to for high-volume assistants where a human rated it nearly as well as anything and the tasks are one or two steps deep.

4. GPT-Realtime-2.1 — best single-model, turn-based agent

Released July 6, 2026, GPT-Realtime-2.1 is OpenAI’s speech-to-speech model that does voice and reasoning in one network, turn-based. Billing is per audio token — $32 in / $64 out per million, cached input $0.40 — which OpenAI estimates at about $0.05 per conversation minute. Pick it when you want strict turn boundaries, one line item and no backend-model decision. As of September 2026 OpenAI positions GPT-Live-1 as the natural-conversation upgrade, not a replacement.

5. GPT-Realtime-2.1-mini — best budget option

The mini variant (July 7, 2026) costs $10/$20 per million audio tokens, about $0.016 per minute — a third of full Realtime-2.1 and comparable to Gemini 3.8 Live’s all-in rate. Quality is a step down, but for menu-style IVR, appointment confirmations and FAQ bots it is the cheapest OpenAI voice.

6. ElevenLabs Agents — best voices, not a native model

ElevenLabs Agents is an orchestration platform (STT, pluggable LLM, ElevenLabs TTS) rather than a single speech-to-speech network, so it does not appear on the native index. It earns a slot because for many products the voice is the brand: the largest voice library, best-in-class cloning, and an all-in-one builder. Reported pricing is around $0.08–0.10 per minute with the LLM bundled. Turn-taking is fast but not simultaneous.

How to choose

  1. Multi-step tasks on the call (bookings, account changes, banking)? → Gemini 3.8 Live Extended Thinking.
  2. Callers talk over the agent; you want your own reasoning model? → GPT-Live-1.
  3. Millions of short calls, tight budget, human-rated quality still matters? → Gemini 3.8 Live or GPT-Realtime-2.1-mini.
  4. One model, one bill, strict turns? → GPT-Realtime-2.1.
  5. A specific brand voice or cloned voice? → ElevenLabs Agents (or ElevenLabs TTS behind a native model via LiveKit/Pipecat).
  6. Need to self-host? → None of the above. The open-weights speech-to-speech tier trails the hosted frontier substantially in 2026; treat it as a separate category.

Three things the benchmarks do not tell you

  • Cost is dominated by talk time, not list price. A verbose agent on a cheap model can out-spend a terse one on an expensive model; measure minutes of output audio in your own pilot.
  • Full-duplex changes UX design. GPT-Live-1’s simultaneous listening means your prompts must handle backchannels (“mm-hm”) that turn-based models never see.
  • Watermarking and compliance differ. All Gemini audio carries a SynthID watermark; check each vendor’s data-retention and telephony-recording terms before deploying in regulated industries.

Sources