AI agents · OpenClaw · self-hosting · automation

Quick Answer

Best Open-Source Voice Agent Frameworks 2026: Compared

Published:

The short answer

Use Pipecat for maximum provider choice, LiveKit Agents for an integrated WebRTC-plus-telephony stack, and treat TEN as an option only if its Agora licence conditions fit you. A voice agent framework handles the hard real-time parts — audio transport, voice activity detection, turn-taking, interruptions and streaming between speech-to-text (STT), the LLM and text-to-speech (TTS). Versions and stars read from GitHub on November 18, 2026:

FrameworkLicence · versionStarsLanguageTransportManaged hostingBest for
PipecatBSD-2-Clause · v1.16.0 (Nov 12, 2026)~17,300Python (+ JS, React, Swift, Kotlin, C++, ESP32 clients)Daily WebRTC, WebSockets, Twilio, SIPPipecat Cloud (Daily)Mixing many STT/LLM/TTS providers
LiveKit AgentsApache-2.0 · 1.8.12 (Nov 13, 2026)~15,300 (+ agents-js)Python, Node.jsLiveKit WebRTC, SIP telephonyLiveKit CloudOne integrated, self-hostable stack
TEN FrameworkApache-2.0 + extra conditions · 0.11.75 (Nov 3, 2026)~11,200C++/Go/Python/Node extensionsAgora RTC, WebSocket, SIPAgoraAgora customers, avatars, hardware demos

If you would rather buy a finished platform than build, compare voice agent platform pricing per minute. Older options such as Vocode have had no commits since November 2024.

1. Pipecat — best for provider choice

Pipecat is a Python framework where each agent is a pipeline of processors: transport in, STT, LLM, TTS, transport out. It integrates 80+ services (Anthropic, OpenAI, Google, Deepgram, Cartesia, ElevenLabs and more), so swapping a model is a config change. Pipecat Flows (built in) adds structured conversation paths with state; multi-agent support lets pipelines hand off, fan out in parallel or run sidecar workers over a shared bus. Tooling includes a CLI (pipecat init), the Whisker debugger, a terminal dashboard and Claude Code skills for scaffolding and deploying.

Hosting: Pipecat Cloud charges per active minute — agent-1x (0.5 vCPU, 1 GB) $0.01/min, agent-2x $0.02, agent-3x $0.03 — with reserved warm agents from $0.0005/min. Daily WebRTC voice is free for 1:1 sessions on Pipecat Cloud; SIP costs $0.003–$0.02/min and PSTN $0.018/min.

2. LiveKit Agents — best integrated stack

LiveKit Agents runs agents as server-side participants in LiveKit rooms. You get job scheduling and dispatch APIs, SIP telephony for inbound and outbound calls, RPC and data channels to clients, a transformer-based semantic turn detector to reduce interruptions, native MCP tool support and a built-in test framework with LLM judges. The whole stack, including the LiveKit media server, is open source and self-hostable.

Hosting: LiveKit Cloud’s Build plan is free (with inference credits), Ship starts at $50/month and Scale at $500/month. Agent sessions are $0.01/min; LiveKit Inference resells STT, LLM and TTS per minute (for example Deepgram Nova-3 at $0.0048/min). For transport alternatives, see cloud providers for real-time audio streaming.

3. TEN Framework — capable, but check the licence

TEN (from Agora) ships a multi-purpose voice assistant example, real-time diarization, Live2D and video avatars (Trulience, HeyGen, Tavus), SIP calling and an ESP32 hardware demo, plus its own open VAD and turn-detection models. Its licence is Apache 2.0 with added conditions: no hosting on end-user devices such as phones, and no deployment that competes with Agora’s offerings. That rules it out for many products.

How to choose

  1. Latency budget first. End-to-end voice latency is mostly STT finalisation, LLM time to first token and TTS first audio; the framework adds little. Benchmark the model endpoints with the tools in best LLM latency benchmarking tools.
  2. Phone or web? Phone-first agents favour LiveKit’s SIP stack or Pipecat with Twilio/Daily PSTN.
  3. Provider lock-in. Pipecat makes switching STT/TTS vendors easiest; compare vendors in speech-to-text API price per minute.
  4. Self-hosting. Both Pipecat and LiveKit run entirely on your own servers.

Last verified: November 18, 2026. Hosting prices from Daily’s Pipecat Cloud pricing page and LiveKit’s pricing page.

Sources