GPT-Live

Sources#

How we built a realtime system for responsive voice AI in six months

What it is#

OpenAI's third-generation voice system, launched July 2026 — a full-duplex voice model (Full-Duplex Interaction) that listens and speaks at the same time, with the surrounding realtime serving system built over six months (Live-Path Minimalism). The load-bearing design choice: the voice model, not a harness, is in control of the conversation. Audio streams in and out of the model continuously; there is no turn detector anywhere in the audio path.

The three generations it closes out#

OpenAI's own framing of the lineage:

Cascaded — speech-to-text → LLM → text-to-speech in series. Sequencing added latency and threw away tone and pacing.
Speech-to-speech (Advanced Voice Mode) — the model processes audio directly, preserving detail lost in transcription — but inference still waited on a separate turn detector: "guess too soon, and the user gets cut off; guess too late, and the response feels sluggish. Only after the detector made its decision could the much larger LLM get to work." In the post's words: "The model handled more of the interaction, but the interaction remained turn-based."
GPT-Live — full-duplex; the detector is gone; turn-taking is model behavior. The dissolution Turn-Based Interface Bottleneck predicted for exactly this component.

Two models, one conversation#

When deeper reasoning or tool use is needed, GPT-Live delegates to frontier models such as GPT-5.5 on an asynchronous path — OpenAI's phrase is "effectively decoupling 'talking' from deeper 'thinking'". This is the Interaction / Background Model Split arrived at independently and shipped at ChatGPT scale: the voice model briefly keeps the exchange moving while the frontier model reasons, and results are incorporated without interrupting the flow. The delegation loop is engineered as a latency budget (pre-warmed prefilled inference sessions, session affinity, prompt caching — details on Live-Path Minimalism).

Deployment#

Validated by a silent shadow test: a gradually increasing share of production ChatGPT Voice sessions was mirrored to both Advanced Voice Mode (still serving users) and GPT-Live running read-only, exposing it to real clients, networks, session lengths, and geography before any user heard it.
Powers ChatGPT Voice, including the newly launched ability to control your computer and coordinate agents from the ChatGPT desktop app — voice as a surface over agentic capability rather than a standalone feature.
A GPT-Live API is announced as upcoming; OpenAI positions the architecture as "a broader platform for realtime interaction" spanning more devices, apps, and modalities.

Connections#

OpenAI — builder; the post is OpenAI's first-party build account
Live-Path Minimalism — the serving architecture built for it: "the voice must flow"
Full-Duplex Interaction — the interaction property it ships in production (audio-only; TML's generalization to video/text remains a research preview)
Interaction / Background Model Split — the two-model talking/thinking architecture it independently converges on
Turn-Based Interface Bottleneck — the harness component it dissolved, and the nuance that turns survive as a derived application-layer view
TML-Interaction-Small — the research-preview sibling: same architectural conclusions from Thinking Machines Lab two months earlier, generalized past audio, with disclosed internals

Sources#

How we built a realtime system for responsive voice AI in six months — OpenAI engineering blog, 2026-07-29 (case-study, first-party): the system-architecture account. The separate "Introducing GPT-Live" launch post is not in the corpus; capability and product claims here are limited to what the engineering post states.