VFF - The signal in the noise
NewsTrending

Thinking Machines Previews Full-Duplex AI for Real-Time Conversation

Read original
Share
Thinking Machines Previews Full-Duplex AI for Real-Time Conversation

Thinking Machines, the AI startup founded by former OpenAI CTO Mira Murati and researcher John Schulman, has unveiled a research preview of 'interaction models' designed to enable near-real-time, simultaneous voice and video conversation with AI. Rather than the current turn-based model where users input and wait for output, these systems use a full-duplex architecture that processes 200ms chunks of input and output concurrently, allowing the AI to listen, speak, and see in real time. The company demonstrated the approach with TML-Interaction-Small, a 276-billion parameter Mixture-of-Experts model, paired with a background reasoning system for complex tasks. A limited research preview will launch in coming months, with broader availability expected later in 2026.

  • Thinking Machines previewed 'interaction models' that enable simultaneous input/output processing instead of turn-based chat, using a full-duplex architecture processing 200ms chunks concurrently
  • The system uses encoder-free early fusion to ingest raw audio and image patches directly, co-training all components within the transformer rather than relying on separate encoders
  • A dual-model architecture separates real-time interaction handling from background reasoning tasks, allowing the AI to respond immediately while delegating complex work asynchronously
  • TML-Interaction-Small is a 276-billion parameter MoE model with 12 billion active parameters, achieving competitive performance on third-party benchmarks with reduced latency

The shift from turn-based to simultaneous input/output processing addresses a fundamental constraint in current AI interaction: users must wait for model responses before continuing, creating friction in natural conversation. If Thinking Machines can deliver on this architecture at scale, it could reshape how AI handles real-time collaboration, live translation, and dynamic visual understanding. This represents a meaningful architectural departure from how frontier models currently process information, potentially influencing how competitors design their next-generation systems.

For operators and founders, this signals that the next competitive frontier in AI may be interaction latency and naturalness rather than raw capability alone. Companies building customer-facing AI products, live collaboration tools, or real-time assistance systems could gain significant UX advantages if they adopt similar full-duplex architectures. The dual-model approach also offers a practical template for balancing immediate responsiveness with deep reasoning, a tradeoff that affects product design and infrastructure costs.

  • Turn-based interaction may become a legacy constraint as full-duplex systems mature, forcing product teams to rethink UI/UX patterns built around waiting for model responses
  • The encoder-free early fusion approach could reduce model complexity and latency by eliminating separate audio/vision encoders, potentially lowering inference costs and enabling deployment on edge devices
  • Dual-model architectures separating real-time interaction from background reasoning may become a standard pattern, allowing teams to optimize for different latency and compute requirements within a single system

Monitor whether Thinking Machines' research preview demonstrates meaningful latency improvements and naturalness gains in real-world use cases when it opens to limited testers. Watch for competitive responses from OpenAI, Anthropic, and Google, which may accelerate their own work on simultaneous input/output processing. Track adoption patterns once broader availability launches, particularly in customer support, live translation, and collaborative coding tools where real-time interaction is most valuable.

Share

Subscribe to the newsletter

The latest stories and analysis, delivered to your inbox.

Free. No spam. Unsubscribe any time.

Related stories

Google DeepMind Launches Sign Language AI for Deaf Users
TrendingNews

Google DeepMind Launches Sign Language AI for Deaf Users

Google DeepMind has introduced sign-language-to-text (SL2T), a new AI model that converts sign language into text for Deaf and hard of hearing users. The model powers new sign language features designed to improve accessibility. The announcement marks a significant step in making AI tools more inclusive for sign language users.

· Google Deepmind
NVIDIA Opens Alpamayo 2 Super for Commercial AV Use
TrendingModel Release

NVIDIA Opens Alpamayo 2 Super for Commercial AV Use

NVIDIA has released Alpamayo 2 Super, an open-source reasoning model for autonomous vehicles, under a permissive commercial license. The model ranks first on autonomous driving benchmarks and is designed to handle complex, rare scenarios that challenge AV systems. The release includes a cloud-to-vehicle workflow that pairs frontier-scale reasoning in development with efficient, specialized models for production deployment.

by Jessica Soares· NVIDIA Blog (AI)
Google DeepMind Releases Gemini Robotics 2 for Whole-Body Robot Control
TrendingModel Release

Google DeepMind Releases Gemini Robotics 2 for Whole-Body Robot Control

Google DeepMind introduced Gemini Robotics 2, a suite of AI models designed to give robots whole-body control, dexterous manipulation, and multi-robot collaboration capabilities. The system includes three models: a vision-language-action model for motor control, an embodied reasoning model for planning and communication, and an on-device model optimized for fast adaptation to new robot bodies. Early-access partners can now deploy these models on humanoid and bi-arm robots to perform complex, multi-step tasks in unstructured environments.

· Google Deepmind
Brain Waves Join Video as Physical AI Training Data
TrendingNews

Brain Waves Join Video as Physical AI Training Data

Frontier physical AI models are moving beyond video training data to incorporate multiple camera angles, dense annotation, and brain wave readings as training inputs. The shift reflects growing recognition that traditional video datasets alone are insufficient for training AI systems that interact with the physical world. Brain wave data represents an emerging frontier in multimodal training approaches for robotics and embodied AI.

by Tim Fernholz· TechCrunch AI