VFF - The signal in the noise

bendee983@gmail.com (Ben Dickson)

25 articles on VFF - The signal in the noise

Meta's EvoHarness-RL Teaches Smaller Models to Self-Manage Task Execution

Meta's EvoHarness-RL Teaches Smaller Models to Self-Manage Task Execution

Researchers at Meta AI and University of Illinois Urbana-Champaign developed EvoHarness-RL, a training framework that enables smaller AI models to perform complex, long-horizon tasks by learning to dynamically manage their execution environment rather than following rigid, manually-coded instructions. The approach consolidates agent support systems into a unified Belief, Progress, and Experience workspace, allowing models to independently decide when and how to consult external state during workflows. This addresses a key limitation in current agentic systems where manual prompts and static memory structures require extensive retuning for each model upgrade.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Nvidia cuts model handoff costs with linear math KV cache transfer

Nvidia cuts model handoff costs with linear math KV cache transfer

Nvidia researchers have developed a technique that uses linear math to transfer key-value caches between different AI models without recomputing conversation history. The method enables enterprises to switch between small and large models mid-session while reducing compute costs and latency by 2.7 to 25 times compared to traditional recomputation, retaining up to 98% accuracy on compatible model pairs.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Stanford's 37,000-Agent Virtual Biotech Outperforms Single Models
Research

Stanford's 37,000-Agent Virtual Biotech Outperforms Single Models

Stanford researchers led by James Zou have built a virtual biotech system running 37,000 AI agents organized into corporate divisions that mirrors a real pharmaceutical company structure. One of the system's drug designs was independently confirmed by Merck. The research demonstrates that orchestrating thousands of specialized agents produces more robust scientific reasoning than single large models, though data integration and legacy system compatibility remain significant technical challenges.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Multi-Agent Coordination Outperforms Single Advanced Models on Code Tasks

Multi-Agent Coordination Outperforms Single Advanced Models on Code Tasks

Researchers at Coral AI Labs introduced AgentRadio, an asynchronous messaging system that lets multiple AI agents coordinate in real time while solving complex coding tasks. In benchmarks on production codebases, four Claude Code agents using AgentRadio nearly doubled task accuracy compared to single agents, and outperformed Claude Opus 4.8 running alone. The system addresses a fundamental limitation in multi-agent AI: most existing architectures force agents to work in isolation or wait for synchronized communication rounds, preventing them from sharing discoveries that could redirect entire investigation paths.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Structured pipelines beat free-form code for AI data engineering

Structured pipelines beat free-form code for AI data engineering

Researchers from Peking University and partner institutions released DataFlow-Harness, an open-source framework that guides AI agents to build structured data pipelines instead of free-form code. The tool addresses a production gap where LLMs excel at one-off scripts but struggle with complex, auditable workflows needed for enterprise systems. DataFlow-Harness achieves 93.3% success on a 12-task benchmark while reducing API costs by up to 72.5% and latency by 49.9% compared to standard Claude Code.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
How Runway Turned a Bug Into a Feature

How Runway Turned a Bug Into a Feature

Runway ML shared insights on building real-time AI video models at VB Transform 2026, revealing that the company turned a persistent avatar drift bug into a front-end feature rather than fixing it at the back-end. Head of enterprise product Ryan Phillips emphasized that robust AI product development requires cross-functional alignment on quality definitions, manual evaluation using simple tools like Excel spreadsheets, and leveraging language models to automate visual grading at scale. The company uses model distillation to achieve real-time latency for its Runway Characters product, which generates interactive video with AI avatars on the fly.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Multi-Model AI Systems Fail More Often Than Enterprises Realize

Multi-Model AI Systems Fail More Often Than Enterprises Realize

A study of 67 frontier models from 21 providers reveals that enterprises using multiple AI models significantly underestimate failure rates by 2.25x due to a phenomenon called the co-failure ceiling. The research shows that combining diverse models based on low pairwise error correlation does not reliably improve performance, and in some cases can degrade it when models have unequal capabilities. Developers are investing in complex routing infrastructure and multi-model orchestration that often fails to deliver promised safety benefits.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Alibaba cuts agent token use 99% with smarter tool routing
TrendingNews

Alibaba cuts agent token use 99% with smarter tool routing

Alibaba researchers developed SkillWeaver, a framework that reduces token consumption by over 99% when routing AI agents to the correct tools from large libraries. The system uses a three-stage process (decompose, retrieve, compose) combined with Skill-Aware Decomposition to iteratively fetch and evaluate relevant tools rather than exposing agents to entire tool catalogs. This addresses a core challenge in enterprise AI systems where agents must orchestrate multiple tools to complete complex, multi-step workflows.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
New agentic memory cuts token use 27x vs. competitors

New agentic memory cuts token use 27x vs. competitors

Researchers at the National University of Singapore developed MRAgent, a framework that dynamically reconstructs memory during reasoning rather than passively retrieving documents upfront. The approach significantly reduces token consumption and runtime costs compared to existing agentic memory systems, addressing a core limitation where context windows fill with irrelevant noise during long-horizon reasoning tasks.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Xiaomi's HarnessX Automates AI Agent Scaffolding

Xiaomi's HarnessX Automates AI Agent Scaffolding

Xiaomi researchers introduced HarnessX, a framework that autonomously improves the software scaffolding connecting large language models to their operational environments. Rather than requiring manual rewrites, HarnessX treats the harness as a modular, composable object that can adapt mid-task based on execution data. Testing showed average performance gains of 14.5% across 15 model-benchmark combinations, with smaller models like Qwen3.5-9B seeing gains up to 44% on embodied planning tasks.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Self-Improving Agents: Shanghai Lab Cuts Manual Tuning

Self-Improving Agents: Shanghai Lab Cuts Manual Tuning

Researchers at Shanghai Artificial Intelligence Laboratory have introduced Self-Harness, a framework that enables LLM-based agents to automatically improve their own operating rules by analyzing execution traces and applying empirical edits. The system achieves performance improvements up to 60 percent without requiring manual tuning or stronger external models. This addresses a key bottleneck in agent development: the reliance on ad hoc human debugging rather than systematic feedback loops.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Arbor Framework Achieves 2.5x Better AI Optimization on Same Compute

Arbor Framework Achieves 2.5x Better AI Optimization on Same Compute

Researchers at Renmin University of China and Microsoft Research introduced Arbor, an optimization framework that organizes AI research into a tree structure to enable cumulative learning from failures. In tests, Arbor delivered 2.5 times greater performance gains than standard AI coding agents on real-world engineering tasks within the same compute budget. The framework addresses a core limitation in autonomous optimization: most AI agents treat each attempt in isolation and lose insights across long experimental sequences.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Google's 'Faithful Uncertainty' Lets LLMs Hedge Instead of Hallucinate
TrendingNews

Google's 'Faithful Uncertainty' Lets LLMs Hedge Instead of Hallucinate

Google researchers propose 'faithful uncertainty,' a technique that allows large language models to express qualified guesses rather than either confidently hallucinating or refusing to answer. The approach reframes hallucinations as 'confident errors' and enables models to hedge responses appropriately, preserving utility while maintaining trustworthiness. This addresses a core tradeoff in LLM deployment where eliminating factual errors typically forces models to abstain from answering questions they actually know.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Microsoft SkillOpt Automates AI Agent Skill Optimization

Microsoft SkillOpt Automates AI Agent Skill Optimization

Microsoft has released SkillOpt, an open-source framework that automatically optimizes AI agent skills, the text-based instructions that guide model behavior in enterprise workflows. Unlike manual skill editing, SkillOpt applies deep-learning-style optimization to evolve skill documents based on performance feedback without modifying the underlying model weights. The tool addresses three recurring failure modes in skill optimization: lack of step-size control, absence of validation, and no negative memory to prevent repeated failed edits.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
MeMo Framework Enables LLM Knowledge Updates Without Retraining

MeMo Framework Enables LLM Knowledge Updates Without Retraining

Researchers have developed MeMo, a framework that lets teams add new knowledge to large language models without retraining them. The approach uses a separate smaller memory model to encode new information, achieving 26% performance gains while avoiding the cost and complexity of full model updates. MeMo works with both open and closed-source models and sidesteps limitations of retrieval-augmented generation and fine-tuning approaches.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Automated LLM reasoning cuts token costs by 70 percent

Automated LLM reasoning cuts token costs by 70 percent

Researchers from Meta, Google, and universities have developed AutoTTS, a framework that automatically discovers optimal test-time scaling strategies for large language models. Rather than relying on manually crafted heuristics, AutoTTS uses an explorer LLM to algorithmically search for resource-allocation policies. In trials, the approach reduced token consumption by up to 69.5% without sacrificing accuracy, offering enterprises a way to lower inference costs.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Lightweight Memory Technique Cuts Agent Parameter Overhead to 0.12%
Research

Lightweight Memory Technique Cuts Agent Parameter Overhead to 0.12%

Researchers from Mind Lab and universities have developed delta-mem, a technique that adds just 0.12% of parameters to language models to give AI agents persistent working memory for long-running tasks. The approach compresses historical interactions into a dynamically updated matrix without modifying the underlying model, outperforming alternatives that require 76% more parameters while reducing reliance on expensive context window expansion or RAG systems.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
RecursiveMAS cuts multi-agent costs by 75% with latent-space communication
Research

RecursiveMAS cuts multi-agent costs by 75% with latent-space communication

Researchers at University of Illinois Urbana-Champaign and Stanford University have developed RecursiveMAS, a framework that enables multi-agent systems to communicate through embedding space rather than text sequences. The approach achieves 2.4x faster inference, 75% reduction in token usage, and improved accuracy across code generation, medical reasoning, and search tasks while being significantly cheaper to train than standard fine-tuning methods. By treating agents as layers in a recursive system that pass latent representations rather than text, RecursiveMAS eliminates sequential bottlenecks and enables the entire system to evolve as a unified whole.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Frontier LLMs Silently Corrupt 25% of Documents in Iterative Workflows
Research

Frontier LLMs Silently Corrupt 25% of Documents in Iterative Workflows

Microsoft researchers developed a benchmark showing that frontier LLMs silently corrupt an average of 25% of document content when performing multi-step autonomous workflows across 52 professional domains. The study, which uses a round-trip relay method to measure content degradation without human annotation, reveals that providing models with agentic tools or realistic distractor documents actually worsens performance. The findings underscore a critical gap between the pressure to automate knowledge work and the current reliability of language models for delegated tasks where users expect faithful document handling.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Sakana trains 7B model to orchestrate GPT, Claude, Gemini

Sakana trains 7B model to orchestrate GPT, Claude, Gemini

Sakana AI has developed RL Conductor, a 7-billion-parameter language model trained via reinforcement learning to automatically orchestrate calls to larger frontier models like GPT-5, Claude Sonnet 4, and Gemini 2.5 Pro. Rather than relying on hard-coded routing logic, the model learns to dynamically analyze inputs, distribute work among specialized agents, and coordinate responses. The approach achieves state-of-the-art results on reasoning and coding benchmarks while reducing API costs and call volume compared to both individual frontier models and manually designed multi-agent systems.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Alibaba cuts AI agent tool calls 49x with decoupled optimization
Research

Alibaba cuts AI agent tool calls 49x with decoupled optimization

Alibaba researchers introduced Hierarchical Decoupled Policy Optimization (HDPO), a reinforcement learning framework that trains AI agents to use external tools more judiciously. Their Metis model reduced redundant tool calls from 98% to 2% while improving reasoning accuracy on industry benchmarks. The framework addresses a core inefficiency in current agentic systems: models trained to maximize task completion blindly invoke APIs and tools even when internal knowledge suffices, creating latency bottlenecks, API costs, and reasoning degradation from environmental noise.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
New Training Method Cuts Reasoning Model Costs for Enterprises
Research

New Training Method Cuts Reasoning Model Costs for Enterprises

Researchers at JD.com and academic partners introduced RLSD (Reinforcement Learning with Verifiable Rewards with Self-Distillation), a training method that combines reinforcement learning's outcome tracking with self-distillation's granular feedback to build custom reasoning models at lower computational cost. The technique addresses fundamental limitations in existing approaches: standard reinforcement learning provides only sparse binary rewards that fail to credit specific reasoning steps, while on-policy distillation requires running a massive teacher model in parallel, doubling GPU overhead and limiting cross-architecture deployment. RLSD sidesteps privileged information leakage problems that plagued earlier self-distillation attempts, making custom reasoning models more accessible to enterprise teams without massive compute budgets.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Autonomous AI Framework Outperforms Human Baselines on Architecture and Data Optimization

Autonomous AI Framework Outperforms Human Baselines on Architecture and Data Optimization

Researchers at SII-GAIR have developed ASI-EVOLVE, an autonomous framework that optimizes AI training data, model architectures, and learning algorithms through a continuous learn-design-experiment-analyze loop. The system demonstrated the ability to discover novel language model designs and improve pretraining pipelines by over 18 points on benchmarks, outperforming human-designed baselines. By automating the full R&D cycle, the framework addresses a core bottleneck in AI development where manual engineering effort and siloed knowledge limit the pace of innovation.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source
Meta's Hyperagents Enable Self-Improving AI Beyond Coding

Meta's Hyperagents Enable Self-Improving AI Beyond Coding

Meta researchers have introduced hyperagents, a self-improving AI framework that can continuously rewrite and optimize its own logic without relying on fixed, handcrafted improvement mechanisms. Unlike existing systems such as Sakana AI's Darwin Gödel Machine, which excel at self-improvement in coding tasks, hyperagents can self-improve across non-coding domains like robotics and document review by independently inventing general-purpose capabilities such as persistent memory and automated performance tracking. The system addresses a critical limitation of current approaches: they require constant manual engineering and domain-specific customization because improving task performance in non-coding domains does not automatically improve the agent's ability to modify its own behavior.

by bendee983@gmail.com (Ben Dickson)· VentureBeat AI
Source