VFF - The signal in the noise
News

Snowflake adds auto-routing to cut AI query costs up to 3x

Read original
Share
Snowflake adds auto-routing to cut AI query costs up to 3x

Snowflake has launched dynamic model routing in its Cortex AI Gateway, automatically selecting the most cost-effective model for each query rather than using a single fixed model. The company claims the capability can reduce token costs by up to 3x on some workloads by routing simple questions to cheaper models instead of expensive, high-capability ones. The move reflects a broader industry trend toward automated model routing, with competitors including Databricks, AWS, Google Cloud, and Nvidia announcing similar technologies.

  • Snowflake's Cortex AI Gateway now offers auto-routing that selects models based on task complexity and cost, with potential savings up to 3x on token usage
  • Two mechanisms power the routing: an advisor pattern where smaller models attempt tasks first before escalating, and a classifier trained on query history to route straightforward questions to simpler models
  • Routing respects existing access controls and governance boundaries, with customers able to restrict routing to approved model sets or pin specific models
  • Snowflake runs all inference, including open models like DeepSeek-V4-Flash and GLM-5.3, within its security boundary rather than routing to external providers

Enterprise AI deployments face a fundamental tradeoff: using a single capable model for all tasks wastes money on simple queries, while using cheaper models risks quality on complex ones. Automated routing addresses this by matching model capability to task difficulty, reducing unnecessary spending. This capability becomes increasingly important as enterprises scale AI agent deployments and face pressure to optimize cloud spending.

For enterprises running AI agents at scale, model routing directly impacts operational costs and performance. Snowflake's approach ties routing to existing governance and access controls, meaning IT teams can implement cost optimization without rebuilding security infrastructure. The optional nature of auto-routing allows gradual adoption while maintaining control over which models handle sensitive workloads.

  • Model routing is becoming table stakes for AI infrastructure providers, with at least five major vendors now offering some form of automated routing capability
  • Enterprises may need to reconsider their AI spending models, as routing to cheaper models for simple tasks could significantly reduce token costs without sacrificing quality
  • Governance and access control are becoming competitive differentiators, as providers must ensure routing decisions respect data residency, compliance, and permission boundaries

Monitor whether the claimed 3x cost savings hold across diverse enterprise workloads and use cases, as internal testing may not reflect production complexity. Watch for how competitors refine their routing capabilities and whether enterprises adopt auto-routing or prefer manual model selection for control. Track whether open models like DeepSeek and GLM-5.3 become viable for more workloads through better context and routing, potentially shifting spending away from proprietary models.

OneUpAI
OneUp Your Business. Get More Done. OneUp Your Business. Get More Done. OneUp Your Business. Get More Done.
Learn More
Share

Subscribe to the newsletter

The latest stories and analysis, delivered to your inbox.

Free. No spam. Unsubscribe any time.

Related stories

Felicis backs Unsiloed AI's $7.5M push into enterprise document processing

Felicis backs Unsiloed AI's $7.5M push into enterprise document processing

Felicis Ventures led a $7.5 million funding round for Unsiloed AI, a startup focused on making enterprise documents usable by AI agents. The seven-person team is entering a crowded market dominated by tech giants and specialized competitors. The funding signals investor confidence in document-processing solutions for enterprise AI workflows.

by Jagmeet Singh· TechCrunch AI
Google Expands Gemini Tasks for Calls and Purchases

Google Expands Gemini Tasks for Calls and Purchases

Google is expanding access to Gemini Tasks, a feature within its Gemini AI assistant that can perform actions on behalf of users, including coordinating calls, logging into websites, and making purchases. The expansion broadens availability of a capability that automates routine digital tasks. This move positions Gemini as a more functional agent for everyday user needs beyond conversational AI.

by Lucas Ropek· TechCrunch AI
Model ML raises $250M to automate investment banking work
TrendingNews

Model ML raises $250M to automate investment banking work

Model ML has raised $250 million to develop AI agents that automate investment banking work. The startup's technology understands deal context and automatically updates financial models and presentations when new developments affect analysis. The funding targets the high-volume, repetitive work that consumes significant banker and consultant time.

by Marina Temkin· TechCrunch AI
Pedestal AI lands $4.7M to automate supply chain operations
TrendingNews

Pedestal AI lands $4.7M to automate supply chain operations

Pedestal AI has raised $4.7 million in funding to develop agentic AI systems designed to optimize supply chain operations. The company focuses on using autonomous AI agents to improve speed and reliability across supply chain workflows. The funding round reflects growing investor interest in applying agent-based AI to operational challenges in logistics and procurement.

by Russell Brandom· TechCrunch AI