VFF - The signal in the noise
News

IBS Software cuts cargo NER costs 14x with Bedrock distillation

Read original
Share
IBS Software cuts cargo NER costs 14x with Bedrock distillation

IBS Software deployed a bilingual named entity recognition system for cargo logistics using Amazon Bedrock's model distillation, extracting 23 entity types from English and Japanese email messages. The system distilled knowledge from Amazon Nova Pro into the lighter Nova Lite model, achieving 95.085 percent F1-Score accuracy while cutting operational costs by 14x. The solution processes thousands of cargo emails daily in real time, replacing manual intervention that previously slowed operations.

  • IBS Software built a bilingual NER system extracting 23 entity types (AWB numbers, flight details, weights, delivery instructions) from cargo logistics emails in English and Japanese
  • Used Amazon Bedrock model distillation to compress Nova Pro into Nova Lite, achieving 95.085% F1-Score accuracy with 14x cost reduction
  • Team of 9 researchers and engineers completed the project in 4 months, annotating 500 bilingual emails (350 English, 150 Japanese) and training the student model over 70 steps
  • System now processes thousands of cargo emails daily in real time, eliminating manual intervention bottlenecks

Model distillation is emerging as a practical path to deploy AI systems at scale without prohibitive inference costs. This case demonstrates that smaller, specialized models can match larger ones on domain-specific tasks when properly trained, making enterprise AI deployment more economically viable for organizations processing high-volume multilingual data.

Cargo logistics relies on rapid, accurate data extraction from unstructured email. Manual intervention creates operational delays and errors. By automating entity extraction across two languages with 95% accuracy at 14x lower cost than alternatives, IBS Software reduced processing friction and improved throughput without sacrificing quality or requiring expensive infrastructure.

  • Model distillation can deliver production-grade accuracy on specialized tasks while significantly reducing inference costs, making it viable for high-volume operational workflows
  • Bilingual and multilingual NER is achievable with managed distillation tools, lowering the barrier for companies serving global supply chains
  • Domain-specific annotation (500 emails) combined with knowledge distillation can outperform generic open-source frameworks, suggesting a shift toward purpose-built AI solutions over general-purpose tools

Monitor whether other logistics and supply chain companies adopt similar distillation approaches for multilingual document processing. Watch for adoption patterns across industries handling high-volume unstructured data in multiple languages, and track whether managed distillation becomes standard practice for cost-sensitive enterprise deployments.

Share

Subscribe to the newsletter

The latest stories and analysis, delivered to your inbox.

Free. No spam. Unsubscribe any time.

Related stories

IBM to train tens of thousands of consultants on OpenAI tech

IBM to train tens of thousands of consultants on OpenAI tech

IBM has partnered with OpenAI to expand enterprise AI adoption, with plans to train and certify tens of thousands of consultants on OpenAI's technologies. The deal positions IBM to deepen its consulting services around generative AI for corporate clients. This move reflects intensifying competition among enterprise software vendors to build AI-native service capabilities.

by Jagmeet Singh· TechCrunch AI
Apple Builds Custom AI Model for China with Alibaba

Apple Builds Custom AI Model for China with Alibaba

Apple has developed a custom large language model for the Chinese market in partnership with Alibaba, marking a shift from its previous reliance on domestic Chinese AI solutions. The collaboration represents a rare cross-border tech partnership amid escalating US-China tensions. The move gives Apple greater control over its AI products in China's competitive smartphone market.

by Robert Hart· The Verge AI
OpenAI Appoints Wiz COO as New Chief Revenue Officer
TrendingNews

OpenAI Appoints Wiz COO as New Chief Revenue Officer

OpenAI has appointed Dali Rajic, president and chief operating officer of Alphabet-owned cybersecurity firm Wiz, as its new chief revenue officer. Rajic replaces Denise Dresser, who is departing to pursue other opportunities after a transition period. The move signals OpenAI's focus on scaling revenue operations as the company continues to expand its commercial offerings.

by Stephanie Palazzolo· The Information
Capital One Builds Multi-Agent AI on Customized Open Models
TrendingNews

Capital One Builds Multi-Agent AI on Customized Open Models

Capital One built a multi-agent AI platform centered on customized open-weight models rather than relying on off-the-shelf frontier models. The bank fine-tunes open models with proprietary data and uses a specialized multi-agent orchestration system called MACAW to handle complex workflows like fraud detection and customer service. This approach leverages Capital One's data advantage while enabling extensibility across the enterprise.

· VentureBeat AI