VFF - The signal in the noise
News

IBS Software cuts cargo NER costs 14x with Bedrock distillation

Read original
Share
IBS Software cuts cargo NER costs 14x with Bedrock distillation

IBS Software deployed a bilingual named entity recognition system for cargo logistics using Amazon Bedrock's model distillation, extracting 23 entity types from English and Japanese email messages. The system distilled knowledge from Amazon Nova Pro into the lighter Nova Lite model, achieving 95.085 percent F1-Score accuracy while cutting operational costs by 14x. The solution processes thousands of cargo emails daily in real time, replacing manual intervention that previously slowed operations.

  • IBS Software built a bilingual NER system extracting 23 entity types (AWB numbers, flight details, weights, delivery instructions) from cargo logistics emails in English and Japanese
  • Used Amazon Bedrock model distillation to compress Nova Pro into Nova Lite, achieving 95.085% F1-Score accuracy with 14x cost reduction
  • Team of 9 researchers and engineers completed the project in 4 months, annotating 500 bilingual emails (350 English, 150 Japanese) and training the student model over 70 steps
  • System now processes thousands of cargo emails daily in real time, eliminating manual intervention bottlenecks

Model distillation is emerging as a practical path to deploy AI systems at scale without prohibitive inference costs. This case demonstrates that smaller, specialized models can match larger ones on domain-specific tasks when properly trained, making enterprise AI deployment more economically viable for organizations processing high-volume multilingual data.

Cargo logistics relies on rapid, accurate data extraction from unstructured email. Manual intervention creates operational delays and errors. By automating entity extraction across two languages with 95% accuracy at 14x lower cost than alternatives, IBS Software reduced processing friction and improved throughput without sacrificing quality or requiring expensive infrastructure.

  • Model distillation can deliver production-grade accuracy on specialized tasks while significantly reducing inference costs, making it viable for high-volume operational workflows
  • Bilingual and multilingual NER is achievable with managed distillation tools, lowering the barrier for companies serving global supply chains
  • Domain-specific annotation (500 emails) combined with knowledge distillation can outperform generic open-source frameworks, suggesting a shift toward purpose-built AI solutions over general-purpose tools

Monitor whether other logistics and supply chain companies adopt similar distillation approaches for multilingual document processing. Watch for adoption patterns across industries handling high-volume unstructured data in multiple languages, and track whether managed distillation becomes standard practice for cost-sensitive enterprise deployments.

OneUpAI
OneUp Your Business. Get More Done. OneUp Your Business. Get More Done. OneUp Your Business. Get More Done.
Learn More
Share

Subscribe to the newsletter

The latest stories and analysis, delivered to your inbox.

Free. No spam. Unsubscribe any time.

Related stories

Meta Brings AI Agent Muse to Small Business Owners

Meta Brings AI Agent Muse to Small Business Owners

Meta is expanding its AI agent Muse to small business owners, positioning the tool as a way to help run operations and acquire new customers. The move represents Meta's effort to bring AI agent capabilities beyond enterprise users to the broader small business market. The expansion signals growing competition in the AI agent space as major tech companies target business automation use cases.

by Aisha Malik· TechCrunch AI
Reco lands $55M as AI agent security market heats up

Reco lands $55M as AI agent security market heats up

Reco, an AI agent security startup, raised $55 million in a new funding round, bringing its total funding to $140 million following a $30 million Series A in February. The company operates in a crowding market of AI agent security vendors as enterprises grapple with securing autonomous AI systems. The funding reflects investor confidence in the emerging category even as competition intensifies.

by Ram Iyer· TechCrunch AI
OpenAI Hits $70B Annualized Revenue on Enterprise Push
TrendingNews

OpenAI Hits $70B Annualized Revenue on Enterprise Push

OpenAI has reached an annualized revenue run rate of approximately $70 billion, representing roughly 70% growth from the beginning of the third quarter. The acceleration reflects the company's strategic pivot toward enterprise sales and aggressive price cuts on its services. This milestone underscores OpenAI's rapid scaling as a commercial entity and its dominance in the generative AI market.

by Stephanie Palazzolo· The Information
LiveRamp Expands OpenAI Partnership for ChatGPT Ad Targeting
TrendingNews

LiveRamp Expands OpenAI Partnership for ChatGPT Ad Targeting

LiveRamp announced an expansion of its partnership with OpenAI that will allow advertisers to target ads within ChatGPT using customer data they collect. The feature brings ChatGPT in line with advertising capabilities already available on Google and Meta. LiveRamp specializes in helping advertisers leverage customer data for ad targeting and measurement.

by Alix Coutures· The Information