AI2 releases Olmo-core 3 to accelerate open mixture-of-experts training

The Allen Institute for AI has launched Olmo-core 3, an open mixture-of-experts training framework. The redesigned stack keeps experts resident on GPUs to boost efficiency. It achieves up to 2.7 times higher throughput compared to standard Fully Sharded Data Parallel approaches at trillion-parameter scale.

Scaling frontier architectures often strains infrastructure budgets and hardware efficiency. High-throughput open frameworks help enterprise teams train massive mixture-of-experts models with significantly reduced compute overhead.

  • Redesigned training framework retains expert parameters directly on GPUs
  • Delivers up to 2.7x throughput improvements over conventional FSDP
  • Engineered to support efficient model training at trillion-parameter scale
Sovereign AI Generative AI Machine Learning
All AI news

More AI news

Models

Selecting enterprise hardware for local LLMs prioritises memory capacity and bandwidth

Enterprise teams evaluating hardware for local language model execution must focus on memory capacity and bandwidth over raw compute power. Unified memory architecture allows development workstations to load larger parameter models directly into memory. Planning leaders are assessing these specifications to ensure cost-effective on-device inference.

Models

RouteStack introduces native Stripe ACP integration for travel AI agents

RouteStack.ai has launched a native integration with the Stripe Agentic Commerce Protocol (ACP). The update allows travel-focused AI agents to complete in-chat, API-based payments directly within conversation workflows.

Models

DeepSeek concludes 15 billion dollar funding round to fuel global AI race

Chinese artificial intelligence developer DeepSeek is concluding its latest investment round, raising approximately 100 billion yuan or 14.98 billion US dollars. The capital will be deployed to accelerate research and infrastructure development across the competitive AI landscape.

Ready to build something extraordinary?

15 minutes. No pitch deck. Just a conversation about what AI can do for your team.

Talk directly with our AI specialists

15 min, no strings
No sales pressure
Prototype in 7 days