AI2 releases Olmo-core 3 to accelerate open mixture-of-experts training

The Allen Institute for AI has launched Olmo-core 3, an open mixture-of-experts training framework. The redesigned stack keeps experts resident on GPUs to boost efficiency. It achieves up to 2.7 times higher throughput compared to standard Fully Sharded Data Parallel approaches at trillion-parameter scale.

Scaling frontier architectures often strains infrastructure budgets and hardware efficiency. High-throughput open frameworks help enterprise teams train massive mixture-of-experts models with significantly reduced compute overhead.

  • Redesigned training framework retains expert parameters directly on GPUs
  • Delivers up to 2.7x throughput improvements over conventional FSDP
  • Engineered to support efficient model training at trillion-parameter scale
Sovereign AI Generative AI Machine Learning
All AI news

More AI news

Models

Global AI divide forces non-aligned nations to balance US and Chinese technologies

Geopolitical competition between the United States and China is creating distinct artificial intelligence blocs across the globe. Non-aligned nations such as Kazakhstan and Indonesia are navigating dual partnerships, seeking to secure infrastructure and computational capacity from both superpowers without becoming locked into either side.

Models

Moonshot AI introduces Kimi K3.1 Pro and high-speed variant for commercial evaluation

Moonshot AI has officially launched its Kimi K3.1 Pro model alongside a dedicated high-speed version designed for faster processing. Organisations assessing the release are scrutinising operational costs and vendor data handling policies before committing to production deployment.

Models

Kimi K3.1 Pro secures fifth place on the SevenLab AI leaderboard

Kimi K3.1 Pro by developer Kimi has officially entered the top ten on the SevenLab AI leaderboard, securing fifth position overall. The benchmark tracks leading foundation models using a specialised value-adjusted methodology derived from Artificial Analysis evaluation data.

Ready to build something extraordinary?

15 minutes. No pitch deck. Just a conversation about what AI can do for your team.

Talk directly with our AI specialists

15 min, no strings
No sales pressure
Prototype in 7 days