AI2 releases Olmo-core 3 to accelerate open mixture-of-experts training

The Allen Institute for AI has launched Olmo-core 3, an open mixture-of-experts training framework. The redesigned stack keeps experts resident on GPUs to boost efficiency. It achieves up to 2.7 times higher throughput compared to standard Fully Sharded Data Parallel approaches at trillion-parameter scale.

Scaling frontier architectures often strains infrastructure budgets and hardware efficiency. High-throughput open frameworks help enterprise teams train massive mixture-of-experts models with significantly reduced compute overhead.

  • Redesigned training framework retains expert parameters directly on GPUs
  • Delivers up to 2.7x throughput improvements over conventional FSDP
  • Engineered to support efficient model training at trillion-parameter scale
Sovereign AI Generative AI Machine Learning
All AI news

More AI news

Models

Microsoft unveils Maia 300 inference chip and Meta debuts Muse Wonder model

Microsoft has announced Maia 300, a new proprietary processor engineered specifically for artificial intelligence inference workloads. Meanwhile, Meta has introduced Muse Wonder, categorised as its inaugural frontier model. These releases signal continued momentum in dedicated machine learning hardware alongside advanced foundation model development.

Models

Meta unveils Wonder frontier models to rival leading AI labs

Meta has announced two new frontier artificial intelligence models, named Wonder and Wonder Full. The organisation states that these releases offer performance on par with rival frontier systems from OpenAI and Anthropic.

Models

Meta's Muse Wonder Full enters SevenLab leaderboard at fourth place

Meta's Muse Wonder Full (max) model has debuted on the SevenLab AI leaderboard, securing fourth place overall. The ranking uses SevenLab's value-adjusted framework derived from benchmark data by ArtificialAnalysis. This milestone establishes the model as a strong new contender within the top tier of enterprise evaluations.

Ready to build something extraordinary?

15 minutes. No pitch deck. Just a conversation about what AI can do for your team.

Talk directly with our AI specialists

15 min, no strings
No sales pressure
Prototype in 7 days