+31 20 705 1010
EnglishNederlandsFrançaisDeutschEspañol
Models

Lumia Lab scales latent space model to 8.9 billion parameters

LUMIA Lab has released the technical report for NCP-ArchPreview, an 8.9B parameter model trained on 5.73 trillion tokens. The model employs Next Concept Prediction to jointly predict tokens and latent representations, achieving performance parity with OLMo-3-7B while requiring significantly less data.

Why it matters

This research demonstrates that latent-space modelling can significantly improve training efficiency for large scale models. For enterprise teams, this suggests a path toward high performance systems with reduced computational overhead and smaller dataset requirements.

Key points

  • Scales Next Concept Prediction to 8.9B parameters using the Dolma-3 dataset
  • Matches the performance of OLMo-3-7B using only 51 percent of the training tokens
  • Integrates token and latent representation prediction for enhanced semantic understanding

Related solutions

Generative AI Machine Learning
All AI news

More AI news

Models

World Labs launches Atlas to move AI from language to spatial world models

World Labs has introduced Atlas, a spatial intelligence model designed to move beyond text based processing. Unlike traditional large language models, this system focuses on creating world models that comprehend and interact with 3D physical spaces. The technology provides AI with a foundational understanding of depth, physics, and spatial relationships.

Models

Modern CISOs shift focus to enable strategic risk and accelerate AI adoption

Security leadership is moving away from a traditional gatekeeper role to become an active enabler of business risk and innovation. This transition focuses on guiding the safe integration of artificial intelligence while fostering a culture of responsible experimentation across the enterprise.

Models

Tech coalition urges US government to protect open-weight AI models

A coalition of major technology firms has petitioned the US government to safeguard the development of open-weight artificial intelligence models. The group argues that downloadable weights are essential for maintaining transparency and competition, ensuring that innovation is not restricted to a handful of proprietary providers.

Ready to build something
extraordinary?

15 minutes. No pitch deck. Just a conversation about what AI can do for your team.

Talk directly with our AI specialists

15 min, no strings
No sales pressure
Prototype in 7 days