Shanghai AI Lab releases ArchPreview model using next concept prediction

Shanghai AI Lab has introduced ArchPreview, an 8.9 billion parameter open model that utilises a novel training method called Next Concept Prediction. This approach allows the model to learn abstract concepts rather than focusing solely on individual words. ArchPreview achieves performance parity with the OLMo-3-7B model while requiring only half the training tokens.

For enterprise teams, this shift suggests a path toward more efficient model training and improved reasoning capabilities. Reducing token requirements significantly lowers the computational cost and time needed to develop high performing custom models.

  • ArchPreview features 8.9 billion parameters and is released as an open model.
  • The Next Concept Prediction technique focuses on semantic meaning over word sequences.
  • The model achieves competitive benchmarks using 50 percent fewer training tokens than traditional methods.
Generative AI Machine Learning AI Apps & Platforms
All AI news

More AI news

Models

US allows domestic AI developers to share advance models with UK for safety testing

The United States has enabled domestic artificial intelligence developers to grant the United Kingdom government early access to proprietary models for security evaluations. This arrangement facilitates formal safety assessments prior to commercial deployment without triggering regulatory friction between both nations.

Tooling

Shanghai AI Lab unveils RSI-Anything framework to boost code repair and planning

Researchers from Shanghai AI Lab, CUHK, NTU, and Oxford have introduced RSI-Anything, a framework built upon JEPA-Anything. The system uses predictive world models to simulate environments and enhance autonomous agent decision-making. The approach lifts code-repair agent accuracy to 31.2 percent and lab planning success to 46 percent.

Tooling

Securing autonomous AI agents as integration shifts from answering to acting

As artificial intelligence transitions from conversational answering to autonomous action via protocols like the Model Context Protocol, systems increasingly execute operational tasks across external tools. This shift introduces distinct security risks for autonomous agents interacting with corporate software environments. Engineering teams must now navigate newly emerging attack surfaces as models gain permission to manipulate systems directly.

Ready to build something
extraordinary?

15 minutes. No pitch deck. Just a conversation about what AI can do for your team.

Talk directly with our AI specialists

15 min, no strings
No sales pressure
Prototype in 7 days