DeepSeek open-sources DSpark to accelerate large language model inference by up to 85 per cent

DeepSeek has released DSpark, an open-source framework designed to optimise large language model inference performance. The system focuses on accelerating the decoding process, reporting speed improvements of up to 85 per cent in specific scenarios to address the computational overhead of generating tokens in massive models.

Inference latency remains a primary bottleneck for real-time applications and high-volume workloads. DSpark provides a method to lower operational costs and latency in production environments by streamlining the token prediction pipeline.

  • Open-source framework targeting inference bottlenecks in large language models.
  • Claims up to 85 per cent faster decoding speeds during token generation.
  • Actual performance gains depend on the quality of token acceptance within the system.
  • Designed to increase efficiency and throughput for large-scale enterprise model deployments.
Generative AI AI Apps & Platforms Machine Learning
All AI news

More AI news

Models

OpenAI releases BioBasicsBench to evaluate AI performance on routine laboratory tasks

OpenAI has announced BioBasicsBench, a benchmark designed to measure how effectively artificial intelligence systems manage routine tasks in laboratory settings. According to an announcement published on OpenAI's website on 6 November 2026, the current highest score achieved on the benchmark is 66.7 per cent.

Models

OpenAI announces ChatGPT Images 2.6 with moving image capabilities

On 4 November 2026, OpenAI announced ChatGPT Images 2.6, an update to its image generation model family. According to reports, this release extends standard visual outputs by introducing the capability to create moving images.

Industry

Coforge joins SpaceX Super Intelligence Partner Network to offer Grok to enterprise clients

IT solutions provider Coforge Limited has announced that it has joined the SpaceX Super Intelligence (SpaceXSI) Partner Network. The company stated that it has entered the network in the role of a transformation partner. According to the announcement, the collaboration intends to support enterprise organisations adopting Grok.

Build it with us, or have us check yours

In 15 minutes we talk through what you want to build, who builds it and what it needs to go live.

Talk directly with our AI specialists

15 minutes, no obligation
No sales pressure
Prototype in 7 days