Why it matters
Enterprise teams should note the trend towards hardware-software co-optimisation for improving inference speed and reducing costs. This diversification of the hardware layer could eventually lead to more competitive pricing and better availability for high-performance compute resources.
Key points
- OpenAI developed custom silicon to reduce reliance on third-party GPU providers.
- Internal benchmarks indicate performance gains over current Nvidia processors for specific tasks.
- The company expects to begin using the chips in its data centres by late 2024.


