New analysis from Dell’Oro Group, a dependable supply of business statistics relating to the information middle, networks, safety, and telecommunications sectors, claims that gross sales for accelerators – which embody GPUs and bespoke accelerators – rose by 130 p.c within the third quarter of 2024. In 2024, greater than 5 million accelerators with AI coaching capabilities will likely be deployed by the US hyperscalers, Amazon, Google, Meta, and Microsoft.
“Because the hyperscalers scramble to deploy infrastructure for the coaching and inference of enormous language fashions, the demand for accelerators has been rising at a breakneck tempo,” mentioned Baron Fung, Senior Analysis Director at Dell’Oro Group. “The US hyperscalers are increasing their use of AI infrastructure with specialised accelerators along with broadly accessible GPUs. Hyperscalers are adopting bespoke accelerators at a quicker price as the scale of big language fashions continues to extend, necessitating bigger computing clusters. These custom-made options, which are sometimes co-developed with chipmakers like Marvell and Broadcom, are supposed to improve efficiency effectivity, reduce bills, and reduce reliance on NVIDIA GPUs.”
Different noteworthy factors from the Information Heart IT Semiconductors and Parts Quarterly Report for the third quarter of 2024:
- In 2024, the marketplace for server and storage methods parts is predicted to develop by greater than 100%. The gradual enlargement was fueled by accelerators, reminiscence, and storage units.
- NVIDIA led all suppliers in element revenues, with SK Hynix and Samsung following carefully after. Almost half of all reported gross sales went to NVIDIA, however hyperscalers utilizing bespoke options are catching up shortly.
Potential Server Element Slowdown
As a result of sturdy deployment of community adapters in AI clusters, sensible NIC and DPU revenues almost doubled within the third quarter of 2024. Progress is anticipated to average to nonetheless a wholesome double-digit improve in 2025, with a attainable slowdown in general-purpose server parts early within the 12 months because of stock changes.
The Information Heart IT Semiconductors and Parts Quarterly Report from Dell’Oro Group displays income, unit and capability shipments, unit and capability pricing, and market share of the main semiconductor and element producers that provide the markets for knowledge middle servers and storage methods starting in 2018.
Main server and storage semiconductors and parts, together with CPUs, accelerators such GPUs, FPGAs, and bespoke AI ASICs, Ethernet and InfiniBand NICs, Good NICs, HDDs, and NAND/SSDs, are among the many applied sciences of consideration.
