New Intel accelerators open the door to massive new AI model

Intel has unveiled a new generation of Gaudi accelerators that could drastically shorten the time it takes to train large-scale AI models.

The Gaudi 2 processors, which were announced at Intel Vision 2022 in Dallas, are constructed on a 7nm process, have 24 integrated 100GbE RoCE ports, and have the most RAM of any accelerator on the market (96GB HBM2e).

The new CPUs are meant for servers specialised to deep learning applications and were developed by Israel-based Habana Labs, which was acquired by Intel in 2019.

A variety of large-scale natural language processing (NLP) and computer vision models have appeared in recent years, giving performance significantly superior than prior entries in the fields.