What is Accelerator?

An accelerator is a processor built for the dense linear algebra of neural networks (a graphics processor or a dedicated tensor processor): thousands of arithmetic units, high-bandwidth memory beside them, and low-precision matrix units that do most of the work.