Tesla’s Dojo Supercomputer Begins Production To Train Autopilot Worthy Of Its Name – SlashGear

At the moment, Tesla relies on a supercomputer consisting of Nvidia A100 GPUs, which consists of 5,760 GPU units arranged across 820 nodes, capable of churning out 1.8 Exa-FLOPS. However, the Dojo can leapfrog those figures easily. Tesla has previously claimed that only a few Dojo cabinets can perform the same kind of automatic labeling work as thousands of GPUs clustered together. But instead of outsourced cores, Dojo relies on a self-designed D1 chip that is manufactured by TSMC based on its 7nm fabrication process. Rather than utilizing centralized server-center-inspired architecture, Dojo will be a scalable machine that would ultimately achieve the form called ExaPODs. 

Each D1 chip contains over 300 computing cores, while the D1 chips themselves are clustered to form tiles. A collection of six tiles would constitute a single System Tray, while a pair of System Trays would occupy one cabinet. Tesla’s engineers would then combine 10 such cabinets to form one ExaPOD. Tesla offered a detailed look at Dojo at its AI Day event last year. 

Dojo aims to significantly accelerate the auto-labeling process that goes into training the Autopilot model, allowing it to more accurately recognize real-world objects and comprehend situations so that it can accordingly make the right decision. But even during the early test phase, Dojo proved to be so powerful that it reportedly overloaded the local power grid.