Meta Unveils Next-Generation AI Chip, Boasting 3x Performance Gains for Ranking and Ad Models
-
Meta unveiled its latest custom AI chip, the "next-gen" Meta Training and Inference Accelerator (MTIA), which is faster and more powerful than its predecessor.
-
The new 5nm chip consumes more power but has more memory, processing cores, and runs at a higher clock speed compared to the previous 7nm chip.
-
Meta claims the next-gen MTIA delivers 3x better performance on key models, but details were vague.
-
The chip is currently being used for ranking and ad recommendation models, not generative AI, though Meta is exploring that.
-
Meta admits the new chip won't fully replace GPUs yet, but took under 9 months to go from initial silicon to production models.