Posted 3/15/2024, 1:08:00 PM
Cerebras Unveils Record-Breaking 4 Trillion Transistor AI Chip, Dramatically Slashes Training Time for Massive AI Models
- World's largest AI chip with 4 trillion transistors by Cerebras Systems
- Delivers 2x performance of previous record-holding Cerebras chip
- Can fine-tune AI models with 70 billion parameters in 1 day
- Requires 97% less code to train large language models vs GPUs
- Enables GPT-3-sized model implementation with just 565 lines of code
interestingengineering.com