Posted 1/9/2024, 2:02:49 PM
Neuchips Debuts 55W AI Accelerator Card for Desktop PCs, Delivering Efficient Inference
- Neuchips pitches PCIe add-on card at CES 2024 that upgrades desktop PCs for AI inference while adding just 55W power draw
- Card demonstrated running Llama 2 chatbot; built around Neuchips' Raptor Gen AI accelerator chip delivering 200 TOPS
- Focus is on power efficiency vs raw performance; card has 1 Raptor chip but is scalable to 4 or 8 chips
- Half the size of a GPU; ships in 2H 2024 with driver software and compiler
- Part of wider trend of startups debuting specialized AI accelerator cards as alternative to power-hungry GPUs