AMD Challenges Nvidia in AI Accelerators with Lamini Partnership and New MI300 GPUs

Machine learning startup Lamini revealed its large language model platform runs exclusively on AMD Instinct GPUs.
Lamini claims its platform has been running on over 100 AMD GPUs in production and can scale to thousands.
AMD aiming to challenge Nvidia's dominance in AI accelerators with new Instinct MI300 GPUs coming later this year.
MI300 GPUs promise up to 8x faster AI performance and 5x better performance per watt versus previous gen.
AMD partnering with frameworks like PyTorch and companies like Hugging Face to optimize its ROCm software stack for AI workloads.

theregister.com

Relevant topic timeline:

8/22/2023

Esperanto Pivots to HPC and Generative AI - EE Times

Esperanto, an AI chip startup, has shifted its focus from recommendation acceleration to large language models (LLMs) and high-performance computing (HPC) by releasing a general-purpose software development kit and PCIe accelerator card for its first generation RISC-V data center accelerator chip. The company believes its chip is well-suited for LLM inference and aims to compete with CPUs rather than Nvidia GPUs for this application.

9/19/2023

Intel Bets on AI Chips and Software to Boost PC Sales and Challenge Nvidia

Intel CEO Pat Gelsinger emphasized the concept of running large language models and machine learning workloads locally and securely on users' own PCs during his keynote speech at Intel's Innovation conference, highlighting the potential of the "AI PC generation" and the importance of killer apps for its success. Intel also showcased AI-enhanced apps running on its processors and announced the integration of neural-processing engine (NPU) functionality in its upcoming microprocessors. Additionally, Intel revealed Project Strata, which aims to facilitate the deployment of AI workloads at the edge, including support for Arm processors. Despite the focus on inference, Intel still plans to compete with Nvidia in AI training, with the unveiling of a new AI supercomputer in Europe that leverages Xeon processors and Gaudi2 AI accelerators.

10/5/2023

AI Startup NucleusAI Emerges from Stealth with Massive 22B Parameter LLM, Aims to Revolutionize Agriculture

Startup NucleusAI has unveiled a 22-billion-parameter language model (LLM) that surpasses similar models in performance, demonstrating the expertise of its four-person team; the company plans to leverage AI to create an intelligent operating system for farming, with details to be announced in October.

10/17/2023

Nvidia Launches Software to Speed Up AI Models on Its GPUs Amid Generative AI Boom

Nvidia is adding support for its TensorRT-LLM SDK to Windows and models like Stable Diffusion in order to accelerate the performance of large language models (LLMs) and improve the experience for writing and coding assistants, as it aims to maintain its position as the hardware leader in generative AI despite increasing competition from companies like Microsoft and AMD.

10/23/2023

AMD Faces Headwinds in AI/ML Market Alongside Nvidia as Demand Slows

Graphics processing unit (GPU) specialist Advanced Micro Devices (AMD) may not be a good investment for the artificial intelligence (AI) market, despite seeming like a bargain compared to rival Nvidia, due to the risk of both companies competing for the same AI niches and the broader AI market being affected by Nvidia's recent decline. The overheated AI narrative and an export crackdown on advanced processors also contribute to the concerns surrounding AMD stock.

Topics

Posted 9/26/2023, 4:00:00 PM