Lamini CEO Mocks Nvidia GPU Shortage, Touts AMD Advantage for AI Workloads

Lamini CEO pokes fun at Nvidia GPU shortages in video, noting AMD GPUs are readily available
Lamini is an AI startup using AMD GPUs; CEO is ML expert, CTO former Nvidia engineer
Lamini claims its LLM needs just "3 lines of code" to run on AMD Instinct GPUs
AMD partner touts ROCm software parity with CUDA for AI workloads
Multiple AMD GPUs can match/exceed one Nvidia H100 for AI, and avoid scarcity pricing

tomshardware.com

Relevant topic timeline:

8/22/2023

Esperanto Pivots to HPC and Generative AI - EE Times

Esperanto, an AI chip startup, has shifted its focus from recommendation acceleration to large language models (LLMs) and high-performance computing (HPC) by releasing a general-purpose software development kit and PCIe accelerator card for its first generation RISC-V data center accelerator chip. The company believes its chip is well-suited for LLM inference and aims to compete with CPUs rather than Nvidia GPUs for this application.

8/28/2023

Chinese GPU Companies See AI Opportunities, Despite Nvidia: Report

Chinese GPU developers are looking to fill the void in their domestic market created by US restrictions on AI and HPC exports to China, with companies like ILuvatar CoreX and Moore Threads collaborating with local cloud computing providers to run their LLM services and shift their focus from gaming hardware to the data center business.

9/17/2023

Nvidia's New Grace Chip Dominates MLPerf Benchmarks, But Rivals Are Gaining Ground

Large language models like Llama2 and ChatGPT perform well on datacenter-class computers, with the best being able to summarize more than 100 articles in a second, according to the latest MLPerf benchmark results. Nvidia continues to dominate in performance, though Intel's Habana Gaudi2 and Qualcomm's Cloud AI 100 chips also showed strong results in power consumption benchmarks. Nvidia's Grace Hopper superchip, combined with an H100 GPU, outperformed other systems in various categories, with its memory access and additional memory capacity contributing to its advantage. Nvidia also announced a software library, TensorRT-LLM, which doubles the H100's performance on GPT-J. Intel's Habana Gaudi2 accelerator is closing in on Nvidia's H100, while Intel's CPUs showed lower performance but could still deliver summaries at a decent speed. Only Qualcomm and Nvidia chips were measured for datacenter efficiency, with both performing well in this category.

10/5/2023

AI Startup NucleusAI Emerges from Stealth with Massive 22B Parameter LLM, Aims to Revolutionize Agriculture

Startup NucleusAI has unveiled a 22-billion-parameter language model (LLM) that surpasses similar models in performance, demonstrating the expertise of its four-person team; the company plans to leverage AI to create an intelligent operating system for farming, with details to be announced in October.

10/17/2023

Nvidia's TensorRT Boosts AI Performance on GPUs by 70% for Stable Diffusion and 4.4x for Large Language Models

Nvidia has released TensorRT and TensorRT-LLM, which optimize the performance of GPUs for tasks like Stable Diffusion and Llama 2 text generation, resulting in a performance improvement of up to 70%.

10/17/2023

Nvidia Launches Software to Speed Up AI Models on Its GPUs Amid Generative AI Boom

Nvidia is adding support for its TensorRT-LLM SDK to Windows and models like Stable Diffusion in order to accelerate the performance of large language models (LLMs) and improve the experience for writing and coding assistants, as it aims to maintain its position as the hardware leader in generative AI despite increasing competition from companies like Microsoft and AMD.

Topics

Posted 9/27/2023, 4:09:25 PM

Lamini CEO Mocks Nvidia GPU Shortage, Touts AMD Advantage for AI Workloads

Lamini CEO pokes fun at Nvidia GPU shortages in video, noting AMD GPUs are readily available
Lamini is an AI startup using AMD GPUs; CEO is ML expert, CTO former Nvidia engineer
Lamini claims its LLM needs just "3 lines of code" to run on AMD Instinct GPUs
AMD partner touts ROCm software parity with CUDA for AI workloads
Multiple AMD GPUs can match/exceed one Nvidia H100 for AI, and avoid scarcity pricing

tomshardware.com

Relevant topic timeline:

8/22/2023

Esperanto Pivots to HPC and Generative AI - EE Times

8/28/2023

Chinese GPU Companies See AI Opportunities, Despite Nvidia: Report

9/17/2023

Nvidia's New Grace Chip Dominates MLPerf Benchmarks, But Rivals Are Gaining Ground

10/5/2023

AI Startup NucleusAI Emerges from Stealth with Massive 22B Parameter LLM, Aims to Revolutionize Agriculture

10/17/2023

Nvidia's TensorRT Boosts AI Performance on GPUs by 70% for Stable Diffusion and 4.4x for Large Language Models

Nvidia has released TensorRT and TensorRT-LLM, which optimize the performance of GPUs for tasks like Stable Diffusion and Llama 2 text generation, resulting in a performance improvement of up to 70%.

10/17/2023

Nvidia Launches Software to Speed Up AI Models on Its GPUs Amid Generative AI Boom