Posted 2/15/2024, 4:54:09 PM
Nvidia Launches Personalized AI Chatbot for Local PCs
- Nvidia released Chat With RTX, a free personalized AI chatbot like ChatGPT that runs locally on a PC with an Nvidia RTX graphics card
- It uses open-source large language models like Mistral or Llama and leverages the GPU for acceleration
- Users can connect local files as a dataset for the AI to query for quick, relevant answers
- It supports various file types like PDFs, Word docs, and even YouTube videos to incorporate external information
- The app is rough around the edges currently - buggy and complex - but shows Nvidia's push toward local processing for privacy