Posted 2/13/2024, 4:03:46 PM
Nvidia launches offline AI chatbot tool for GeForce RTX GPUs
- Nvidia released Chat with RTX, a tool to run AI chatbots like ChatGPT offline on GeForce RTX GPUs
- Allows users to customize and fine-tune models by connecting them to local documents and files
- Currently supports text, PDFs, Word docs, and XML formats; can also use YouTube playlist transcripts
- Limitations doesn't remember context between questions, relevance affected by question phrasing and model/data quality
- Part of a trend toward affordable local devices to run AI models offline for privacy, cost and latency benefits