Man Builds Custom AI Voice Assistant with Powerful Hardware to Run Locally, Avoiding the Cloud
-
[John Karabudak] built his own voice assistant with a large language model brain to run locally and avoid cloud reliance.
-
He used high-powered hardware like RTX 4060 Ti cards to run the AI model locally with enough VRAM.
-
The system connects the AI assistant to HomeAssistant to control devices, using JSON instructions and custom wrappers.
-
The model runs with more personality and creativity than commercial assistants, since it is customized.
-
Helpful hardware tips are provided for those who want to build their own local voice assistant.