KoboldCpp
A single-file program for running open AI models on your own computer, with a browser chat window built in.
KoboldCpp is a free program that lets you run an open AI model on your own machine. Its selling point is how little setup it needs. You download one file for your operating system, point it at a model file, and it opens a chat window in your browser. There is no installer and no programming environment to configure, which makes it one of the gentlest ways into local AI.
Under the hood it builds on llama.cpp, the engine most local AI tools share, and it usually picks up support for newly released open models within days. Its built in interface is called Kobold Lite. The project grew out of the roleplay and interactive fiction community, so it carries some features aimed at storytelling, but it works perfectly well as an ordinary private assistant.