Top open source llm & inference projects for your next project
Open WebUI
157k GitHub starsllama.cpp
132k GitHub stars
Top Picks
Ollama
185k GitHub starsRun AI chat models like Gemma, Qwen and DeepSeek on your own computer with one command, for free and in private. Other apps can use them too.
Open WebUI
157k GitHub starsUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
llama.cpp
132k GitHub starsLLM inference in C/C++
Odysseus
94.4k GitHub starsPewDiePie's free AI workspace that runs on your own computer: chat, agents, research, email, notes and documents in one private app.
DeepTutor
58.5k GitHub starsA free AI tutor for your computer. It turns your notes and PDFs into quizzes, study plans and books, and can run on a free local AI model.
Handy
34.6k GitHub starsFree, private voice typing for your computer. Press a shortcut, speak, and your words appear in any app. Works offline on Mac, Windows and Linux.

