Top open source llm & inference projects for your next project

Top Picks

  • Ollama

    185k GitHub stars

    Run AI chat models like Gemma, Qwen and DeepSeek on your own computer with one command, for free and in private. Other apps can use them too.

    • LLM & inference
    • MIT License
  • Open WebUI

    157k GitHub stars

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

    • LLM & inference
    • Other license
  • llama.cpp

    132k GitHub stars

    LLM inference in C/C++

    • LLM & inference
    • MIT License
  • Odysseus

    94.4k GitHub stars

    PewDiePie's free AI workspace that runs on your own computer: chat, agents, research, email, notes and documents in one private app.

    • LLM & inference
    • RAG & agents
    • AGPL 3.0
  • DeepTutor

    58.5k GitHub stars

    A free AI tutor for your computer. It turns your notes and PDFs into quizzes, study plans and books, and can run on a free local AI model.

    • LLM & inference
    • RAG & agents
    • Apache 2.0
  • Handy

    34.6k GitHub stars

    Free, private voice typing for your computer. Press a shortcut, speak, and your words appear in any app. Works offline on Mac, Windows and Linux.

    • LLM & inference
    • MIT License