LLM & inference guides

Top LLM & inference projects

• 

  Ollama

  181k GitHub stars

  Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

  • LLM & inference
  • MIT License
• 

  Open WebUI

  153k GitHub stars

  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

  • LLM & inference
  • Other license
• 

  llama.cpp

  129k GitHub stars

  LLM inference in C/C++

  • LLM & inference
  • MIT License