Ollama

185k GitHub starsollama/ollama

Run AI chat models like Gemma, Qwen and DeepSeek on your own computer with one command, for free and in private. Other apps can use them too.

View on GitHub

Build a stack with Ollama

Pick parts from it and the projects that work well with it. We check the licences together and write a prompt for your AI.

Ollama
Open WebUI
Chroma
LangChain

Your stack

Tick the parts you want to use. Projects whose parts are not listed yet can be added whole; the prompt tells your AI to find the right pieces in their code.

Website (opens in a new tab)
More actions

Why we picked it

Ollama is the easiest way to run AI models on your own computer. One command downloads a model and starts it, and it then runs quietly in the background so chat apps, coding assistants and your own code can use it. Your words stay on your machine and there's nothing to pay. It's the engine behind a huge number of local AI tools, including Open WebUI, and now also offers bigger models in the cloud for when your computer isn't powerful enough. It gets new releases every week or two, and it's free to use in any project.

About Ollama

Ollama lets you run AI models, the kind that power chat assistants, on your own computer. You choose a model, type one short command, and Ollama downloads it and gets it running. Then you can chat with it in Ollama's app or connect it to other apps and tools. Because the model runs on your own machine, your conversations stay private and there's nothing to pay. It works on Mac, Windows and Linux, and Ollama says more than 9 million developers use it.

What it can do

  • One command to get started. Tell Ollama which model you want and it downloads it and starts it. It picks a version that's small enough for most computers, so you don't need to understand the technical details.
  • A big library of free models. It can run hundreds of openly shared models, including Google's Gemma, Alibaba's Qwen, DeepSeek, OpenAI's gpt-oss, Meta's Llama and Mistral. Some can also look at pictures, and some are built for writing code.
  • Private by default. Models you run on your own computer never send your words anywhere. Once a model is downloaded, it works even without an internet connection.
  • Plugs into the apps you already use. Ollama runs quietly in the background, and other apps can talk to it. It understands the same requests as OpenAI's service, so many tools built for ChatGPT can switch to Ollama by changing one web address. It also works with Claude Code, Claude Desktop, ChatGPT's Codex and VS Code.
  • Sets up AI coding helpers for you. The ollama launch command starts coding assistants such as Claude Code and OpenCode, or personal assistants such as OpenClaw, already connected to the model you pick, with no settings files to edit.
  • Borrows a bigger computer when yours isn't enough. The largest models are too big for a laptop. Models marked "cloud" run on Ollama's own servers instead, using exactly the same commands. Ollama says it doesn't use those conversations to train models, and you can switch the cloud off completely.
  • Uses your graphics card if you have one. It works with NVIDIA and AMD graphics cards and is especially quick on Apple's M-series Macs. Without a graphics card it still runs, just more slowly.

Where you'll meet it

Ollama is often the engine behind other tools. Open WebUI is the most popular way to give it a chat window that looks and works like ChatGPT. Apps that answer questions about your own documents often pair Ollama, which runs the model, with Chroma, which stores and finds the documents, and LangChain, which joins the pieces together. Under the hood, Ollama is built on llama.cpp.

Ollama, LM Studio or llama.cpp?

These are the three most popular free ways to run AI models on your own computer. They run the same kinds of models at similar speeds, because Ollama and LM Studio both use llama.cpp inside. The difference is how you use them.

OllamaThis page

Best forGetting a model running fast and connecting apps to it

The simplest start: one command downloads and runs a model, and it keeps running in the background for other apps to use. Adds cloud models and one-step setup for coding assistants. You give up a little speed and fine control.

How you use it
A simple app, commands, or from other apps
Open source
Yes (MIT)
Cost
Free on your computer; cloud plans from $20 a month
LM Studio

Best forBrowsing and trying models in a friendly app

A polished desktop app with a model shop that shows which models will fit on your computer. Great for trying models side by side without the command line. The app itself is free but not open source.

How you use it
A desktop app, with a built-in server for other apps
Open source
No
Cost
Free

Best forThe most speed and control

The engine the other two are built on. Usually the fastest, runs on almost any hardware and lets you tune every setting, but you choose and download model files yourself and it takes more technical know-how.

How you use it
Commands and settings, for technical users
Open source
Yes (MIT)
Cost
Free

A quick way to choose: want an AI model running on your computer in five minutes, or need one that other apps can use? Pick Ollama. Prefer clicking through a friendly app to compare models? Try LM Studio. Comfortable with technical settings and want every bit of speed? Use llama.cpp. You can't go far wrong, and you can switch later because they all run the same kinds of models.

Good to know

  • Your computer sets the limit. Small models run on an ordinary laptop, but bigger, smarter ones need a lot of memory or a good graphics card. If a model is slow, try a smaller version of it.
  • Models are big downloads, usually several gigabytes each, so check your free disk space.
  • Free models on your own computer aren't as capable as the best paid assistants for hard tasks, but they're good enough for many everyday jobs and improve every few months.
  • Ollama's own app is simple. For a fuller chat window with saved chats, document uploads and several users, add Open WebUI.
  • Ollama opens its door only to your own computer by default. If you open it up to other machines, put a password or proxy in front of it, because it has no login of its own.
  • Cloud models are optional and send your prompts to Ollama's servers. The free plan includes some starter use; running models on your own computer is always free and unlimited.
  • Licence: MIT. You can use it for free, including in paid products.

What you can build with it

  • Chatting with an AI model privately, without sending your words to a company
  • Running AI on a laptop with no internet connection
  • Giving your own app or script an AI model to call, without paying per message
  • Powering a coding assistant with a free model on your own computer
  • Building an app that answers questions about your own documents

Works well with

  • Open WebUI

    157k GitHub stars

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

    • LLM & inference
    • Other license
  • Chroma

    29.6k GitHub stars

    Search infrastructure for AI

    • Vector databases
    • Apache 2.0
  • LangChain

    148k GitHub stars

    The agent engineering platform.

    • RAG & agents
    • MIT License

Comments

No comments yet. Be the first to share your thoughts.