llama.cpp

Building blocks

llama.cpp is made of parts you can use on their own in your project. Copy a prompt to have your AI assistant add one for you, and see the licence card for what you may do with them.

• Read and write local AI model files

  Free to use, even in closed products

  A Python library for GGUF files, the format llama.cpp uses to run AI models on your own computer.

  Use it to build

  • Converting and inspecting local models
  • Model tooling and pipelines

  Copy promptView code

  Technical details

  Name

  gguf

  What it is

  Code library

  How to use it

  Install it and use it

  Install

  pip install ggufCopy

  Licence

  MIT License (read from gguf-py/LICENSE)