103.2k
AI Development Performance Tools

Llama.cpp

Efficient LLM inference in C/C++ for high-performance computing applications.

Llama.cpp is built in C++, distributed under the MIT License, 103.2k GitHub stars from 100 contributors, latest release b8763.

When to use Llama.cpp

Llama.cpp is listed here as a AI project. The directory calls out High-performance LLM inference, C/C++ language support, Optimized for speed as capabilities associated with it.

Other recorded traits for Llama.cpp include Cross-platform compatibility.

Besides AI, this page also files Llama.cpp under Development, Performance, Tools.

Llama.cpp compared with

Records in this directory name ONNX, TensorFlow, PyTorch as products people compare with Llama.cpp. That list is editorial metadata, not a claim that Llama.cpp replaces each of them.

What the Llama.cpp stats reflect

GitHub currently shows 103.2k GitHub stars, about 100 contributors, 16.7k forks, 1.5k open issues, latest tracked release b8763. Star and activity counts here are a snapshot used as a proxy for community adoption, not a quality score.

Stats refreshed

Language
C++
Latest Release
b8763
License
MIT License

Our Newsletter

Get new AI tools right in your inbox

Get short emails with useful ai projects, releases, and repos worth watching.

Key features of Llama.cpp

  • High-performance LLM inference
  • C/C++ language support
  • Optimized for speed
  • Cross-platform compatibility

Recorded alternatives to Llama.cpp

ONNX TensorFlow PyTorch

Llama.cpp on GitHub

Stars
103.2k
Contributors
100
Open Issues
1.5k
Forks
16.7k

Frequently asked questions

What is Llama.cpp?

Efficient LLM inference in C/C++ for high-performance computing applications. This directory highlights High-performance LLM inference, C/C++ language support, Optimized for speed.

Is Llama.cpp free to use?

Llama.cpp is published as open source under the MIT License. The directory lists High-performance LLM inference, C/C++ language support, Optimized for speed among its recorded capabilities.

What language is Llama.cpp written in, and what is the latest release?

Llama.cpp is written primarily in C++. The latest release tracked on this page is b8763.

How widely is Llama.cpp used on GitHub?

Llama.cpp has about 103.2k GitHub stars across about 100 contributors. It also has about 16.7k forks. Those counts are a snapshot of community attention, not a ranking of quality.

What do people compare Llama.cpp with?

This directory records ONNX, TensorFlow, PyTorch as comparison points for Llama.cpp.

More AI tools