Home Llama.cpp
🐆
🤖 AI👨‍💻 Development🏎️ Performance🛠️ Tools
103.2k

Llama.cpp

Efficient LLM inference in C/C++ for high-performance computing applications.

Language
C++
Latest Release
b8763
License
MIT License

Our Newsletter

Get new AI tools right in your inbox

Get short emails with useful ai projects, releases, and repos worth watching.

Key Features

  • High-performance LLM inference
  • C/C++ language support
  • Optimized for speed
  • Cross-platform compatibility

Alternative Tools

ONNXTensorFlowPyTorch

Community

Stars
103.2k
Contributors
100
Open Issues
1.5k
Forks
16.7k