Home Llama.cpp
🐆
🤖 AI👨‍💻 Development🏎️ Performance🛠️ Tools
82.4k

Llama.cpp

Efficient LLM inference in C/C++ for high-performance computing applications.

Language
C++
Latest Release
b5797
License
MIT License

Key Features

  • High-performance LLM inference
  • C/C++ language support
  • Optimized for speed
  • Cross-platform compatibility

Alternative Tools

ONNXTensorFlowPyTorch

Community

Stars
82.4k
Contributors
100
Open Issues
790
Forks
12.2k