Home Llama.cpp
🐆
🤖 AI👨‍💻 Development🏎️ Performance🛠️ Tools
79.2k

Llama.cpp

Efficient LLM inference in C/C++ for high-performance computing applications.

Language
C++
Latest Release
b5281
License
MIT License

Key Features

  • High-performance LLM inference
  • C/C++ language support
  • Optimized for speed
  • Cross-platform compatibility

Alternative Tools

ONNXTensorFlowPyTorch

Community

Stars
79.2k
Open Issues
760
Forks
11.6k