Home Llama.cpp
🐆
🤖 AI👨‍💻 Development🏎️ Performance🛠️ Tools
83.6k

Llama.cpp

Efficient LLM inference in C/C++ for high-performance computing applications.

Language
C++
Latest Release
b6027
License
MIT License

Key Features

  • High-performance LLM inference
  • C/C++ language support
  • Optimized for speed
  • Cross-platform compatibility

Alternative Tools

ONNXTensorFlowPyTorch

Community

Stars
83.6k
Contributors
100
Open Issues
762
Forks
12.5k