Llama.cpp
Efficient LLM inference in C/C++ for high-performance computing applications.
Llama.cpp is built in C++, distributed under the MIT License license, 103.2k GitHub stars from 100 contributors, latest release b8763.
Stats refreshed
- Language
- C++
- Latest Release
- b8763
- License
- MIT License
Our Newsletter
Get new AI tools right in your inbox
Get short emails with useful ai projects, releases, and repos worth watching.
Key Features
- High-performance LLM inference
- C/C++ language support
- Optimized for speed
- Cross-platform compatibility
Alternative Tools
Resources
Community
More AI tools
N8n
A powerful fair-code workflow automation platform with native AI capabilities. It combines visual workflow building with the ability to include custom code. Self-host or use the cloud version with over 400+ integrations available.
AutoGPT
AutoGPT is the vision of accessible AI for everyone, providing tools to focus on what matters in building and utilizing AI.
Ollama
Ollama is an AI platform that enables you to easily run and experiment with popular open source and proprietary language models like OpenAI gpt-oss, DeepSeek-R1, Gemma 3, and more—locally, with a focus on privacy and low setup overhead.
Transformers
State-of-the-art Machine Learning library for Pytorch, TensorFlow, and JAX, providing thousands of pre-trained models for natural language processing, computer vision, and other areas.
Stable-diffusion-webui
A comprehensive web-based user interface for Stable Diffusion, providing powerful tools for generating and modifying images using AI models directly from your browser.
Awesome ChatGPT Prompts
A curated collection of ChatGPT prompts to enhance the use of ChatGPT and other language model tools.