Llama.cpp
Efficient LLM inference in C/C++ for high-performance computing applications.
There are 5 open-source alternatives to PyTorch in this directory. The most popular is Llama.cpp with 103.2k GitHub stars, followed by Llama(59.3k stars). All are open source, free to use, and many can be self-hosted.
| # | Tool | Stars | Language | License |
|---|---|---|---|---|
| 1 | Llama.cpp Efficient LLM inference in C/C++ for high-performance computing applications. | 103.2k | C++ | MIT License |
| 2 | Llama Inference code for Llama models, a versatile solution for running Llama model inferences efficiently. | 59.3k | Python | Other |
| 3 | Autogen A comprehensive programming framework for building agentic AI applications, supporting various integrations and community interactions. | 57.0k | Python | Creative Commons Attribution 4.0 International |
| 4 | Tinygrad A minimalist deep learning framework designed to be simple and easy to understand, inspired by pytorch and micrograd. | 32.3k | Python | MIT License |
| 5 | Postgresml Postgres enhanced with GPU acceleration for efficient machine learning and AI applications. | 6.7k | Rust | MIT License |
Efficient LLM inference in C/C++ for high-performance computing applications.
Inference code for Llama models, a versatile solution for running Llama model inferences efficiently.
A comprehensive programming framework for building agentic AI applications, supporting various integrations and community interactions.
A minimalist deep learning framework designed to be simple and easy to understand, inspired by pytorch and micrograd.
Postgres enhanced with GPU acceleration for efficient machine learning and AI applications.
The top three are Llama.cpp(103.2k stars), Llama(59.3k stars), Autogen(57.0k stars). All are open source and free to use.
Yes. Every tool listed here is open source and free to use in your own projects. Many can be self-hosted on your own infrastructure, which means no subscription fees and full control over your data.
Many of the alternatives listed are self-hostable. Each tool's page lists hosting details, system requirements, and licensing terms.
Get notified about new tools and updates to existing ones.