Crawl4AI
Crawl4AI is an open-source and LLM-friendly web crawler and scraper that facilitates efficient data extraction from the web.
Crawl4AI is built in Python, distributed under the Apache License 2.0 license, 63.8k GitHub stars from 47 contributors, latest release v0.8.5.
Stats refreshed
- Language
- Python
- Latest Release
- v0.8.5
- License
- Apache License 2.0
Our Newsletter
Get new AI tools right in your inbox
Get short emails with useful ai projects, releases, and repos worth watching.
Key Features
- LLM friendly
- Open-source
- Efficient web crawling
- Flexible scraping capabilities
- Community support
Resources
Community
More AI tools
N8n
A powerful fair-code workflow automation platform with native AI capabilities. It combines visual workflow building with the ability to include custom code. Self-host or use the cloud version with over 400+ integrations available.
AutoGPT
AutoGPT is the vision of accessible AI for everyone, providing tools to focus on what matters in building and utilizing AI.
Ollama
Ollama is an AI platform that enables you to easily run and experiment with popular open source and proprietary language models like OpenAI gpt-oss, DeepSeek-R1, Gemma 3, and more—locally, with a focus on privacy and low setup overhead.
Transformers
State-of-the-art Machine Learning library for Pytorch, TensorFlow, and JAX, providing thousands of pre-trained models for natural language processing, computer vision, and other areas.
Stable-diffusion-webui
A comprehensive web-based user interface for Stable Diffusion, providing powerful tools for generating and modifying images using AI models directly from your browser.
Awesome ChatGPT Prompts
A curated collection of ChatGPT prompts to enhance the use of ChatGPT and other language model tools.