Home AnyCrawl
🤖
👨‍💻 Development🛠️ Tools💚 Node.js🔷 TypeScript
2.5k

AnyCrawl

AnyCrawl is a Node.js and TypeScript-powered web crawler that transforms websites into data suitable for large language models (LLMs) and extracts structured SERP results from search engines like Google, Bing, and Baidu. It features native multi-threading for efficient, bulk-scale processing.

Language
TypeScript
Latest Release
v1.0.0-beta.6
License
MIT License

Key Features

  • Native multi-threaded crawling for high performance
  • Extracts structured SERP results from multiple search engines
  • Converts websites into LLM-ready datasets
  • Bulk processing support
  • Powered by Node.js and TypeScript
  • Flexible for different crawling and extraction scenarios

Alternative Tools

ScrapyPlaywright Puppeteer Selenium

Community

Stars
2.5k
Open Issues
10
Forks
255