Crawl4AI
Open-source web crawling library optimized for LLM and AI applications.
About
Crawl4AI is an open-source web crawling and scraping library built for LLM and AI pipelines. It converts pages into clean Markdown suitable for RAG and agents, renders JavaScript-heavy sites, and supports concurrent crawling with configurable extraction strategies. It is widely adopted in the open-source community and aims to be a cost-effective alternative to hosted extraction services. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Agents & Orchestration
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Beginner (1/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Multi-agent framework for building and studying societies of communicating LLM agents at scale.
Super-agent harness orchestrating sub-agents, memory, and sandboxes for research and automation.
TypeScript agentic operating system with plugins, memory, and connectors for major messaging platforms.
Code-first, model-agnostic toolkit for building, evaluating, and deploying AI agents.
Autonomous agent that plans queries, searches the web and local files, and writes cited reports.
Platform for building and running autonomous agents that execute complete workflows from goals.