Crawl4AI
Open-source web crawling library optimized for LLM and AI applications.
About
Crawl4AI is an open-source web crawling and scraping library built for LLM and AI pipelines. It converts pages into clean Markdown suitable for RAG and agents, renders JavaScript-heavy sites, and supports concurrent crawling with configurable extraction strategies. It is widely adopted in the open-source community and aims to be a cost-effective alternative to hosted extraction services. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Agents & Orchestration
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Beginner (1/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Visual framework for building multi-agent and RAG applications.
Visual interface for building and testing AutoGen multi-agent workflows.
Library for enabling AI agents to interact with web browsers.
Integration platform providing 250+ tools for AI agents and LLMs.
Python framework for building AI workflows with structured task management.
Microsoft's framework for building multi-agent AI systems