Crawlee
Web scraping and browser automation library by Apify for Node.js and Python.
About
Crawlee by Apify is a web scraping and browser automation library for Node.js and Python that handles crawling end to end. It supports plain HTTP crawling and headless Chrome through Playwright, automatic concurrency scaling, proxy rotation, and human-like behavior to avoid bot detection, storing results to disk or cloud. A CLI scaffolds a project with dependencies. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- RAG & Document Retrieval
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Easy (2/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Cloud-native vector database for scalable similarity search
Open-source RAG engine with deep document understanding and chunk-level citations.
Open-source embedding database for AI applications
All-in-one desktop and Docker app for private LLM chat with your documents.
Open-source RAG-based tool for chatting with documents.
Open-source AI second brain for chatting with documents and knowledge bases.