Open source

Crawl4AI

Reference entryData prep and crawling
Reference entryCrawl4AI

Crawl4AI is a web crawler designed to extract configurable, structured and AI-ready content from sites in self-hosted Python workflows.

Where it sits