Back to Directory/Documentation

TheCrawler

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Documentationv0.1.1