Showing 1 of 1 repositories tagged #markdown-scraper, ranked by stars
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
