#Article-extractor

adbar

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

lightfeed

extractor

Use LLMs to robustly extract web data

opendatalab

MinerU-HTML

MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

fterh

sneakpeek

Reddit bot to preview and post hyperlinks as comments