#Scrape
Showing 19 of 19 repositories tagged #scrape, ranked by stars
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.
Implementation of X/Twitter v1, v2, and GraphQL APIs
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
Crawl telegra.ph searching for nudes!
Scrape any website, article or RSS/Atom Feed with ease!
Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).
A sports data scraping and analysis tool
Conversational agent that fuses chat data with live web results through Tavily search, extract, and crawl.
Scrape ETF data for free - the unofficial python wrapper for ETFDB
Generate thousands of temporary emails within seconds!
[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library
Grabs all your Perplexity conversations data, spits it out into a nice file folder structure and allows you to find your old conversations again.
This was the night of the crawling terror!
Open-source smart money tracker & crypto KOL leaderboard — real-time trade feeds, wallet monitoring, P&L analytics, token discovery. Solana & BSC. Built with Next.js, TypeScript, PostgreSQL.
certinfo is a powerful SSL certificate scraping tool that extracts domain names from SSL certificates of arbitrary hosts. It supports both basic certificate data extraction and recursive subdomain enumeration through Certificate Subject Alternative Names (SANs).