#Scraping-websites

Showing 16 of 16 repositories tagged #scraping-websites, ranked by stars

gildas-lormeau
gildas-lormeau
single-file-cli

CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

Score
100
★ 1.5k ⑂ 132 +3/day
JavaScript
0xjas0
0xjas0
Edu-Mail-Generator

Generate Free Edu Mail(s) within minutes

Score
100
★ 867 ⑂ 396
Python
slotix
slotix
dataflowkit

Extract structured data from web sites. Web sites scraping.

Score
0
★ 715 ⑂ 84
Go
KTZgraph
KTZgraph
sarenka

OSINT tool - gets data from services like shodan, censys etc. in one app

Score
0
★ 667 ⑂ 85
Python
unixfox
unixfox
pupflare

A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)

Score
0
★ 445 ⑂ 79
JavaScript
m92vyas
m92vyas
llm-reader

Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.

Score
100
★ 296 ⑂ 21
Python
spmedia
spmedia
Threat-Actor-Usernames-Scrape

A collection & lists of intel and usernames scraped from various cybercrime sources & forums. DarkForums, HackForums, Patched, Cracked, BreachForums, OGUser, XSS, Dread, & more

Score
100
★ 221 ⑂ 30
pavlovtech
pavlovtech
WebReaper

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

Score
50
★ 140 ⑂ 33 +1/day
C#
fizahkhalid
fizahkhalid
forex_factory_calendar_news_scraper

Forex Factory economic calendar scraper with rule-based pre-event alerts using selenium, sends to Discord, Telegram, and webhooks.

Score
67
★ 89 ⑂ 30 +3/day
Python
alpdias
alpdias
instagram-bot

🤖 Python bot to view stories, like and comment on Instagram

Score
33
★ 82 ⑂ 18
Python
guptachetan1997
guptachetan1997
crawling-projects

Web scraping and automation using python

Score
0
★ 61 ⑂ 15
Python
noobscode
noobscode
kalel

Kal El Network Stress Test and Penetration Testing Toolkit

Score
0
★ 54 ⑂ 16
Python
simwai
simwai
perplexity-ai-export

Grabs all your Perplexity conversations data, spits it out into a nice file folder structure and allows you to find your old conversations again.

Score
0
★ 51 ⑂ 16
TypeScript
Evil0ctal
Evil0ctal
Reverse-Engineering-Online-Toolkit

Reverse Engineering Online Toolkit (REOT) 是一个基于纯前端实现的在线逆向工程与爬虫工具箱。本项目旨在为安全研究人员、逆向工程师、爬虫工程师和开发者提供一套便捷、高效、无需安装的在线工具集合,用于处理逆向工程期间常见的编码、解码、加密、解密、数据转换等操作。

Score
50
★ 42 ⑂ 14
JavaScript
ziggy-data
ziggy-data
Brazilian-Real-Estate-Intelligence

Faz web scraping no site Zap-Imoveis, ETL, RegEx, análise de dados, dashboard e modelo preditivo.

Score
100
★ 34 ⑂ 11 +2/day
Python
mratanusarkar
mratanusarkar
Dataset-Indian-Companies

Web Scraping "List of companies in India" from AmbitionBox Website using Python and Beautiful Soup

Score
0
★ 15 ⑂ 8
Jupyter Notebook
Related Topics
#scraping#scraper#crawler#python#llm#webscraping#automation#web-scraping#python3#selenium#crawling#extract-data

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly