#Web-scraping-python

Showing 10 of 10 repositories tagged #web-scraping-python, ranked by stars

D4Vinci
D4Vinci
Scrapling

๐Ÿ•ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Score
75
โ˜… 68.7k โ‘‚ 6.8k +621/day
Python
scrapy
scrapy
scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Score
100
โ˜… 63.0k โ‘‚ 11.8k +93/day
Python
omkarcloud
omkarcloud
botasaurus

The All in One Framework to Build Undefeatable Scrapers

Score
50
โ˜… 5.5k โ‘‚ 485 +5.5k/day
Python
oxylabs
oxylabs
how-to-scrape-amazon-product-data

The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

Score
25
โ˜… 3.0k โ‘‚ 11 โ€”
tinyfish-io
tinyfish-io
agentql

AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.

Score
100
โ˜… 1.4k โ‘‚ 161 +4/day
Python
scrapfly
scrapfly
scrapfly-scrapers

Scalable Python web scraping scripts for +40 popular domains

Score
0
โ˜… 1.0k โ‘‚ 198 +2/day
Python
davidteather
davidteather
everything-web-scraping

Learn everything web scraping with David Teather Codes on YouTube

Score
0
โ˜… 465 โ‘‚ 89 โ€”
HTML
ScrapingBee
ScrapingBee
chatgpt-scraper-api

Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters.

Score
100
โ˜… 417 โ‘‚ 1 โ€”
vishwajeetdabholkar
vishwajeetdabholkar
eGet-Crawler-for-ai

Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.

Score
0
โ˜… 57 โ‘‚ 15 โ€”
Python
Narenpradhan
Narenpradhan
WatchTower

WatchTower - A platform to save your valuable time while staying updated in the Cyber realm.

Score
0
โ˜… 18 โ‘‚ 1 โ€”
Python
Related Topics
#web-scraping#python#scraping#automation#crawler#crawling#webscraping#scraping-python#ai#crawling-python#playwright#web-scraper

ยฉ 2026 GitRepoTrend ยท GitHub repositories by topic ยท Updated weekly