#Warc
Showing 8 of 8 repositories tagged #warc, ranked by stars
ArchiveBox
ArchiveBox
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
Score
100
★ 27.9k
⑂ 1.5k
+47/day
Python
Rhizome-Conifer
conifer
Collect and revisit web pages.
Score
100
★ 1.5k
⑂ 126
—
Python
oduwsdl
ipwb
InterPlanetary Wayback: A distributed and persistent archive replay system using IPFS
Score
50
★ 654
⑂ 41
+2/day
Python
webrecorder
browsertrix
Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!
Score
0
★ 437
⑂ 70
+3/day
TypeScript
Florents-Tselai
WarcDB
WarcDB: Web crawl data as SQLite databases.
Score
0
★ 406
⑂ 10
—
Python
harvard-lil
warc-gpt
WARC + AI - Experimental Retrieval Augmented Generation Pipeline for Web Archive Collections.
Score
0
★ 274
⑂ 26
+1/day
Python
chatnoir-eu
chatnoir-resiliparse
A robust web archive analytics toolkit
Score
0
★ 144
⑂ 18
+2/day
Rust
internetarchive
cdx-summary
Summarize web archive capture index (CDX) files.
Score
0
★ 96
⑂ 32
+1/day
Python