#S3
Showing 60 of 216 repositories tagged #s3, ranked by stars
MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.
SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
๐2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
Open-source data movement for ELT pipelines and AI agents โ from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Ceph is a distributed object, block, and file storage platform
Light, fluffy, and always free - The AWS Local Emulator alternative
:file_folder: File Management Platform / Universal Data Access Layer (without FUSE)
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
Streaming replication for SQLite.
Full-featured and highly configurable SFTP, HTTP/S, FTP/S and WebDAV server - S3, Google Cloud Storage, Azure Blob
A library that allows you to easily mock out tests based on AWS infrastructure.
PostgreSQL backup tool with Point-In-Time-Recovery and restore verification
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
a high-performance, POSIX-ish Amazon S3 file system written in Go
Apache OpenDAL: One Layer, All Storage.
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
Seed your development database with real data โก๏ธ
Archival and Restoration for databases in the Cloud
Parallel S3 and local filesystem execution tool.
(Mirror) S3-compatible object store for small self-hosted geo-distributed deployments. Main repo: https://git.deuxfleurs.fr/Deuxfleurs/garage
Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox, Google Drive or SSH compatible storage
An image upload and manage tool, base on PicGo
Modularized AWS SDK for JavaScript.
Unix like utilities for object store
Ministack: Free, open-source local AWS emulator - 55+ services, Terraform compatible, real databases. Free forever. MIT licensed.
Continuous Archiving for Postgres
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
MinIO Go client SDK for S3 compatible object storage
The fastest business intelligence tool for humans and agents.
A simple to deploy but feature rich S3 object storage server for your filesystem
๐ฉ๏ธ Serverless ่ชๆ็ฎก็ๆไปถ็ฎก็ไธๆๆฌๅไบซๅทฅๅ ท/็ฝ็๏ผๆฏๆๅคๅญๅจ่ๅ็ฎก็ๅWebDAV ๆๅกๆ่ฝฝใๅ ผๅฎน S3ใWebDAVใOneDriveใGoogle DriveใTelegramใHFใGitHub ็ญใๅ ็ฝฎ Markdown ็ผ่พๅจใ30+ๆไปถๆ ผๅผ้ข่งใๆฏๆ Cloudflare Workers ๆ Docker ้จ็ฝฒใ
Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.
CLI tool to easily migrate or backup/restore Kubernetes persistent volumes
Node.js framework made by a former @expressjs TC and @koajs team member. Built for @forwardemail, @spamscanner, @breejs, @cabinjs, and @lassjs.
AWS Mobile React Native Starter App https://aws.amazon.com/mobile
๐ Self hosted note taking app stored on S3
The Universal Storage Engine
Amazon Q, CodeCatalyst, Local Lambda debug, SAM/CFN syntax, ECS Terminal, AWS resources
Photo blog, reporting ๐ค EXIF camera details (aperture, shutter speed, ISO) for each image.
Tool for easy backup and restore for ClickHouseยฎ using object storage for backup files.
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
A collection of bash shell scripts for automating various tasks with Amazon Web Services using the AWS CLI and jq.
Example end to end data engineering project.
Add database, KV, blob storage, and cache to your Nuxt application. NuxtHub works on Vercel, Cloudflare, Netlify, and more.
Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.
Backtest 1000s of minute-by-minute trading algorithms for training AI with automated pricing data from: IEX, Tradier and FinViz. Datasets and trading performance automatically published to S3 for building AI training datasets for teaching DNNs how to trade. Runs on Kubernetes and docker-compose. >150 million trading history rows generated from +5000 algorithms. Heads up: Yahoo's Finance API was disabled on 2019-01-03 https://developer.yahoo.com/yql/
Bareos is a cross-network Open Source backup solution (licensed under AGPLv3) which preserves, archives, and recovers data from all major operating systems.
๐Auth and ๐ฆStorage for Hasura. The quickest way to get Auth and Storage working for your next app based on Hasura.
A mock implementation of the AWS S3 API startable as Docker image, TestContainer, JUnit 4 rule, JUnit Jupiter extension or TestNG listener
๐ฆญ Run and operate MariaDB in a cloud native way
Kurrier is a modern, self-hosted workspace for email, calendar, contacts and storage.
RClone Manager is a cross-platform GUI application designed to help users manage Rclone remotes efficiently.
A Python-based application to backup Grafana settings by using the Grafana API
Measure Amazon S3's performance from any location.