#Distributed-systems
Showing 60 of 289 repositories tagged #distributed-systems, ranked by stars
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
Distributed reliable key-value store for the most critical data of a distributed system
Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.
Reference implementation of Anoma
SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
A realtime distributed messaging platform
《Designing Data-Intensive Application》DDIA 第一版 / 第二版 中文翻译
A Go agent harness and service framework
Temporal service
High-Performance server for NATS.io, the cloud and edge native messaging system.
The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.
Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
The infrastructure platform for the intelligence era
open source training courses about distributed database and distributed systems
Cloud Native application framework for .NET
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Distributed, offline-first bug tracker embedded in git
Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
Provides a simple way to run Selenium Grid with Chrome, Firefox, and Edge using Container Platform, making it easier to perform browser automation at scale
⭐ 【出版书籍】京东购买链接 https://item.jd.com/14531549.html 深入讲解内核网络、Kubernetes、ServiceMesh、容器等云原生相关技术。经历实践检验的“大规模分布式系统”开发指南。
Cloud-Native distributed storage built on and for Kubernetes
🪓 An orchestration engine for background tasks, AI agents, and durable workflows
🐼 Chinese translations for classic software development resources
Open Source, Google Zanzibar-inspired database for scalably storing and querying fine-grained authorization data
Python Stream Processing
Instant Kubernetes-Native Application Observability
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
Data-Centric Pipelines and Data Versioning
A Cloud Native traffic orchestration system
⟁ Tendermint Core (BFT Consensus) in Go
Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
A feature complete and high performance multi-group Raft library in Go.
FastStream is an asynchronous Python framework for building event-driven applications. It brings together message broker integration, dependency injection, validation, testing utilities, and AsyncAPI documentation generation in a single toolkit
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
Build powerful pipelines in any programming language.
Fullstack Workspace for Humans & Machines
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
Dkron - Distributed, fault tolerant job scheduling system https://dkron.io
Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.
An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.
Next generation distributed, event-driven, parallel config management!
Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.
Efficient and minimal collaborative code editor, self-hosted, no database required
A list of useful resources to learn Data Engineering from scratch
High-Performance Symbolic Regression in Python and Julia
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
Distributed, in-memory key/value store and cache. It can be used as an embedded Go library and a language-independent service.
Raft distributed consensus algorithm implemented in Rust.
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
Lightweight, facility, high performance golang based game server framework
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Service Fabric is a distributed systems platform for packaging, deploying, and managing stateless and stateful distributed applications and containers at large scale.
zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.
Highly-available Distributed Fault-tolerant Runtime