#Distributed
Showing 60 of 147 repositories tagged #distributed, ranked by stars
An Open Source Machine Learning Framework for Everyone
ClickHouseยฎ is a real-time analytics database management system
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
A scalable, distributed, collaborative, document-graph database, for the realtime web
โ๏ธ DEPRECATED โ See https://github.com/ageron/handson-ml3 or handson-mlp instead.
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
high-performance graph database for real-time use cases
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
AI-powered development workspaces with reusable components, architectural clarity and zero overhead.
Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
A hyperparameter optimization framework
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
A distributed transaction framework, supports workflow, saga, tcc, xa, 2-phase message, outbox patterns, supports many languages.
Modin: Scale your Pandas workflows by changing a single line of code
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
๐ช An orchestration engine for background tasks, AI agents, and durable workflows
Distributed SQL database in Rust, written as an educational project
The open-source Observability 2.0 database. One engine for metrics, logs, and traces โ replacing Prometheus, Loki & ES.
An open-source authorization as a service inspired by Google Zanzibar, designed to build and manage fine-grained and scalable authorization systems for any application. โ Permify is now part of FusionAuth ๐
Redis-based components for Scrapy.
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
YDB is an open source Distributed SQL Database that combines high availability and scalability with strong consistency and ACID transactions
An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
Distributed private networking
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
A cloud-native database based on PostgreSQL developed by Alibaba Cloud.
A fast Golang Redis client that supports Client Side Caching, Auto Pipelining, RDMA, etc.
Highly-available Distributed Fault-tolerant Runtime
Blockchain-based marketplace for file storage. Project has moved to GitLab: https://gitlab.com/NebulousLabs/Sia
Web-based Cloud Gaming service for Retro Game
wasmCloud is an open source Cloud Native Computing Foundation (CNCF) project that enables teams to build, manage, and scale polyglot apps across any cloud, K8s, or edge.
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
Apache DataFusion Ballista Distributed Query Engine
๐๏ธ The world's most advanced open source instant messaging engine for 100K~10M concurrent users https://turms-im.github.io/docs
Gossip-based service discovery (and more) for large distributed systems.
Simplified distributed locking implementation using Redis
DEPRECATED - Raspberry Pi Kubernetes cluster that runs HA/HP Drupal 8
Agola: CI/CD Redefined
Official Implementation of 'Fast AutoAugment' in PyTorch.
MLBox is a powerful Automated Machine Learning python library.
Nerdlog: fast, remote-first, multi-host TUI log viewer with timeline histogram and no central server
Sandglass is a distributed, horizontally scalable, persistent, time sorted message queue.
The pure golang implementation of nanomsg (version 1, frozen)
[unmaintained] An open-source convolutional neural networks platform for research in medical image analysis and image-guided therapy
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
Examples of programs built using Modal
Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.
Mysterium Network Node - official implementation of distributed VPN network (dVPN) protocol
CNCF sandbox project, an open source distributed time-series database with high concurrency, high performance, and high scalability
ๅบไบๅบๅ้พ็็ฌฆๅW3C DIDๅVerifiable Credential่ง่็ๅๅธๅผ่บซไปฝ่งฃๅณๆนๆก
Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.
Torrent client with HTTP, fuse, and WebDAV interfaces. Start exploring your torrent files right away, even zip, rar, or 7zip archive contents!
๐ถ Awesome list of distributed, decentralized, p2p apps and tools ๐