#Distributed-computing

Showing 60 of 92 repositories tagged #distributed-computing, ranked by stars

hpcaitech
hpcaitech
ColossalAI

Making large AI models cheaper, faster and more accessible

Score
100
★ 41.4k ⑂ 4.5k +4/day
Python
ty4z2008
ty4z2008
Qix

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Score
100
★ 15.2k ⑂ 4.6k +1/day
livebook-dev
livebook-dev
livebook

Automate code & data workflows with interactive Elixir notebooks

Score
100
★ 5.8k ⑂ 500 +9/day
Elixir
Eventual-Inc
Eventual-Inc
Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Score
80
★ 5.6k ⑂ 514 +2/day
Rust
asynkron
asynkron
protoactor-go

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

Score
80
★ 5.5k ⑂ 573 +6/day
Go
chrislusf
chrislusf
gleam

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

Score
60
★ 3.6k ⑂ 292 +3/day
Go
pytorch
pytorch
rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

Score
100
★ 3.5k ⑂ 466 +2/day
Python
catalyst-team
catalyst-team
catalyst

Accelerated deep learning R&D

Score
40
★ 3.4k ⑂ 399
Python
alpa-projects
alpa-projects
alpa

Training and serving large-scale neural networks with auto parallelization.

Score
60
★ 3.2k ⑂ 362
Python
lakehq
lakehq
sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Score
60
★ 3.1k ⑂ 192 +2/day
Rust
b4rtaz
b4rtaz
distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Score
100
★ 3.0k ⑂ 238 +7/day
C++
eclipse-zenoh
eclipse-zenoh
zenoh

zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

Score
100
★ 3.0k ⑂ 326 +38/day
Rust
BOINC
BOINC
boinc

Open-source software for volunteer computing and grid computing.

Score
0
★ 2.4k ⑂ 515 +5/day
C++
fugue-project
fugue-project
fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Score
94
★ 2.2k ⑂ 101
Python
innovation-cat
innovation-cat
Awesome-Federated-Machine-Learning

Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond

Score
100
★ 2.1k ⑂ 282 +2/day
beam-cloud
beam-cloud
beta9

Ultrafast serverless GPU inference, sandboxes, and background jobs

Score
90
★ 1.7k ⑂ 145
Go
google
google
vizier

Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

Score
92
★ 1.7k ⑂ 111 +2/day
Python
maxpumperla
maxpumperla
elephas

Distributed Deep learning with Keras & Spark

Score
77
★ 1.6k ⑂ 304
Python
AshwinRJ
AshwinRJ
Federated-Learning-PyTorch

Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data

Score
85
★ 1.4k ⑂ 459
Python
holochain
holochain
holochain

The current, performant & industrial strength version of Holochain on Rust.

Score
90
★ 1.4k ⑂ 190
Rust
couler-proj
couler-proj
couler

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

Score
20
★ 943 ⑂ 86
Python
lichess-org
lichess-org
fishnet

Distributed Stockfish analysis for lichess.org

Score
80
★ 912 ⑂ 112 +4/day
Rust
BaguaSys
BaguaSys
bagua

Bagua Speeds up PyTorch

Score
50
★ 880 ⑂ 81
Python
jmerelnyc
jmerelnyc
Talos

GPU worker client for the Talos network. Pairs with your Talos account, serves open-model inference jobs over a WebSocket, and reports uptime for payouts.

Score
80
★ 778 ⑂ 13 +195/day
Python
substantic
substantic
rain

Framework for large distributed pipelines

Score
40
★ 760 ⑂ 54 +1/day
Rust
google
google
yggdrasil-decision-forests

A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.

Score
40
★ 662 ⑂ 80 +1/day
C++
lablup
lablup
backend.ai

Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, Gaudi NPU, Google TPU, GraphCore IPU and other NPUs.

Score
100
★ 655 ⑂ 178
Python
WwZzz
WwZzz
easyFL

An experimental platform for federated learning.

Score
69
★ 630 ⑂ 103
Jupyter Notebook
It4innovations
It4innovations
hyperqueue

User-friendly Scheduler for sub-node tasks for HPC systems

Score
70
★ 544 ⑂ 50 +3/day
Rust
tidwall
tidwall
finn

Fast Raft framework using the Redis protocol for Go

Score
0
★ 533 ⑂ 24
Go
kubeflow
kubeflow
mpi-operator

Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)

Score
90
★ 529 ⑂ 237
Go
HDI-Project
HDI-Project
ATM

Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).

Score
75
★ 528 ⑂ 140
Python
constellation-rs
constellation-rs
amadeus

Harmonious distributed data analysis in Rust.

Score
30
★ 479 ⑂ 25
Rust
tushar-semwal
tushar-semwal
awesome-federated-computing

:books: :eyeglasses: A collection of research papers, codes, tutorials and blogs on Federated Computing/Learning.

Score
62
★ 479 ⑂ 85
bharathgs
bharathgs
Awesome-Distributed-Deep-Learning

A curated list of awesome Distributed Deep Learning resources.

Score
62
★ 441 ⑂ 85
PersiaML
PersiaML
PERSIA

High performance distributed framework for training deep learning recommendation models based on PyTorch.

Score
60
★ 414 ⑂ 55
Rust
jaylfc
jaylfc
taOS

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

Score
70
★ 411 ⑂ 31
Python
ArchiveBox
ArchiveBox
good-karma-kit

😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...

Score
70
★ 395 ⑂ 14
maxpumperla
maxpumperla
learning_ray

Notebooks for the O'Reilly book "Learning Ray"

Score
56
★ 354 ⑂ 96
Jupyter Notebook
guydavis
guydavis
machinaris

An easy-to-use WebUI for crypto plotting and farming. Offers Bladebit, Gigahorse, MadMax, Chiadog and Plotman in a Docker container. Supports Chia, MMX, Chives, Flax, and HDDCoin among others.

Score
100
★ 341 ⑂ 71
Python
profjsb
profjsb
python-seminar

Python for Data Science (Seminar Course at UC Berkeley; AY 250)

Score
69
★ 332 ⑂ 162
Jupyter Notebook
selinon
selinon
selinon

An advanced distributed task flow management on top of Celery

Score
60
★ 315 ⑂ 35
Python
zero-one-group
zero-one-group
geni

A Clojure dataframe library that runs on Spark

Score
50
★ 295 ⑂ 26
Clojure
Bears-R-Us
Bears-R-Us
arkouda

Arkouda (αρκούδα): Interactive Data Analytics at Supercomputing Scale :bear:

Score
88
★ 281 ⑂ 98
Python
FleexSecurity
FleexSecurity
fleex

Fleex makes it easy to create multiple VPS on cloud providers and use them to distribute workloads.

Score
0
★ 269 ⑂ 35
Go
helmholtz-analytics
helmholtz-analytics
heat

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

Score
81
★ 243 ⑂ 66 +1/day
Python
lachlan2k
lachlan2k
phatcrack

Modern web-based distributed hashcracking solution, built on hashcat

Score
50
★ 193 ⑂ 14
Go
daveschumaker
daveschumaker
artbot-for-stable-diffusion

A front-end GUI for interacting with the AI Horde / Stable Diffusion distributed cluster

Score
0
★ 187 ⑂ 41
TypeScript
lightforever
lightforever
mlcomp

Distributed DAG (Directed acyclic graph) framework for machine learning with UI

Score
54
★ 186 ⑂ 25
Python
Haidra-Org
Haidra-Org
horde-worker-reGen

The default client software for volunteering to generate images for the crowdsourced AI-Horde

Score
50
★ 174 ⑂ 65
Python
varchar-io
varchar-io
nebula

A distributed block-based data storage and compute engine

Score
44
★ 158 ⑂ 21
C++
stateless-minds
stateless-minds
cyber-stasis

Post-money economy simulator in the form of a free fictional game based on gift economy that tests the hypothesis of having a market system without any exchange be it barters or money.

Score
88
★ 133 ⑂ 4
Go
Aavache
Aavache
LLMWebCrawler

A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG.

Score
20
★ 102 ⑂ 12
Python
JasonThon
JasonThon
lightflus

A Lightweight, Cloud-Native Stateful Distributed Dataflow Engine

Score
10
★ 100 ⑂ 10
Rust
alibaba
alibaba
TePDist

TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.

Score
38
★ 97 ⑂ 10
C++
JorgeCandeias
JorgeCandeias
Trader

Trader is an algorithmic trading framework and host built on Microsoft Orleans.

Score
0
★ 94 ⑂ 17
C#
TalwalkarLab
TalwalkarLab
paleo

An analytical performance modeling tool for deep neural networks.

Score
46
★ 93 ⑂ 40
Python
mahmoudparsian
mahmoudparsian
pyspark-algorithms

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

Score
38
★ 88 ⑂ 41
Python
alibaba
alibaba
easydist

Automated Parallelization System and Infrastructure for Multiple Ecosystems

Score
10
★ 82 ⑂ 7
Python
input-output-hk
input-output-hk
high-assurance-legacy

Legacy code connected to the high-assurance implementation of the Ouroboros protocol family

Score
75
★ 79 ⑂ 15
Haskell
Related Topics
#machine-learning#deep-learning#python#distributed-systems#pytorch#rust#data-science#llm#big-data#high-performance-computing#hpc#golang

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly