#Slurm

Showing 33 of 33 repositories tagged #slurm, ranked by stars

stas00
stas00
ml-engineering

Machine Learning Engineering Open Book

Score
100
★ 18.3k ⑂ 1.2k +18/day
Python
skypilot-org
skypilot-org
skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

Score
67
★ 10.3k ⑂ 1.1k +1/day
Python
nextflow-io
nextflow-io
nextflow

A DSL for data-driven computational pipelines

Score
100
★ 3.4k ⑂ 788 +4/day
Groovy
dstackai
dstackai
dstack

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Score
94
★ 2.2k ⑂ 236 +1/day
Python
DataBiosphere
DataBiosphere
toil

A WDL, CWL and Python API supporting easy-to-use workflow engine. It is scalable, efficient and cross-platform (Linux/macOS).

Score
33
★ 936 ⑂ 246
Python
giovtorres
giovtorres
slurm-docker-cluster

A Slurm cluster using docker-compose

Score
88
★ 524 ⑂ 264
Shell
karimknaebel
karimknaebel
turm

TUI for the Slurm Workload Manager

Score
100
★ 488 ⑂ 30
Rust
awslabs
awslabs
awsome-distributed-ai

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

Score
82
★ 455 ⑂ 195 +3/day
Shell
meta-pytorch
meta-pytorch
torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

Score
76
★ 427 ⑂ 155
Python
nebius
nebius
soperator

Run Slurm in Kubernetes

Score
65
★ 400 ⑂ 60
Go
elasticluster
elasticluster
elasticluster

Create clusters of VMs on the cloud and configure them with Ansible.

Score
18
★ 339 ⑂ 149
Python
SlinkyProject
SlinkyProject
slurm-operator

Run Slurm on Kubernetes. A Slinky project.

Score
59
★ 326 ⑂ 91 +1/day
Go
dell
dell
omnia

An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.

Score
71
★ 294 ⑂ 167
Python
zhenrong-wang
zhenrong-wang
hpc-now

A Cross-Platform, Multi-Cloud High-Performance Computing Platform

Score
6
★ 272 ⑂ 113
C
calypr
calypr
funnel

Funnel is a toolkit for distributed task execution via a simple, standard API.

Score
53
★ 141 ⑂ 43
Go
aws-samples
aws-samples
aws-hpc-recipes

Contains example recipes that demonstrate how to build HPC systems using AWS services and solutions.

Score
47
★ 97 ⑂ 43
Shell
John-Kazan
John-Kazan
OpenMMScripts

This repository provides scripts for running NPT MD simulations using OpenMM, specifically designed for use on the PHX cluster.

Score
0
★ 97 ⑂ 0
Python
giovtorres
giovtorres
docker-centos7-slurm

Slurm Docker Container on CentOS 7

Score
35
★ 90 ⑂ 56
Python
SlinkyProject
SlinkyProject
slurm-bridge

Run Slurm as a Kubernetes scheduler. A Slinky project.

Score
29
★ 90 ⑂ 23
Go
CLIP-HPC
CLIP-HPC
SlurmCommander

Slurm TUI

Score
50
★ 80 ⑂ 6
Go
AndPuQing
AndPuQing
gflow

A lightweight, single-node GPU job scheduler implemented in Rust.

Score
0
★ 79 ⑂ 2
Rust
ceems-dev
ceems-dev
ceems

A Prometheus exporter and a REST API server to export metrics of compute units of resource managers like SLURM, LSF, Openstack, k8s

Score
24
★ 73 ⑂ 7 +1/day
C
stackhpc
stackhpc
ansible-slurm-appliance

A Slurm-based HPC workload management environment, driven by Ansible.

Score
41
★ 72 ⑂ 40
Python
NERSC
NERSC
slurm-magic

IPython magic for SLURM.

Score
80
★ 70 ⑂ 18
Python
hill
hill
lazyslurm

like lazygit/lazydocker but for slurm

Score
100
★ 66 ⑂ 7 +1/day
Rust
fgci-org
fgci-org
fgci-ansible

:microscope: Collection of the Finnish Grid and Cloud Infrastructure Ansible playbooks

Score
0
★ 56 ⑂ 18
Shell
ploomber
ploomber
soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.

Score
60
★ 46 ⑂ 20
Python
last9
last9
gpu-telemetry

GPU Observability with workload attribution. One OTLP agent per node ties hardware metrics (NVIDIA, AMD, Intel Gaudi) to the K8s pod or Slurm job burning the GPU.

Score
12
★ 46 ⑂ 4
Python
berkegokmen1
berkegokmen1
slurm-ssh-compute-node

Connect to Slurm Compute Nodes Directly from VSCode. Do your debugging and development easily.

Score
0
★ 31 ⑂ 0
Shell
hokiegeek2
hokiegeek2
slurm-cloud-integration

slurm-docker-integration provides HPC-Kubernetes integration artifacts

Score
40
★ 26 ⑂ 9
Smarty
pc2
pc2
slurm_jupyter_kernel

Manage (create, list, modify and delete) and starting jupyter kernels using sbatch

Score
20
★ 15 ⑂ 5
Python
lunarc
lunarc
gfxlauncher

User interface for launching interactive software through SLURM. Supports launching standard graphical applications X11 application (software and hardware accelerated), Jupyter Notebooks/Labs and Windows based applications (through RDP).

Score
100
★ 15 ⑂ 6
Python
aaronkollasch
aaronkollasch
jupyter-o2

Run Jupyter on Orchestra 2

Score
0
★ 12 ⑂ 3
Python
Related Topics
#hpc#kubernetes#gpu#machine-learning#aws#docker#cloud#python#jupyter#ansible#mlops#deep-learning

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly