Example of GPU-accelerated machine learning on the RCS compute cluster using Jupyter and conda
Last updated Aug 6, 2025
11
Stars
1
Forks
0
Issues
0
Stars/day
Attention Score
1
Language breakdown
Jupyter Notebook 97.6%
Shell 2.4%
▸ Files
click to expand
README
Pacemakers
These instructions describe how to run a lightly-modified version of the Pacemakers Kaggle kernel on Imperial College's HPC system.
Platforms such as Kaggle, Colab and Azure Notebooks are great for sharing notebooks but there are advantages to using the RCS Compute Service for your research:
- Your data remains inside the College, via the RDS
- You can run long, non-interactive and/or parallel jobs (see below)
- You have access to multi-GPU nodes and several models of GPU (details)
Setup
- Clone or download this repository to the HPC system
- Download the data to
TrainandTestfolders in the same directory - Create a conda environment with the required dependencies:
conda env create --file environment.yml
Execute
To run the notebook in Jupyter (P1000):
- Visit the RCS Jupyter Service
- Create a new server (GPU recommended)
- Open
pacemakers.ipynband run the notebook
qsub pacemakers.pbs.sh- On job completion visit the RCS Jupyter Service
- Open
pacemakers.ipynband review the outputs
Multi-GPU execution
This repository has two branches. The master branch (the default) targets a single GPU. The multi-gpu branch uses DataParallel to target two GPUs. You can see the relevant modifications by comparing the branches.
Acknowledgements
Many thanks to James Howard for sharing his work and reviewing these instructions.
🔗 More in this category