Showing 2 of 2 repositories tagged #offloading, ranked by stars
Running large language models on a single GPU for throughput-oriented scenarios.
Run Mixtral-8x7B models in Colab or consumer desktops
