Showing 1 of 1 repositories tagged #mode-compression, ranked by stars
Official code for the Manning book on structural LLM optimization: depth/width pruning, knowledge distillation, and attention optimization, runnable on free Colab GPUs.
