#Model-compression

Showing 36 of 36 repositories tagged #model-compression, ranked by stars

microsoft
microsoft
nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Score
100
★ 14.4k ⑂ 1.9k +2/day
Python
dkozlov
dkozlov
awesome-knowledge-distillation

Awesome Knowledge Distillation

Score
100
★ 3.9k ⑂ 512 +2/day
VainF
VainF
Torch-Pruning

[CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.

Score
100
★ 3.3k ⑂ 383
Python
Tencent
Tencent
PocketFlow

An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

Score
0
★ 2.9k ⑂ 490
Python
FLHonker
FLHonker
Awesome-Knowledge-Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

Score
79
★ 2.7k ⑂ 332 +1/day
Efficient-ML
Efficient-ML
Awesome-Model-Quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

Score
95
★ 2.4k ⑂ 240 +1/day
haitongli
haitongli
knowledge-distillation-pytorch

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

Score
68
★ 2.0k ⑂ 353 +1/day
Python
tensorflow
tensorflow
model-optimization

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

Score
89
★ 1.6k ⑂ 348
Python
microsoft
microsoft
NeuronBlocks

NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

Score
58
★ 1.5k ⑂ 190
Python
horseee
horseee
DeepCache

[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

Score
50
★ 969 ⑂ 54
Python
MingSun-Tse
MingSun-Tse
Efficient-Deep-Learning

Collection of recent methods on (deep) neural network compression and acceleration.

Score
53
★ 955 ⑂ 132
alibaba
alibaba
TinyNeuralNetwork

TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.

Score
84
★ 879 ⑂ 133
Python
SqueezeAILab
SqueezeAILab
SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

Score
75
★ 722 ⑂ 51
Python
cnkuangshi
cnkuangshi
LightCTR

Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosophy of Parameter Server and Ring-AllReduce collective communication.

Score
47
★ 668 ⑂ 138
C++
SforAiDl
SforAiDl
KD_Lib

A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.

Score
100
★ 650 ⑂ 61 +1/day
Python
cedrickchee
cedrickchee
awesome-ml-model-compression

Awesome machine learning model compression research papers, quantization, tools, and learning material.

Score
42
★ 546 ⑂ 62
microsoft
microsoft
archai

Accelerate your Neural Architecture Search (NAS) through fast, reproducible and modular research.

Score
63
★ 485 ⑂ 93
Python
1duo
1duo
awesome-ai-infrastructures

Infrastructures™ for Machine Learning Training/Inference in Production.

Score
0
★ 454 ⑂ 88
SqueezeAILab
SqueezeAILab
KVQuant

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Score
50
★ 430 ⑂ 46
Python
pratyushasharma
pratyushasharma
laser

The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction

Score
25
★ 395 ⑂ 35 +1/day
Python
sunshangquan
sunshangquan
logit-standardization-KD

[CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation

Score
26
★ 386 ⑂ 31
Jupyter Notebook
HanXinzi-AI
HanXinzi-AI
awesome-computer-vision-resources

a collection of computer vision projects&tools. 计算机视觉方向项目和工具集合。

Score
32
★ 354 ⑂ 44 +1/day
Picovoice
Picovoice
picollm

On-device LLM Inference Powered by X-Bit Quantization

Score
88
★ 315 ⑂ 26 +2/day
Python
AIoT-MLSys-Lab
AIoT-MLSys-Lab
SVD-LLM

[ICLR 2025🔥] SVD-LLM & [NAACL 2025🔥] SVD-LLM V2

Score
62
★ 299 ⑂ 46
Python
FasterAI-Labs
FasterAI-Labs
fasterai

FasterAI: Prune and Distill your models with FastAI and PyTorch

Score
74
★ 265 ⑂ 19
Jupyter Notebook
VainF
VainF
Data-Free-Adversarial-Distillation

Code and pretrained models for paper: Data-Free Adversarial Distillation

Score
0
★ 99 ⑂ 16
Python
jordddan
jordddan
Pruning-LLMs

The framework to prune LLMs to any size and any config.

Score
12
★ 94 ⑂ 3
Python
CASE-Lab-UMD
CASE-Lab-UMD
Unified-MoE-Compression

The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".

Score
37
★ 89 ⑂ 6
Python
archsyscall
archsyscall
aquvitae

Knowledge Distillation Toolkit

Score
16
★ 88 ⑂ 10
Python
hnuzhy
hnuzhy
CV_DL_Gather

Gather research papers, corresponding codes (if having), reading notes and any other related materials about Hot🔥🔥🔥 fields in Computer Vision based on Deep Learning.

Score
21
★ 81 ⑂ 5
UMBCvision
UMBCvision
CompRess

Compressing Representations for Self-Supervised Learning

Score
11
★ 80 ⑂ 12
Python
whucs21Mzy
whucs21Mzy
Model-Phase-Transitions

Navigating Model Phase Transitions to Enable Extreme Lossless Compression: A Perspective

Score
38
★ 76 ⑂ 1
Hulalazz
Hulalazz
A-_Guide_-to_Data_Sciecne_from_mathematics

It is a blueprint to data science from the mathematics to algorithms. It is not completed.

Score
0
★ 67 ⑂ 22
HTML
Irtza
Irtza
Keras_model_compression

Model Compression Based on Geoffery Hinton's Logit Regression Method in Keras applied to MNIST 16x compression over 0.95 percent accuracy.An Implementation of "Distilling the Knowledge in a Neural Network - Geoffery Hinton et. al"

Score
5
★ 61 ⑂ 4
Jupyter Notebook
mlzxy
mlzxy
qsparse

Train neural networks with joint quantization and pruning on both weights and activations using any pytorch modules

Score
0
★ 42 ⑂ 2
Python
linkedin
linkedin
QuantEase

QuantEase, a layer-wise quantization framework, frames the problem as discrete-structured non-convex optimization. Our work leverages Coordinate Descent techniques, offering high-quality solutions without the need for matrix inversion or decomposition.

Score
0
★ 19 ⑂ 3
Python
Related Topics
#deep-learning#machine-learning#pytorch#knowledge-distillation#quantization#pruning#llm#computer-vision#natural-language-processing#large-language-models#tensorflow#efficient-inference

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly