#Efficient-inference
Showing 13 of 13 repositories tagged #efficient-inference, ranked by stars
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free
Code for paper " AdderNet: Do We Really Need Multiplications in Deep Learning?"
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
Learning Efficient Convolutional Networks through Network Slimming, In ICCV 2017.
Fast, lossless LLM inference via dual-view diffusion decoding.
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
On-device LLM Inference Powered by X-Bit Quantization
Explorations into some recent techniques surrounding speculative decoding
[EMNLP 2025 Main] Video Compression Commander: Plug-and-Play Inference Acceleration for Video Large Language Models
[NeurIPS'23] Speculative Decoding with Big Little Decoder
[ICLR 2022] Code for Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillation (GLNN)
BlockRank makes LLMs efficient and scalable for RAG and in-context ranking