#Compression
Showing 60 of 123 repositories tagged #compression, ranked by stars
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis
Deduplicating archiver with compression and authenticated encryption.
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
An android image compression library.
The macOS & iOS file archiver
The Universal Filesystem Abstraction for Go
Optimized Go Compression Packages
A blazingly fast multi-language serialization framework for idiomatic domain objects, schema IDL, and cross-language data exchange.
DEPRECATED. Please use mholt/archives instead.
Hide secrets with invisible characters in plain text securely using passwords ๐ง๐ปโโ๏ธโญ
Painless compression and decompression in the terminal
SimpleMem: Efficient Lifelong Memory for LLM Agents โ Text & Multimodal
Android multi-media selector based on MVP mode.
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
Swift framework for zipping and unzipping files.
10x faster matrix and vector operations
A tool to convert a Wallpaper's color scheme / palette, OCR with VLM's Traditional & Hybrid, Image Compression ,color palette extraction, image upsacling with Adversarial Networks and more image processing features.
่ทจๅนณๅฐๅฏ็ ๅญฆๅทฅๅ ท็ฎฑใๅ ๅซ็ผ่งฃ็ ๏ผ็ผ็ ่ฝฌๆข๏ผๅ ่งฃๅฏ๏ผ ๅๅธ๏ผMAC๏ผ็ญพๅ๏ผๅคงๆฐ่ฟ็ฎ๏ผๅ็ผฉ๏ผไบ็ปด็ ๅ่ฝ๏ผCTF็ญๅ่ฝใ
A curated list for Efficient Large Language Models
Bichon โ A lightweight, high-performance Rust email archiver with WebUI
XZ Utils
A PyTorch library and evaluation platform for end-to-end compression research
A portable, simple zip library written in C
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
A user interface for Windows 10 filesystem compression
๐๏ธCompress Image, Video, and Audio same like Whatsapp ๐โจ
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
Bareos is a cross-network Open Source backup solution (licensed under AGPLv3) which preserves, archives, and recovers data from all major operating systems.
Neural Network Compression Framework for enhanced OpenVINOโข inference
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
PyTorch Implementation of "Lossless Image Compression through Super-Resolution"
๐ข Super-fast, tiny C/C++ tracing with printf look-and-feel, even in interrupts โก, plus real-time PC logging ๐ป
Simple image compression full website code written in node, react and next.js framework. Easy to deploy as a microservice.
Brotli compressor and decompressor written in rust that optionally avoids the stdlib
Data compression in TensorFlow
๐ State-of-the-art learned data structure that enables fast lookup, predecessor, range searches and updates in arrays of billions of items using orders of magnitude less space than traditional indexes
a free local self hosted video compressor webui designed for performance and ease of use. inspired by 8mb.video
High Octane Triage Analysis
๐ฆ Minecraft: Java Edition resource and data pack optimizer which aims to achieve the best possible compression, performance and protection, improving pack distribution, storage and in-game load times.
a high performance, general purpose data compressor written in the crab-lang
Automated image compression for efficiently distributing images on the web.
New and extensible file format for storage of large columnar datasets.
[ECCV] Swin2SR: SwinV2 Transformer for Compressed Image Super-Resolution and Restoration. Advances in Image Manipulation (AIM) workshop ECCV 2022. Try it out! over 3.3M runs https://replicate.com/mv-lab/swin2sr
A rust binding for the zstd compression library.
DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
Fast lossless data compression in Go
Fastest pure Rust implementation of LZ4 compression/decompression.
A collection of tools for neural compression enthusiasts.
collection of works aiming at reducing model sizes or the ASIC/FPGA accelerator for machine learning
The complete syllabus of Computer Science and Engineering. Roadmap, Checklist for Beginners.
Pure golang package for reading and writing xz-compressed files
Image conversion and optimization desktop app.
Lightning fast, ad free, super lightweight native video compressor for Android
Python AV Evasion Tools
go wrapper for zstd
Dinky makes files smaller.
Intelligent token optimization for Claude Code - achieving 95%+ token reduction through caching, compression, and smart tool intelligence