#Kvcache
Showing 5 of 5 repositories tagged #kvcache, ranked by stars
kvcache-ai
Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Score
100
★ 5.8k
⑂ 950
+21/day
C++
uccl-project
uccl
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
Score
75
★ 1.4k
⑂ 160
+3/day
C++
Zefan-Cai
R-KV
[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
Score
50
★ 1.2k
⑂ 194
—
Python
ovg-project
kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
Score
25
★ 1.1k
⑂ 122
+1/day
Python
agentic-in
inferoa
Inference-native Tokenmaxxing Agent Harness for Loop Engineering
Score
0
★ 418
⑂ 69
+48/day
TypeScript