#Mla
Showing 2 of 2 repositories tagged #mla, ranked by stars
xlite-dev
Awesome-LLM-Inference
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
Score
0
★ 5.4k
⑂ 420
+19/day
Python
Bruce-Lee-LY
decoding_attention
Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
Score
0
★ 47
⑂ 4
—
C++