#Latency-optimization

avilum

minrlm

A small Recursive Language Model: let any LLM run code on its context instead of stuffing it into the prompt.

megeezy

Chameleon

Stateless LLM runtime that dynamically routes, loads, executes, and unloads models per request with bounded VRAM caching and intelligent model selection.