#Llm-cost
Showing 5 of 5 repositories tagged #llm-cost, ranked by stars
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
Nadir is a Python package designed to dynamically choose the best llm for your prompt by balancing complexity and cost and response time.
A curated list of strategies, tools, papers, and resources for reducing LLM token costs and improving efficiency in production.