#Load-balancing
Showing 13 of 13 repositories tagged #load-balancing, ranked by stars
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Consistent hashing with bounded loads in Golang
A simple and ultrafast http reverse proxy serving multiple domain names and terminating TLS for http/1.1, 2 and 3, written in Rust
The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
Cloud & DevOps Architecture Diagrams-as-Code in Python, D2 and MermaidJS languages
☸ Add a floating virtual IP to Kubernetes cluster nodes for load balancing easily.
GoCast is a tool for controlled BGP route announcements from a host
A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format
Route inference across providers.
A secure and efficient gateway for interacting with OpenAI's API, featuring load balancing, user request handling without individual API keys, and global access control.
Awesome Mixture of Experts (MoE): A Curated List of Mixture of Experts (MoE) and Mixture of Multimodal Experts (MoME)
Ansible role to configure Nginx as a load balancer
Batata is a high-performance, Rust-based service discovery and configuration management platform for cloud-native applications. It provides full API compatibility with Nacos V2/V3 and Consul, serving as a production-ready drop-in replacement