#Litellm
Showing 45 of 45 repositories tagged #litellm, ranked by stars
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
The most accurate document search and store for building AI apps
A set of tools that gives agents powerful capabilities.
Evaluate your LLM's response with Prometheus and GPT4 ๐ฏ
1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.
Self-hostable channel-native AI teammate for Slack. Open source alternative to Claude Tag. LLM-agnostic.
Agent samples built using the Strands Agents SDK.
Draw a store, generate LLM personas, and watch them shop โ an isometric 3D sandbox for synthetic-consumer experiments.
Your easy to use, always-on AI workforce ๐พ
A transparent, minimal, and hackable agent framework. ~300 lines of readable code. Full control, no magic.
An example agent demonstrating streaming, tool use, and interactivity from your terminal. This agent builder can help you to build your own agents and tools.
A website where you can compare every AI Model โจ
Co-create PowerPoint slide decks with AI
Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours
AI-powered companion for Homebox. Snap photos and let AI auto-identify and catalog items into your inventory, then use the AI Chat to organize, search, and update your inventory effortlessly.
Your Claude Pro/Max subscription in any tool โ Cursor, Cline, Aider, Agent SDK โ at subscription pricing, not per-token bills. One local endpoint that replays Claude Code's wire shape so your traffic stays in the subscription pool.
Documentation for the Strands Agents SDK. A model-driven approach to building AI agents in just a few lines of code.
Python toolkit for Chinese LLMs, with flexible batch capacity, structured real-time visulization and automated accumulation for streaming, and explicit feedback on vendor-native parameter validation.
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
CodeWiki is a knowledge platform that analyzes repositories into AST graphs, builds GraphRAG indexes, and generates source-grounded developer wikis with FastAPI, React, and LiteLLM.
To simplify and streamline LLM operations, empowering developers and organizations to harness the full potential of large language models with ease.
Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.
A lightweight AI agent framework for vertical domain applications | ้ขๅๅๅๅบ็จ็่ฝป้็บง AI Agent ๆกๆถ
Secure autonomous AI agent framework and platform. Build AI teams by describing what you want. Orchestrate agents that can do everything a human can do.
Agentic code reviewer for GitHub PRs and GitLab MRs. Multi-step reasoning with autonomous tool orchestration โ catches bugs requiring analysis across files.
Learn to build AI agents with Strands framework. Covers LLM integration via Amazon Bedrock/Anthropic, AWS service connections, tool implementation with MCP/A2A protocols, and agent evaluation using LangFuse/RAGAS.
Sales AI agent that talks with your customers, recommend products, book consultations, and process Stripe payments
Production-ready multi-agent orchestration engine built on Google ADK. Database-driven agent config, 50+ LLM providers, MCP protocol, persistent memory, web dashboard, RBAC.
This project applies the core knowledge from the LLMOps module, including the design and implementation of the API Layer, Inference Layer, Observability Layer, Cache Layer, Guardrails Layer, Routing Layer, and the Data Ingestion Pipeline.
CLI for audio, video, and text transcription with ASR providers and LLM-powered summarization via local or cloud backends.
Debuggable runtime for AI agent workflows. DAG pipelines, artifact lineage, and replayable runs.
Power up your data science workflow with ChatGPT.
SynthGenAI - Package for Generating Synthetic Datasets using LLMs.
PHP library for interacting with AI platform provider.
One-click knowledge system for documents, internal bots, and AI agents
Implementation of Recursive Language Model paper from scratch
Enter a US stock ticker, get an analyst grade memo with DCF valuation, peer comparables, news sentiment, and earnings call tone analysis. Multi agent LLM pipeline (Claude + GPT-4o devil's advocate) with strict citation validation. FastAPI + Next.js + pgvector RAG. No hallucinated numbers
Defanged malware stages from the litellm 1.82.8 PyPI supply chain compromise โ credential stealer, K8s lateral movement, C2 backdoor
An AI agent that controls your Flipper Zero that uses PyFlipper, LightLLM, RAG, and can connect to your local Ollama instance!
Parse bank statements โ CAMT/ISO 20022, PAIN.001, CSV (EN/DE/FR/ES), OFX/QFX, MT940, PDFs (digital + scanned) โ into unified Transactions. Deterministic parsers, LLM/vision fallback, Golden Rule + multi-currency + continuity verification, page provenance, dedupe, review, accuracy evals, CLI + REST API. 100% test coverage.
Autonomous agent networks for task automation that requires multi-step reasoning
High-performance LLM Gateway built in Go - OpenAI compatible proxy with multi-provider support, adaptive routing, and enterprise features
Self-hosted, OpenAI-compatible AI gateway for organizations โ multi-provider (Azure/OpenAI/Anthropic/Gemini), revocable per-allocation credentials, usage & cost tracking, and an OpenAI Codexโready /v1/responses endpoint.
Multi-agent LLM pipeline for long-form novel continuation ยท ๅค Agent ้ฟ็ฏๅฐ่ฏด็ปญๅๆตๆฐด็บฟ๏ผ19 ่ฝฎ่ฟญไปฃ + ๅ จ็จ mock-first