#Llm-evaluation-framework
Showing 9 of 9 repositories tagged #llm-evaluation-framework, ranked by stars
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
The LLM Evaluation Framework
The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.
LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
The official evaluation suite and dynamic data release for MixEval.
MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.
Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
Realign is a testing and simulation framework for AI applications.