#Llm-as-a-judge
Showing 8 of 8 repositories tagged #llm-as-a-judge, ranked by stars
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
Evaluate your LLM's response with Prometheus and GPT4 💯
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
Evaluation package that allows benchmarking of agentic AIs from various sources and frameworks by producing statistical results which can be compared across different use cases and datasets.
First-of-its-kind AI benchmark for evaluating the protection capabilities of large language model (LLM) guard systems (guardrails and safeguards)
This is the repo for the survey of Bias and Fairness in IR with LLMs.
⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.