#Ai-evaluation
Showing 10 of 10 repositories tagged #ai-evaluation, ranked by stars
Catch your AI's mistakes and blind spots before your customers or regulators do. iFixAi runs 45 inspections, 32 graded core plus 13 extended for frontier risks like sabotage, sandbagging, and oversight evasion. It returns a letter grade in under 5 minutes. Industry and model agnostic.
UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.
one click to open multi AI sites | 一键打开多个 AI 站点,查看 AI 结果
Statistical analysis methods for comparing prompt and model performance in LLM evaluations.
☑️ A curated list of tools, methods & platforms for evaluating AI reliability in real applications
Code scanner to check for issues in prompts and LLM calls
Bring Galileo powered eval workflows into Claude Code and Codex.
⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.