#Ai-evaluation

Showing 10 of 10 repositories tagged #ai-evaluation, ranked by stars

ifixai-ai
ifixai-ai
iFixAi

Catch your AI's mistakes and blind spots before your customers or regulators do. iFixAi runs 45 inspections, 32 graded core plus 13 extended for frontier risks like sabotage, sandbagging, and oversight evasion. It returns a letter grade in under 5 minutes. Industry and model agnostic.

Score
0
★ 1.3k ⑂ 166 +44/day
Python
cvs-health
cvs-health
uqlm

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Score
100
★ 1.2k ⑂ 126 +3/day
Python
lechmazur
lechmazur
confabulations

Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.

Score
0
★ 248 ⑂ 9 +1/day
HTML
mahmoudrabie
mahmoudrabie
agentic-ai

Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.

Score
83
★ 154 ⑂ 4 +1/day
taoAIGC
taoAIGC
AICompare

one click to open multi AI sites | 一键打开多个 AI 站点,查看 AI 结果

Score
67
★ 117 ⑂ 14
JavaScript
ianarawjo
ianarawjo
evalstats

Statistical analysis methods for comparing prompt and model performance in LLM evaluations.

Score
50
★ 107 ⑂ 2
Python
Vvkmnn
Vvkmnn
awesome-ai-eval

☑️ A curated list of tools, methods & platforms for evaluating AI reliability in real applications

Score
33
★ 94 ⑂ 23 +1/day
kereva-dev
kereva-dev
kereva-scanner

Code scanner to check for issues in prompts and LLM calls

Score
0
★ 78 ⑂ 8
Python
Galileo-Agent-Labs
Galileo-Agent-Labs
eval-engineer

Bring Galileo powered eval workflows into Claude Code and Codex.

Score
17
★ 36 ⑂ 6
Python
HZYAI
HZYAI
RagScore

⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.

Score
0
★ 22 ⑂ 3
Python
Related Topics
#llm#rag#ai#ai-safety#llm-evaluation#claude#gemini#evaluation#cli#hallucination-detection#llm-security#prompt-injection

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly