#Eval
Showing 16 of 16 repositories tagged #eval, ranked by stars
Re-write of Injection for Xcode in (mostly) Swift
Interactive Go interpreter and debugger with REPL, Eval, generics and Lisp-like macros
A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
Fast and safe evaluation of algebraic expressions
A small, powerful, open-source CLI coding agent that works with open models.
High-performance LLM evaluation framework with parallel API calls — up to 17× faster than sequential tools. Supports box, math, and logit-based evaluation.
Serbian LLM Eval.
Multi-Agent Step Race Benchmark: Assessing LLM Collaboration and Deception Under Pressure. A multi-player “step-race” that challenges LLMs to engage in public conversation before secretly picking a move (1, 3, or 5 steps). Whenever two or more players choose the same number, all colliding players fail to advance.
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
Expressions Evaluator for .NET
This course uses a deliberately vulnerable banking application to demonstrate common security vulnerabilities, their impact, and how to fix them. The application is built with Flask (backend) and React (frontend).
Open Source Embeddings Optimisation and Eval Framework for RAG/LLM Applications. Documentations at https://docs.vectorboard.ai/introduction
A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).
Validate and retry LLM outputs for ruby_llm. Describe the JSON response you expect, fall back to a stronger model when the cheaper one fails the rules, and gate CI on regressions — all as one contract object per step.
Prompts and evaluation data for LLMs on real world coding and writing tasks
Autonomous AI skill improvement through iterative experimentation — inspired by Karpathy's autoresearch. An agent mutates skill instructions, evaluates against objective metrics, keeps improvements, reverts regressions. No human in the loop.