#Benchmark
Showing 60 of 300 repositories tagged #benchmark, ranked by stars
A command-line benchmarking tool
A MNIST-like fashion product database. Benchmark :point_down:
Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation.
OpenMMLab Pose Estimation Toolbox and Benchmark.
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
Benchmarks of approximate nearest neighbor libraries in Python
Statistics-driven benchmarking library for Rust
OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
Kodezi Chronos is a debugging-first language model that achieves state-of-the-art results on SWE-bench Lite (80.33%) and 67% real-world fix accuracy, over six times better than GPT-4. Built with Adaptive Graph-Guided Retrieval and Persistent Debug Memory. Model available Q1 2026 via Kodezi OS.
A series of large language models developed by Baichuan Intelligent Technology
Visual Tracking Paper List
XcodeBenchmark measures the compilation time of a large codebase on iMac, MacBook, and Mac Pro
Prime number projects in 100+ programming languages, to compare their speed - and their programmer's cleverness
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
A 13B large language model developed by Baichuan Intelligent Technology
A unified evaluation framework for large language models
Java web common vulnerabilities and security code which is base on springboot and spring security
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
VPS Fusion Monster Server Test GO Version Aiming to be the most comprehensive server testing project, implemented in Go with zero environment dependencies. VPS融合怪服务器测评项目 GO版本 尽量成为最全能的服务器测评项目，使用 Go 实现，无需任何环境依赖。
📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
An objective comparison of multiple frameworks that allow us to "transform" our web apps to desktop applications.
benchmarks for implementation of servers which support 1 million connections
Tracking Any Point (TAP)
Efficient Retrieval Augmentation and Generation Framework
Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024
Reference implementations of MLPerf® training benchmarks
Quickly find bottlenecks in Rust - one profiler for CPU, time, memory, and async code.
The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
Reference implementations of MLPerf® inference benchmarks
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
Fast and simple benchmarking for Rust projects
[pip install medmnist] 18x Standardized Datasets for 2D and 3D Biomedical Image Classification
Microbenchmarking app for Swift with nice log-log plots
Open Source Continuous Inference Benchmark Research Platform — Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3
[NeurIPS '25] Knowledge Graph Generation from Any Text
LongBench v2 and LongBench (ACL 25'&24')
OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning
TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models
Model Zoo For OpenCV DNN and Benchmarks.
Monocular Depth Estimation Toolbox based on MMSegmentation.
🔍 The hardest search benchmark in the wild — vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.
BlazeHTTP 是一款简单易用的 WAF 防护效果测试工具。BlazeHTTP stands as a user-friendly WAF protection efficacy evaluation tool.
Measure Amazon S3's performance from any location.
Python suite to construct benchmark machine learning datasets from the MIMIC-III 💊 clinical database.
Windows, macOS and Android storage (HDD, SSD, RAM) speed testing/performance benchmarking app
A benchmark dataset for data-driven weather forecasting
Natural Intelligence is still a pretty good idea.
📊 Benchmark Comparison of Packages with Runtime Validation and TypeScript Support
ClawProBench is a live-first benchmark harness for evaluating LLM agents in the OpenClaw runtime with deterministic grading and repeated-trial reliability.
A dataset of datasets for learning to learn from few examples
S3 benchmarking tool
Yet another implementation of computer language benchmarks game
Easily monitor your ThreeJS performances.
golang HTTP stress testing tool, support single and distributed, http/1, http/2 and http/3.
Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology.
An agent benchmark with tasks in a simulated software company.
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research · 浏览器里运行的安卓模拟器 · Browser-hosted Android Simulator · Verifiable Evaluation · Scalable Online RL Training