#Benchmarking
Showing 60 of 89 repositories tagged #benchmarking, ranked by stars
Write scalable load tests in plain Python 🚗💨
HTTP load testing tool and library. It's over 9000!
A free, powerful, multi-purpose tool that helps you monitor system resources, debug software and detect malware. Brought to you by Winsider Seminars & Solutions, Inc. @ https://windows-internals.com
Fast cross-platform HTTP benchmarking tool written in Go
An adversarial example library for constructing attacks, building defenses, and benchmarking both
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
🦩 Tools for Go projects
Merlion: A Machine Learning Framework for Time Series Intelligence
Generate HTTP load and plot the results in real-time
Collection of popular and reproducible image denoising works.
[PVLDB 2024 Best Paper Nomination] TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methods
Benchmarks of Go serialization methods
A Toolbox for Adversarial Robustness Research
Unsupervised time series anomaly detection library
FuzzBench - Fuzzer benchmarking as a service.
Toolkit to run Python benchmarks
A swift library to benchmark code snippets.
[NeurIPS'21 Outstanding Paper] Library for reliable evaluation on RL and ML benchmarks, even with only a handful of seeds.
ROS 2 LiDAR SLAM for pointcloud-map authoring, benchmarking, and Autoware-compatible map workflows.
LogAI - An open-source library for log analytics and intelligence
Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.
Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to facilitate collaborative and reproducible research and to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks
goben is a golang tool to measure TCP/UDP transport layer throughput between hosts.
A collection of GNN-based fake news detection models.
A library for ML benchmarking. It's powerful.
Structural variant toolkit for VCFs
A PyTorch reinforcement learning library for generalizable and reproducible algorithm implementations with an aim to improve accessibility in RL
Benchmark diffusion models faster. Automate evals, seeds, and metrics for reproducible results.
BLOCKBENCH: A Framework for Analyzing Private Blockchains. Blockbench contains workloads for measuring the data processing performance, and workloads for understanding the performance of different layers of Blockchain systems.
OpenML's Python API for a World of Data and More 💫
vHive: Open-source framework for serverless experimentation
CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.
An Authentic Dataset for Visual-Inertial Odometry
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
Python timeit CLI for the 21st century! colored output, multi-line input with syntax highlighting and autocompletion and much more!
A mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.
A non-sampling profiler purpose built to measure and optimize performance of C++ low latency/real time systems
MLOS is a project to enable autotuning for systems.
Rust libraries and programs focused on succinct data structures
Evaluation Tool for Anomaly Detection Algorithms on Time Series
A micro/macro benchmark framework for the Python programming language that helps with optimizing your software.
HEWN 2.0 2026: AI Output Router for Precision Summaries & Polished Code
A curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.
Benchmark Generator for Smart-Contract Fuzzers
Find the fastest DNS in your location to improve internet browsing experience.
Deep Learning Benchmarking Suite
Statistical analysis methods for comparing prompt and model performance in LLM evaluations.
Deep learning program generator
Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
[ICLR 2026] Beyond a Million Tokens: Benchmarking and Enhancing Long-Term Memory in LLMs
R package to interface with OpenML
Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
Execute and document benchmarks reproducibly.
Enso: An Open Source Library for Benchmarking Embeddings + Transfer Learning Methods
A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.
Perun is a Python package that measures the energy consumption of your applications.
Automated benchmarking of Retrieval-Augmented Generation (RAG) systems
Call and benchmark YARPC services from the command line.