Current benchmarks problems and their implementations are from The Computer Language Benchmarks Game ( Repo)

Local development

Prerequisites

net9

nodejs 14

pnpm

podman (or docker by changing dockercmd: podman to dockercmd: docker in bench/bench.yaml)

Build

The 1st step is to build source code from various of languages

cd bench
To build a subset
dotnet run --project tool -- --task build --langs lisp go --problems nbody helloworld --force-rebuild
To build all
dotnet run --project tool -- --task build

Test

The 2nd step is to test built binaries to ensure the correctness of their implementation

cd bench
To test a subset
dotnet run --project tool -- --task test --langs lisp go --problems nbody helloworld
To test all
dotnet run --project tool -- --task test

Bench

The 3rd step is to generate benchmarks

cd bench
To bench a subset
dotnet run --project tool -- --task bench --langs lisp go --problems nbody helloworld
To bench all
dotnet run --project tool -- --task bench

For usage

cd bench
dotnet run --project tool -- -h
BenchTool   Main function
Usage:   BenchTool [options]
Options:   --config <config>              Path to benchmark config file [default: bench.yaml]   --algorithm <algorithm>        Root path that contains all algorithm code [default: algorithm]   --include <include>            Root path that contains all include project templates [default: include]   --build-output <build-output>  Output folder of build step [default: build]   --task <task>                  Benchmark task to run, valid values: build, test, bench [default: build]   --force-pull-docker            A flag that indicates whether to force pull docker image even when it exists [default: False]   --force-rebuild                A flag that indicates whether to force rebuild [default: False]   --fail-fast                    A Flag that indicates whether to fail fast when error occurs [default: False]   --build-pool                   A flag that indicates whether builds that can run in parallel [default: False]   --verbose                      A Flag that indicates whether to print verbose information [default: False]   --no-docker                    A Flag that forces disabling docker [default: False]   --langs <langs>                Languages to include, e.g. --langs go csharp [default: ]   --problems <problems>          Problems to include, e.g. --problems binarytrees nbody [default: ]   --environments <environments>  OS environments to include, e.g. --environments linux windows [default: ]   --version                      Show version information   -?, -h, --help                 Show help and usage information

Refresh website

Lastly you can re-generate website with latest benchmark numbers

cd website
pnpm i
pnpm content
pnpm build
serve dist

TODOs

Integrate test environment info into website

Integrate build / test / benchmark information into website

...

How to contribute

TODO

Thanks

This is inspired by The Computer Language Benchmarks Game, thanks to the curator._