Run your benchmarks locally or in CI using your favorite
benchmarking tools. The bencher CLI simply
wraps your existing benchmark harness and stores its
results.
How It Works
Run your benchmarks
Track your benchmarks
Track the results of your benchmarks over time. Monitor, query, and graph the results using the Bencher web console based on the source branch and testbed.
Catch performance regressions
Catch performance regressions in CI. Bencher uses state of the art, customizable analytics to detect performance regressions before they make it to production.
You are in good company
Track your Iai benchmarks
Track the results of your Iai benchmarks over time. Monitor, query, and graph the results using the Bencher web console based on the source branch and testbed.
$ bencher run --adapter rust_iai "cargo bench"
Running target/release/deps/test_regular_bench-8b173c29ce041afa
bench_fibonacci_short
Instructions: 1735
L1 Accesses: 2364
L2 Accesses: 1
RAM Accesses: 1
Estimated Cycles: 2404
bench_fibonacci_long
Instructions: 26214735
L1 Accesses: 35638623
L2 Accesses: 2
RAM Accesses: 1
Estimated Cycles: 35638668
Bencher New Report:
{
"branch": "main",
"end_time": "2024-03-10T20:34:00.981095Z",
"hash": "a7d081e048b77c5d4bfc0fb66f48cbf05cb49464",
"results": [ ... ],
"settings": {},
"start_time": "2024-03-10T20:33:57.722930Z",
"testbed": "localhost"
}Get Performance Insights Directly in Your Workflow
Software performance pull request comments allow you to quickly analyze your PR's performance and risk without leaving your workflow. Fail the build! Keep your codebase fast and your users happy.
Bencher Report
| Branch | 254/merge |
| Testbed | ubuntu-latest |
π¨ 1 ALERT: Threshold Boundary Limit exceeded!
| Benchmark | Measure Units | View | Benchmark Result (Result Ξ%) | Upper Boundary (Limit %) |
|---|---|---|---|---|
| Adapter::Json | Latency nanoseconds (ns) | π plot π¨ alert π· threshold | 3,445.60 (+1.52%) | 3,362.07 (102.48%) |
Click to view all benchmark results
| Benchmark | Latency | Benchmark Results nanoseconds (ns) (Result Ξ%) | Upper Boundary nanoseconds (ns) (Limit %) |
|---|---|---|---|
| Adapter::Json | π view plot π¨ view alert π· view threshold | 3,445.60 (+1.52%) | 3,362.07 (102.48%) |
| Adapter::Magic (JSON) | π view plot π· view threshold | 3,431.40 (+0.69%) | 3,596.95 (95.40%) |
| Adapter::Magic (Rust) | π view plot π· view threshold | 22,095.00 (-0.83%) | 24,732.80 (89.33%) |
| Adapter::Rust | π view plot π· view threshold | 2,305.70 (-2.76%) | 2,500.49 (92.21%) |
| Adapter::RustBench | π view plot π· view threshold | 2,299.90 (-3.11%) | 2,503.41 (91.87%) |
π° View full continuous benchmarking report in Bencher
Hosting
Self-Hosted
Run Bencher on-prem or in your own cloud. Bencher can be deployed on a standalone server, in a Docker container, or as part of a Kubernetes cluster.
Bencher Cloud
It's 2024, who wants to manage yet another serviceβ½ Let us take care of that for you. All of the same great features with none of the hassle.
Share Your Benchmarks
All public projects have their own perf page. These results can easily be shared with an auto-updating perf image. Perfect for your README!
Track your benchmarks in CI
Have you ever had a performance regression impact your users? Bencher could have prevented that from happening with continuous benchmarking.