Run your benchmarks locally or in CI using your favorite
benchmarking tools. The bencher CLI simply
wraps your existing benchmark harness and stores its
results.
How It Works
Run your benchmarks
Track your benchmarks
Track the results of your benchmarks over time. Monitor, query, and graph the results using the Bencher web console based on the source branch and testbed.
Catch performance regressions
Catch performance regressions in CI. Bencher uses state of the art, customizable analytics to detect performance regressions before they make it to production.
You are in good company
Track your cargo bench benchmarks
Track the results of your cargo bench benchmarks over time.
Monitor, query, and graph the results using the Bencher web console based on the source branch and testbed.
$ bencher run --adapter rust_bench "cargo +nightly bench"
running 5 tests
test tests::benchmark ... bench: 3,161 ns/iter (+/- 975)
test tests::other_benchmark ... bench: 4,502 ns/iter (+/- 975)
test tests::one_digit ... bench: 1 ΞΌs/iter (+/- 1)
test tests::two_digit ... bench: 22 ms/iter (+/- 22)
test tests::three_digit ... bench: 333 s/iter (+/- 333)
test result: ok. 0 passed; 0 failed; 0 ignored; 5 measured; 0 filtered out; finished in 0.11s
Bencher New Report:
{
"branch": "main",
"end_time": "2024-03-10T20:34:00.981095Z",
"hash": "a7d081e048b77c5d4bfc0fb66f48cbf05cb49464",
"results": [ ... ],
"settings": {},
"start_time": "2024-03-10T20:33:57.722930Z",
"testbed": "localhost"
}Get Performance Insights Directly in Your Workflow
Software performance pull request comments allow you to quickly analyze your PR's performance and risk without leaving your workflow. Fail the build! Keep your codebase fast and your users happy.
Bencher Report
| Branch | 254/merge |
| Testbed | ubuntu-latest |
π¨ 1 ALERT: Threshold Boundary Limit exceeded!
| Benchmark | Measure Units | View | Benchmark Result (Result Ξ%) | Upper Boundary (Limit %) |
|---|---|---|---|---|
| Adapter::Json | Latency nanoseconds (ns) | π plot π¨ alert π· threshold | 3,445.60 (+1.52%) | 3,362.07 (102.48%) |
Click to view all benchmark results
| Benchmark | Latency | Benchmark Results nanoseconds (ns) (Result Ξ%) | Upper Boundary nanoseconds (ns) (Limit %) |
|---|---|---|---|
| Adapter::Json | π view plot π¨ view alert π· view threshold | 3,445.60 (+1.52%) | 3,362.07 (102.48%) |
| Adapter::Magic (JSON) | π view plot π· view threshold | 3,431.40 (+0.69%) | 3,596.95 (95.40%) |
| Adapter::Magic (Rust) | π view plot π· view threshold | 22,095.00 (-0.83%) | 24,732.80 (89.33%) |
| Adapter::Rust | π view plot π· view threshold | 2,305.70 (-2.76%) | 2,500.49 (92.21%) |
| Adapter::RustBench | π view plot π· view threshold | 2,299.90 (-3.11%) | 2,503.41 (91.87%) |
π° View full continuous benchmarking report in Bencher
Hosting
Self-Hosted
Run Bencher on-prem or in your own cloud. Bencher can be deployed on a standalone server, in a Docker container, or as part of a Kubernetes cluster.
Bencher Cloud
It's 2024, who wants to manage yet another serviceβ½ Let us take care of that for you. All of the same great features with none of the hassle.
Share Your Benchmarks
All public projects have their own perf page. These results can easily be shared with an auto-updating perf image. Perfect for your README!
Track your benchmarks in CI
Have you ever had a performance regression impact your users? Bencher could have prevented that from happening with continuous benchmarking.