Prior Art


Benchmark Tracking Tools

  • General

  • Benchmark Harness Specific

    • airspeed-velocity/asv - Airspeed Velocity: A simple Python benchmarking tool with web-based reporting
    • bamlab/flashlight - Flashlight is a Lighthouse-like tool for mobile apps. No installation required.
    • benchhub/benchhub - A service for running database benchmarks and saving the result
    • bheisler/criterion.rs - Statistics-driven benchmarking library for Rust
    • bobheadxi/gobenchdata - Run Go benchmarks, publish results to an interactive web app, and check for performance regressions in your pull requests
    • callstack/reassure - Performance testing companion for React and React Native
    • codingberg/benchgraph - Visualization of Golang benchmark output using Google charts
    • CodSpeed - CodSpeed provides integrated CI tools for software engineering teams to anticipate the impacts of the next delivery on system performance.
    • Cybench - Continuous performance regression testing for Java CI/CD pipelines
    • dandavison/chronologer - Visualize performance benchmarks over git commit history
    • distributed-system-analysis/pbench - A benchmarking and performance analysis framework
    • icebob/bench-bot - Benchmark runner robot. Continuous benchmarking for benchmarkify the benchmark framework for NodeJS
    • jsperf/jsperf.com - jsPerf aims to provide an easy way to create and share test cases, comparing the performance of different JavaScript snippets by running benchmarks.
    • knqyf263/cob - Continuous Benchmark for Go Project
    • moditect/jfrunit - A JUnit extension for asserting JDK Flight Recorder events
    • NimbleDroid - Functional Performance Testing for Android & iOS
    • novadiscovery/benchgraph - A lightewight tool for visualizing your benchmarks history
    • OctoPerf - Simplify your load testing experience
    • ocurrent/current-bench - Experimental continuous benchmarking infrastructure using OCurrent pipelines
    • OpenBenchmarking.org - Storage of Phoronix Test Suite benchmark result data (including optional system logs, etc)
    • OpenEBench - OpenEBench is the ELIXIR gateway to benchmarking communities, software monitoring, and quality metrics for life sciences tools and workflows.
    • Orijtech bencher - Continuous benchmarking for the Go programming language
    • Perfbench - Perfbench is an interactive online C++ code profiling tool.
    • python/codespeed - A fork of Codespeed that includes the instances run at https://speed.python.org/ and https://speed.pypy.org
    • tobami/codespeed - A web application to monitor and analyze the performance of your code
    • trytouca/trytouca - Continuous Regression Testing for Engineering Teams
    • Unity-Technologies/PerformanceBenchmarkReporter - Establish benchmark samples and measurements using the Performance Testing package, then use these benchmark values to compare subsequent performance test results in an html output utilizing graphical visualizations
  • Web Specific

    • Contentsquare - Speed Analysis is not only about Synthetic Monitoring but also offers powerful Real User Monitoring capabilities, a great fit for brands leading the way on customer experience across the world.
    • Iron/Out - Faster websites equals better business results: improve user experience, increase conversion rate and page experience ranking, lower the bounce rate
    • MeasureWorks - Track user behavior with End-2-End observability to continuously optimize your online performance
    • SpeedCurve - See how people experience the speed of your website, then identify and fix performance issues
    • ubenchan/frontend - Beautiful browser benchmarks
    • WebPageTest - Run a free website speed test from around the globe using real browsers at consumer connection speeds with detailed optimization recommendations
  • Project Specific

🐰 A special thank you to Continuous Benchmark! Some of their test files are used for our Benchmark Harness Adapters.

Benchmark Tracking Posts

Benchmark Comparisons

  • CH-benCHmark - Operational and real-time Business Intelligence (BI) mixed workload SQL benchmarks
  • denosaurs/bench - Comparing deno & node HTTP frameworks
  • HewlettPackard/netperf - Netperf is a benchmark that can be used to measure the performance of many different types of networking. It provides tests for both unidirectional throughput, and end-to-end latency
  • krausest/js-framework-benchmark - A comparison of the performance of a few popular javascript frameworks
  • PerfKit Benchmarker (PKB) - A set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see.
  • Programming Language Benchmarks - Yet another implementation of computer language benchmarks game
  • rebar - A biased barometer for gauging the relative speed of some regex engines on a curated set of tasks.
  • Standard Performance Evaluation Corporation (SPEC) - A non-profit consortium that establishes and maintains standardized benchmarks and performance evalutation tools for new generations of computing systems
  • TechEmpower/FrameworkBenchmarks - In the following tests, we have measured the performance of several web application platforms, full-stack frameworks, and micro-frameworks (collectively, “frameworks”).
  • The Computer Language Benchmarks Game - Which programming language is fastest?
  • Top500

Benchmark Harnesses



Published: Sat, August 12, 2023 at 4:07:00 PM UTC | Last Updated: Mon, April 8, 2024 at 10:46:00 PM UTC