Bencher is a suite of continuous benchmarking tools designed to catch performance regressions in CI. That is, Bencher allows you to detect and prevent performance regressions before they make it to production.

Bencher consists of:

• bencher CLI
• Bencher API Server
• Bencher Web UI

The best place to start is the Bencher Quick Start tutorial.

Though Bencher is open source, there is also a hosted version available Bencher Cloud.

• Tutorial
  • Quick Start
• How To
  • Install CLI
  • Track Benchmarks
  • GitHub Actions
  • GitLab CI/CD
• Explanation
  • Benchmarking Overview
  • Benchmark Adapters
  • Branch Selection
  • Thresholds & Alerts
  • Continuous Benchmarking
  • Talks
• Reference
  • REST API
  • Server Config
  • Prior Art
  • Roadmap
  • Changelog

• {...} JSON
  • Custom benchmark harness support
• #️⃣ C#
  • BenchmarkDotNet
• ➕ C++
  • Catch2
  • Google Benchmark
• 🕳 Go
  • go test -bench
• ☕️ Java
  • Java Microbenchmark Harness (JMH)
• 🕸 JavaScript
  • Benchmark.js
  • console.time/console.timeEnd
• 🐍 Python
  • airspeed velocity
  • pytest-benchmark
• ♦️ Ruby
  • Benchmark
• 🦀 Rust
  • libtest bench
  • Criterion

For more details see the explanation of benchmark harness adapters.

All public projects have their own perf page. These results can easily be shared with an auto-updating perf image. Perfect for your README!

The easiest way to contribute is to open the repo in GitPod. Everything you need will already be there! It is best to connect to the GitPod instance with VS Code Desktop via SSH. There is a hotkey set to tapping caps lock twice to prompt the web VS Code to create a VS Code Desktop SSH session. For more details see the GitPod docs here. Once set up, both the UI and API should be built, running, and seeded at localhost:3000 and localhost:61016 respectively.

All content that resides under any directory or feature named "plus" is licensed under the Bencher Plus License.

All other content is license under either of Apache License, Version 2.0 or MIT license at your discretion.

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in Bencher by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.