Benchmarks currently use ordo-one/package-benchmark library for benchmarking.

To run the benchmarks in their default configuration, run this command in the Benchmarks subdirectory of the SwiftPM repository clone (the directory in which this README.md file is contained):

swift package benchmark

To collect all benchmark metrics, set SWIFTPM_BENCHMARK_ALL_METRICS to a truthy value:

SWIFTPM_BENCHMARK_ALL_METRICS=true swift package benchmark

Benchmarks/Thresholds subdirectory contains recorded allocation and syscall counts for macOS on Apple Silicon when built with Swift 5.10. To record new thresholds, run the following command:

swift package --allow-writing-to-package-directory benchmark \
  --format metricP90AbsoluteThresholds \
  --path "Thresholds/$([[ $(uname) == Darwin ]] && echo macos || echo linux)-$(uname -m)"

To verify that recorded thresholds do not exceeded given relative or absolute values (passed as thresholds arguments to each benchmark's configuration), run this command:

swift package benchmark baseline check --check-absolute-path Thresholds/