Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ci-plutus-benchmark: add git ref info #3458

Merged
merged 1 commit into from
Jun 30, 2021
Merged

ci-plutus-benchmark: add git ref info #3458

merged 1 commit into from
Jun 30, 2021

Conversation

gilligan
Copy link
Contributor

@gilligan gilligan commented Jun 30, 2021 •
edited
Loading

Include git refs for base and PR branches in the comment added to PRs
as response to /benchmark

Pre-submit checklist:

  • Branch
    • Commit sequence broadly makes sense
    • Key commits have useful messages
    • Relevant tickets are mentioned in commit messages
    • Formatting, materialized Nix files, PNG optimization, etc. are updated
  • PR
    • Self-reviewed the diff
    • Useful pull request description
    • Reviewer requested

Pre-merge checklist:

  • Someone approved it
  • Commits have useful messages
  • Review clarifications made it into the code
  • History is moderately tidy; or going to squash-merge

@gilligan
ci-plutus-benchmark: add git ref info
1ecbbe0 
Include git refs for base and PR branches in the comment added to PRs
as response to `/benchmark`
@gilligan
Copy link
Contributor Author

/benchmark

@iohk-devops
Copy link

Comparing benchmark results of 'f37f9cca5662fede7c334dfbf839d836a2926eaa' (base) and 'f37f9cca5662fede7c334dfbf839d836a2926eaa' (PR)

crowdfunding/crowdfunding-success-1 698.2 μs 655.6 μs -6.1%
crowdfunding/crowdfunding-success-2 699.3 μs 656.8 μs -6.1%
crowdfunding/crowdfunding-success-3 699.0 μs 656.3 μs -6.1%
currency/currency-1 629.8 μs 585.2 μs -7.1%
currency/currency-2 812.1 μs 807.3 μs -0.6%
escrow/escrow-redeem_1-1 967.0 μs 967.2 μs +0.0%
escrow/escrow-redeem_1-2 967.1 μs 968.2 μs +0.1%
escrow/escrow-redeem_2-1 1.108 ms 1.113 ms +0.5%
escrow/escrow-redeem_2-2 1.109 ms 1.114 ms +0.5%
escrow/escrow-redeem_2-3 1.106 ms 1.112 ms +0.5%
escrow/escrow-refund-1 479.0 μs 461.2 μs -3.7%
future/future-increase-margin-1 627.6 μs 589.9 μs -6.0%
future/future-increase-margin-2 809.8 μs 804.8 μs -0.6%
future/future-increase-margin-3 1.397 ms 1.395 ms -0.1%
future/future-increase-margin-4 1.401 ms 1.399 ms -0.1%
future/future-increase-margin-5 1.312 ms 1.301 ms -0.8%
future/future-increase-margin-6 1.945 ms 1.804 ms -7.2%
future/future-pay-out-1 632.3 μs 587.1 μs -7.1%
future/future-pay-out-2 815.4 μs 802.1 μs -1.6%
future/future-pay-out-3 1.402 ms 1.392 ms -0.7%
future/future-pay-out-4 1.403 ms 1.392 ms -0.8%
future/future-pay-out-5 1.822 ms 1.804 ms -1.0%
future/future-settle-early-1 630.9 μs 590.1 μs -6.5%
future/future-settle-early-2 809.9 μs 805.9 μs -0.5%
future/future-settle-early-3 1.402 ms 1.402 ms 0.0%
future/future-settle-early-4 1.399 ms 1.400 ms +0.1%
future/future-settle-early-5 1.433 ms 1.434 ms +0.1%
game-sm/game-sm-success-1 999.4 μs 998.5 μs -0.1%
game-sm/game-sm-success-2 535.0 μs 605.7 μs +13.2%
game-sm/game-sm-success-3 1.439 ms 1.455 ms +1.1%
game-sm/game-sm-success-4 746.9 μs 723.1 μs -3.2%
game-sm/game-sm-success_2-1 1.002 ms 995.5 μs -0.6%
game-sm/game-sm-success_2-2 538.0 μs 606.2 μs +12.7%
game-sm/game-sm-success_2-3 1.453 ms 1.454 ms +0.1%
game-sm/game-sm-success_2-4 751.4 μs 719.1 μs -4.3%
game-sm/game-sm-success_2-5 1.472 ms 1.427 ms -3.1%
game-sm/game-sm-success_2-6 752.4 μs 720.0 μs -4.3%
multisig-sm/multisig-sm-01 1.065 ms 1.062 ms -0.3%
multisig-sm/multisig-sm-02 1.075 ms 1.066 ms -0.8%
multisig-sm/multisig-sm-03 1.089 ms 1.089 ms 0.0%
multisig-sm/multisig-sm-04 1.106 ms 1.104 ms -0.2%
multisig-sm/multisig-sm-05 1.306 ms 1.296 ms -0.8%
multisig-sm/multisig-sm-06 1.164 ms 1.068 ms -8.2%
multisig-sm/multisig-sm-07 1.073 ms 1.074 ms +0.1%
multisig-sm/multisig-sm-08 1.089 ms 1.177 ms +8.1%
multisig-sm/multisig-sm-09 1.104 ms 1.103 ms -0.1%
multisig-sm/multisig-sm-10 1.301 ms 1.298 ms -0.2%
ping-pong/ping-pong-1 830.8 μs 804.2 μs -3.2%
ping-pong/ping-pong-2 831.3 μs 803.2 μs -3.4%
ping-pong/ping-pong_2-1 529.0 μs 497.5 μs -6.0%
prism/prism-1 496.9 μs 472.3 μs -5.0%
prism/prism-2 1.093 ms 1.067 ms -2.4%
prism/prism-3 989.8 μs 983.6 μs -0.6%
pubkey/pubkey-1 442.4 μs 416.4 μs -5.9%
stablecoin/stablecoin_1-1 2.109 ms 2.087 ms -1.0%
stablecoin/stablecoin_1-2 636.0 μs 591.7 μs -7.0%
stablecoin/stablecoin_1-3 2.379 ms 2.356 ms -1.0%
stablecoin/stablecoin_1-4 690.4 μs 645.6 μs -6.5%
stablecoin/stablecoin_1-5 2.889 ms 3.008 ms +4.1%
stablecoin/stablecoin_1-6 722.1 μs 830.0 μs +14.9%
stablecoin/stablecoin_2-1 2.100 ms 2.104 ms +0.2%
stablecoin/stablecoin_2-2 634.7 μs 594.4 μs -6.3%
stablecoin/stablecoin_2-3 2.368 ms 2.370 ms +0.1%
stablecoin/stablecoin_2-4 688.6 μs 645.9 μs -6.2%
token-account/token-account-1 594.7 μs 558.9 μs -6.0%
token-account/token-account-2 695.1 μs 655.9 μs -5.6%
token-account/token-account-3 887.1 μs 883.9 μs -0.4%
uniswap/uniswap-1 699.4 μs 651.0 μs -6.9%
uniswap/uniswap-2 1.122 ms 1.103 ms -1.7%
uniswap/uniswap-3 762.0 μs 719.6 μs -5.6%
uniswap/uniswap-4 833.2 μs 820.8 μs -1.5%
uniswap/uniswap-5 3.909 ms 3.875 ms -0.9%
uniswap/uniswap-6 1.129 ms 1.110 ms -1.7%
uniswap/uniswap-7 2.809 ms 2.798 ms -0.4%
uniswap/uniswap-8 1.076 ms 1.052 ms -2.2%
vesting/vesting-1 904.5 μs 895.7 μs -1.0%
marlowe/trustfund/trustfund-1 2.110 ms 2.071 ms -1.8%
marlowe/trustfund/trustfund-2 1.510 ms 1.515 ms +0.3%
marlowe/zerocoupon/zerocoupon-1 2.184 ms 2.186 ms +0.1%
marlowe/zerocoupon/zerocoupon-2 1.309 ms 1.326 ms +1.3%

@gilligan gilligan merged commit 4f2a9e3 into master Jun 30, 2021
@gilligan gilligan deleted the extend-bench-ci-output branch June 30, 2021 12:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@michaelpj michaelpj michaelpj approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@gilligan @iohk-devops @michaelpj