Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] pin DMC and mujoco #2374

Merged
merged 6 commits into from
Aug 6, 2024
Merged

[CI] pin DMC and mujoco #2374

merged 6 commits into from
Aug 6, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Aug 6, 2024 •
edited
Loading

Temporarily disable dm_control

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Aug 6, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2374

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 1 Cancelled Job, 8 Unrelated Failures

As of commit 88e150b with merge base 788710f (image):

NEW FAILURES - The following jobs have failed:

CANCELLED JOB - The following job was cancelled. Please retry:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 6, 2024
@vmoens vmoens changed the title [CI] pin mujoco 3.2.0 version [CI] Temporarily disable dm_control Aug 6, 2024
@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Aug 6, 2024
@vmoens vmoens changed the title [CI] Temporarily disable dm_control [CI] pin DMC and mujoco Aug 6, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 6, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}6$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 59.3714ms 58.7854ms 17.0110 Ops/s 16.6021 Ops/s $\color{#35bf28}+2.46\%$
test_sync 33.3036ms 32.1492ms 31.1050 Ops/s 29.0294 Ops/s $\textbf{\color{#35bf28}+7.15\%}$
test_async 59.4958ms 30.5606ms 32.7218 Ops/s 32.5091 Ops/s $\color{#35bf28}+0.65\%$
test_simple 0.4919s 0.4213s 2.3736 Ops/s 2.3941 Ops/s $\color{#d91a1a}-0.86\%$
test_transformed 0.6417s 0.5800s 1.7243 Ops/s 1.7121 Ops/s $\color{#35bf28}+0.71\%$
test_serial 1.3400s 1.2791s 0.7818 Ops/s 0.7997 Ops/s $\color{#d91a1a}-2.24\%$
test_parallel 1.1759s 1.1032s 0.9064 Ops/s 0.9113 Ops/s $\color{#d91a1a}-0.53\%$
test_step_mdp_speed[True-True-True-True-True] 0.2018ms 24.9987μs 40.0020 KOps/s 40.1598 KOps/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[True-True-True-True-False] 66.0440μs 14.4446μs 69.2298 KOps/s 69.7843 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-True-True-False-True] 42.2790μs 14.4282μs 69.3088 KOps/s 70.3413 KOps/s $\color{#d91a1a}-1.47\%$
test_step_mdp_speed[True-True-True-False-False] 46.7170μs 8.2777μs 120.8061 KOps/s 119.3626 KOps/s $\color{#35bf28}+1.21\%$
test_step_mdp_speed[True-True-False-True-True] 55.3940μs 26.7069μs 37.4435 KOps/s 37.6481 KOps/s $\color{#d91a1a}-0.54\%$
test_step_mdp_speed[True-True-False-True-False] 74.5490μs 15.9117μs 62.8469 KOps/s 62.9823 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[True-True-False-False-True] 46.1260μs 15.9448μs 62.7165 KOps/s 63.7298 KOps/s $\color{#d91a1a}-1.59\%$
test_step_mdp_speed[True-True-False-False-False] 59.0000μs 9.8267μs 101.7639 KOps/s 101.9037 KOps/s $\color{#d91a1a}-0.14\%$
test_step_mdp_speed[True-False-True-True-True] 59.1810μs 28.5788μs 34.9910 KOps/s 35.6151 KOps/s $\color{#d91a1a}-1.75\%$
test_step_mdp_speed[True-False-True-True-False] 71.0020μs 17.6619μs 56.6189 KOps/s 56.3058 KOps/s $\color{#35bf28}+0.56\%$
test_step_mdp_speed[True-False-True-False-True] 53.0990μs 15.9458μs 62.7126 KOps/s 63.4997 KOps/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[True-False-True-False-False] 47.3180μs 9.8187μs 101.8460 KOps/s 101.7936 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-False-False-True-True] 84.2680μs 29.8798μs 33.4674 KOps/s 33.4644 KOps/s $+0.01\%$
test_step_mdp_speed[True-False-False-True-False] 54.4620μs 19.0521μs 52.4877 KOps/s 52.7406 KOps/s $\color{#d91a1a}-0.48\%$
test_step_mdp_speed[True-False-False-False-True] 71.8340μs 17.3697μs 57.5714 KOps/s 57.9514 KOps/s $\color{#d91a1a}-0.66\%$
test_step_mdp_speed[True-False-False-False-False] 42.5900μs 11.2996μs 88.4989 KOps/s 88.4814 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[False-True-True-True-True] 85.6800μs 28.2893μs 35.3491 KOps/s 35.3440 KOps/s $\color{#35bf28}+0.01\%$
test_step_mdp_speed[False-True-True-True-False] 69.9510μs 17.6532μs 56.6469 KOps/s 56.9952 KOps/s $\color{#d91a1a}-0.61\%$
test_step_mdp_speed[False-True-True-False-True] 84.4480μs 18.4856μs 54.0960 KOps/s 55.0832 KOps/s $\color{#d91a1a}-1.79\%$
test_step_mdp_speed[False-True-True-False-False] 49.5630μs 11.0121μs 90.8092 KOps/s 90.6747 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[False-True-False-True-True] 69.7510μs 29.8180μs 33.5368 KOps/s 33.7069 KOps/s $\color{#d91a1a}-0.50\%$
test_step_mdp_speed[False-True-False-True-False] 68.9290μs 18.9022μs 52.9038 KOps/s 52.0444 KOps/s $\color{#35bf28}+1.65\%$
test_step_mdp_speed[False-True-False-False-True] 46.5470μs 19.8901μs 50.2762 KOps/s 50.0845 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-True-False-False-False] 63.1180μs 12.4860μs 80.0897 KOps/s 79.1968 KOps/s $\color{#35bf28}+1.13\%$
test_step_mdp_speed[False-False-True-True-True] 3.7363ms 31.4973μs 31.7487 KOps/s 31.3374 KOps/s $\color{#35bf28}+1.31\%$
test_step_mdp_speed[False-False-True-True-False] 52.7890μs 20.6670μs 48.3863 KOps/s 48.1033 KOps/s $\color{#35bf28}+0.59\%$
test_step_mdp_speed[False-False-True-False-True] 70.1910μs 19.7747μs 50.5697 KOps/s 49.8067 KOps/s $\color{#35bf28}+1.53\%$
test_step_mdp_speed[False-False-True-False-False] 42.1490μs 12.4328μs 80.4324 KOps/s 79.4280 KOps/s $\color{#35bf28}+1.26\%$
test_step_mdp_speed[False-False-False-True-True] 0.1175ms 32.3526μs 30.9094 KOps/s 30.7880 KOps/s $\color{#35bf28}+0.39\%$
test_step_mdp_speed[False-False-False-True-False] 88.8460μs 21.8340μs 45.8001 KOps/s 45.2909 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[False-False-False-False-True] 53.3190μs 21.0567μs 47.4908 KOps/s 46.8068 KOps/s $\color{#35bf28}+1.46\%$
test_step_mdp_speed[False-False-False-False-False] 61.1240μs 13.6851μs 73.0723 KOps/s 71.7057 KOps/s $\color{#35bf28}+1.91\%$
test_values[generalized_advantage_estimate-True-True] 9.9673ms 9.4645ms 105.6577 Ops/s 104.6415 Ops/s $\color{#35bf28}+0.97\%$
test_values[vec_generalized_advantage_estimate-True-True] 39.5739ms 35.7272ms 27.9899 Ops/s 28.0492 Ops/s $\color{#d91a1a}-0.21\%$
test_values[td0_return_estimate-False-False] 0.2285ms 0.1675ms 5.9695 KOps/s 5.9257 KOps/s $\color{#35bf28}+0.74\%$
test_values[td1_return_estimate-False-False] 27.3865ms 24.0844ms 41.5206 Ops/s 40.8121 Ops/s $\color{#35bf28}+1.74\%$
test_values[vec_td1_return_estimate-False-False] 37.2074ms 35.6212ms 28.0732 Ops/s 28.0466 Ops/s $\color{#35bf28}+0.09\%$
test_values[td_lambda_return_estimate-True-False] 38.0962ms 34.7701ms 28.7603 Ops/s 28.5706 Ops/s $\color{#35bf28}+0.66\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.9612ms 35.6845ms 28.0234 Ops/s 28.0090 Ops/s $\color{#35bf28}+0.05\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 10.4564ms 8.3367ms 119.9512 Ops/s 121.9060 Ops/s $\color{#d91a1a}-1.60\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3730ms 1.7934ms 557.6067 Ops/s 497.1289 Ops/s $\textbf{\color{#35bf28}+12.17\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4504ms 0.3518ms 2.8424 KOps/s 2.8388 KOps/s $\color{#35bf28}+0.13\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 48.4812ms 47.4331ms 21.0823 Ops/s 22.3641 Ops/s $\textbf{\color{#d91a1a}-5.73\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.9750ms 3.0270ms 330.3549 Ops/s 326.7654 Ops/s $\color{#35bf28}+1.10\%$
test_dqn_speed 6.7895ms 1.3013ms 768.4472 Ops/s 772.0242 Ops/s $\color{#d91a1a}-0.46\%$
test_ddpg_speed 3.2309ms 2.6903ms 371.7096 Ops/s 368.6128 Ops/s $\color{#35bf28}+0.84\%$
test_sac_speed 8.9533ms 7.8862ms 126.8036 Ops/s 125.2472 Ops/s $\color{#35bf28}+1.24\%$
test_redq_speed 13.2775ms 12.5208ms 79.8669 Ops/s 76.7248 Ops/s $\color{#35bf28}+4.10\%$
test_redq_deprec_speed 13.7683ms 12.6219ms 79.2276 Ops/s 76.3568 Ops/s $\color{#35bf28}+3.76\%$
test_td3_speed 8.6056ms 7.8317ms 127.6862 Ops/s 125.5333 Ops/s $\color{#35bf28}+1.71\%$
test_cql_speed 38.3551ms 36.0507ms 27.7387 Ops/s 27.6710 Ops/s $\color{#35bf28}+0.24\%$
test_a2c_speed 8.0450ms 7.3029ms 136.9328 Ops/s 136.4559 Ops/s $\color{#35bf28}+0.35\%$
test_ppo_speed 8.8178ms 7.5973ms 131.6249 Ops/s 130.4762 Ops/s $\color{#35bf28}+0.88\%$
test_reinforce_speed 7.3490ms 6.4872ms 154.1495 Ops/s 154.1239 Ops/s $\color{#35bf28}+0.02\%$
test_iql_speed 32.9500ms 31.7037ms 31.5421 Ops/s 30.9500 Ops/s $\color{#35bf28}+1.91\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.5085ms 4.8354ms 206.8098 Ops/s 207.3935 Ops/s $\color{#d91a1a}-0.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6512ms 0.4791ms 2.0873 KOps/s 2.0786 KOps/s $\color{#35bf28}+0.42\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6304ms 0.4572ms 2.1873 KOps/s 2.0805 KOps/s $\textbf{\color{#35bf28}+5.14\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.1360ms 4.8230ms 207.3388 Ops/s 207.3435 Ops/s $-0.00\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.5804ms 0.4731ms 2.1136 KOps/s 1.8067 KOps/s $\textbf{\color{#35bf28}+16.99\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6702ms 0.4533ms 2.2060 KOps/s 2.1951 KOps/s $\color{#35bf28}+0.49\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.3735ms 1.6819ms 594.5707 Ops/s 594.9551 Ops/s $\color{#d91a1a}-0.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.3873ms 1.5947ms 627.0654 Ops/s 628.1582 Ops/s $\color{#d91a1a}-0.17\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.4203ms 4.9989ms 200.0443 Ops/s 198.1661 Ops/s $\color{#35bf28}+0.95\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9902ms 0.6140ms 1.6287 KOps/s 1.6155 KOps/s $\color{#35bf28}+0.82\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8871ms 0.5874ms 1.7024 KOps/s 1.7071 KOps/s $\color{#d91a1a}-0.27\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.1576ms 4.8498ms 206.1939 Ops/s 203.9609 Ops/s $\color{#35bf28}+1.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.1833ms 0.4800ms 2.0831 KOps/s 2.0813 KOps/s $\color{#35bf28}+0.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6303ms 0.4542ms 2.2017 KOps/s 2.2034 KOps/s $\color{#d91a1a}-0.08\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.3671ms 4.8171ms 207.5917 Ops/s 206.0776 Ops/s $\color{#35bf28}+0.73\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6485ms 0.4750ms 2.1052 KOps/s 2.0838 KOps/s $\color{#35bf28}+1.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 7.4356ms 0.4564ms 2.1912 KOps/s 2.2185 KOps/s $\color{#d91a1a}-1.23\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.3156ms 4.9517ms 201.9498 Ops/s 198.2443 Ops/s $\color{#35bf28}+1.87\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0113ms 0.6113ms 1.6357 KOps/s 1.6045 KOps/s $\color{#35bf28}+1.95\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9829ms 0.5914ms 1.6910 KOps/s 1.6992 KOps/s $\color{#d91a1a}-0.48\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1175s 8.0773ms 123.8036 Ops/s 159.5742 Ops/s $\textbf{\color{#d91a1a}-22.42\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.3508ms 12.9690ms 77.1070 Ops/s 77.9198 Ops/s $\color{#d91a1a}-1.04\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.8448ms 1.1432ms 874.7276 Ops/s 863.2042 Ops/s $\color{#35bf28}+1.33\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1119s 5.8646ms 170.5155 Ops/s 161.0580 Ops/s $\textbf{\color{#35bf28}+5.87\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.1321ms 12.9661ms 77.1243 Ops/s 68.3955 Ops/s $\textbf{\color{#35bf28}+12.76\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.8646ms 1.1433ms 874.6814 Ops/s 868.6953 Ops/s $\color{#35bf28}+0.69\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1110s 8.1224ms 123.1161 Ops/s 119.8463 Ops/s $\color{#35bf28}+2.73\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.9688ms 13.1839ms 75.8500 Ops/s 76.5606 Ops/s $\color{#d91a1a}-0.93\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.1542ms 1.3390ms 746.8499 Ops/s 798.5983 Ops/s $\textbf{\color{#d91a1a}-6.48\%}$

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 6, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1064s 0.1061s 9.4218 Ops/s 9.0787 Ops/s $\color{#35bf28}+3.78\%$
test_sync 95.8789ms 92.6730ms 10.7906 Ops/s 10.6481 Ops/s $\color{#35bf28}+1.34\%$
test_async 0.1787s 87.7472ms 11.3964 Ops/s 11.7317 Ops/s $\color{#d91a1a}-2.86\%$
test_single_pixels 0.1177s 0.1168s 8.5652 Ops/s 8.5955 Ops/s $\color{#d91a1a}-0.35\%$
test_sync_pixels 77.1296ms 76.4231ms 13.0850 Ops/s 12.7481 Ops/s $\color{#35bf28}+2.64\%$
test_async_pixels 0.1443s 71.6459ms 13.9575 Ops/s 14.1018 Ops/s $\color{#d91a1a}-1.02\%$
test_simple 0.7589s 0.7580s 1.3192 Ops/s 1.2735 Ops/s $\color{#35bf28}+3.59\%$
test_transformed 1.0845s 1.0163s 0.9840 Ops/s 0.9996 Ops/s $\color{#d91a1a}-1.56\%$
test_serial 2.2771s 2.1883s 0.4570 Ops/s 0.4496 Ops/s $\color{#35bf28}+1.65\%$
test_parallel 1.9340s 1.8853s 0.5304 Ops/s 0.5311 Ops/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[True-True-True-True-True] 89.5310μs 38.7785μs 25.7875 KOps/s 26.0993 KOps/s $\color{#d91a1a}-1.19\%$
test_step_mdp_speed[True-True-True-True-False] 39.3300μs 21.5469μs 46.4103 KOps/s 47.4359 KOps/s $\color{#d91a1a}-2.16\%$
test_step_mdp_speed[True-True-True-False-True] 45.4900μs 21.5226μs 46.4628 KOps/s 47.0000 KOps/s $\color{#d91a1a}-1.14\%$
test_step_mdp_speed[True-True-True-False-False] 29.6500μs 12.1208μs 82.5028 KOps/s 83.2604 KOps/s $\color{#d91a1a}-0.91\%$
test_step_mdp_speed[True-True-False-True-True] 0.1190ms 40.7678μs 24.5292 KOps/s 24.9939 KOps/s $\color{#d91a1a}-1.86\%$
test_step_mdp_speed[True-True-False-True-False] 49.6700μs 23.5642μs 42.4373 KOps/s 43.0409 KOps/s $\color{#d91a1a}-1.40\%$
test_step_mdp_speed[True-True-False-False-True] 41.3310μs 23.5857μs 42.3985 KOps/s 42.2399 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[True-True-False-False-False] 38.4710μs 14.4524μs 69.1928 KOps/s 69.5999 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[True-False-True-True-True] 69.7810μs 42.5423μs 23.5060 KOps/s 23.8297 KOps/s $\color{#d91a1a}-1.36\%$
test_step_mdp_speed[True-False-True-True-False] 98.3210μs 25.8130μs 38.7401 KOps/s 39.0892 KOps/s $\color{#d91a1a}-0.89\%$
test_step_mdp_speed[True-False-True-False-True] 42.5500μs 23.5698μs 42.4272 KOps/s 43.2600 KOps/s $\color{#d91a1a}-1.93\%$
test_step_mdp_speed[True-False-True-False-False] 65.1820μs 14.3322μs 69.7730 KOps/s 70.0165 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[True-False-False-True-True] 63.2410μs 45.0499μs 22.1976 KOps/s 22.6705 KOps/s $\color{#d91a1a}-2.09\%$
test_step_mdp_speed[True-False-False-True-False] 51.6010μs 28.1221μs 35.5593 KOps/s 36.1446 KOps/s $\color{#d91a1a}-1.62\%$
test_step_mdp_speed[True-False-False-False-True] 49.9310μs 25.2483μs 39.6066 KOps/s 39.2840 KOps/s $\color{#35bf28}+0.82\%$
test_step_mdp_speed[True-False-False-False-False] 0.1352ms 16.5294μs 60.4983 KOps/s 61.0915 KOps/s $\color{#d91a1a}-0.97\%$
test_step_mdp_speed[False-True-True-True-True] 0.1812ms 43.0693μs 23.2184 KOps/s 23.6062 KOps/s $\color{#d91a1a}-1.64\%$
test_step_mdp_speed[False-True-True-True-False] 42.4200μs 25.9086μs 38.5972 KOps/s 38.4190 KOps/s $\color{#35bf28}+0.46\%$
test_step_mdp_speed[False-True-True-False-True] 53.3100μs 27.8576μs 35.8969 KOps/s 35.4827 KOps/s $\color{#35bf28}+1.17\%$
test_step_mdp_speed[False-True-True-False-False] 30.6810μs 16.3047μs 61.3318 KOps/s 61.6767 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-True-False-True-True] 64.4100μs 45.0169μs 22.2139 KOps/s 22.6605 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-True-False-True-False] 44.5810μs 28.1912μs 35.4721 KOps/s 35.6346 KOps/s $\color{#d91a1a}-0.46\%$
test_step_mdp_speed[False-True-False-False-True] 46.9610μs 30.1940μs 33.1191 KOps/s 32.7384 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-True-False-False-False] 42.4500μs 18.5240μs 53.9840 KOps/s 54.4078 KOps/s $\color{#d91a1a}-0.78\%$
test_step_mdp_speed[False-False-True-True-True] 4.0874ms 47.8060μs 20.9179 KOps/s 21.0447 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[False-False-True-True-False] 48.5310μs 30.6244μs 32.6537 KOps/s 32.8592 KOps/s $\color{#d91a1a}-0.63\%$
test_step_mdp_speed[False-False-True-False-True] 48.0910μs 30.3532μs 32.9455 KOps/s 32.4416 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-False-True-False-False] 34.0200μs 18.5307μs 53.9646 KOps/s 54.1141 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[False-False-False-True-True] 0.1254ms 49.4004μs 20.2428 KOps/s 20.4891 KOps/s $\color{#d91a1a}-1.20\%$
test_step_mdp_speed[False-False-False-True-False] 61.1100μs 32.5203μs 30.7501 KOps/s 30.5734 KOps/s $\color{#35bf28}+0.58\%$
test_step_mdp_speed[False-False-False-False-True] 0.1384ms 32.6212μs 30.6549 KOps/s 31.3662 KOps/s $\color{#d91a1a}-2.27\%$
test_step_mdp_speed[False-False-False-False-False] 59.7200μs 20.7841μs 48.1138 KOps/s 49.2009 KOps/s $\color{#d91a1a}-2.21\%$
test_values[generalized_advantage_estimate-True-True] 26.3966ms 25.0202ms 39.9676 Ops/s 41.6158 Ops/s $\color{#d91a1a}-3.96\%$
test_values[vec_generalized_advantage_estimate-True-True] 95.7418ms 2.8147ms 355.2828 Ops/s 353.7519 Ops/s $\color{#35bf28}+0.43\%$
test_values[td0_return_estimate-False-False] 89.3410μs 65.9619μs 15.1603 KOps/s 15.1187 KOps/s $\color{#35bf28}+0.27\%$
test_values[td1_return_estimate-False-False] 54.5903ms 54.2740ms 18.4250 Ops/s 18.4464 Ops/s $\color{#d91a1a}-0.12\%$
test_values[vec_td1_return_estimate-False-False] 1.2838ms 1.0866ms 920.3023 Ops/s 914.7284 Ops/s $\color{#35bf28}+0.61\%$
test_values[td_lambda_return_estimate-True-False] 87.0339ms 86.2663ms 11.5920 Ops/s 11.5779 Ops/s $\color{#35bf28}+0.12\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.2752ms 1.0771ms 928.3861 Ops/s 911.9619 Ops/s $\color{#35bf28}+1.80\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.5088ms 24.0840ms 41.5213 Ops/s 40.5626 Ops/s $\color{#35bf28}+2.36\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9721ms 0.7245ms 1.3803 KOps/s 1.3790 KOps/s $\color{#35bf28}+0.10\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8080ms 0.6718ms 1.4885 KOps/s 1.4753 KOps/s $\color{#35bf28}+0.89\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.6340ms 1.4698ms 680.3790 Ops/s 678.4410 Ops/s $\color{#35bf28}+0.29\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.8217ms 0.6829ms 1.4643 KOps/s 1.4494 KOps/s $\color{#35bf28}+1.03\%$
test_dqn_speed 7.5051ms 1.3790ms 725.1749 Ops/s 735.2243 Ops/s $\color{#d91a1a}-1.37\%$
test_ddpg_speed 3.0228ms 2.7804ms 359.6622 Ops/s 371.7500 Ops/s $\color{#d91a1a}-3.25\%$
test_sac_speed 8.2764ms 7.9955ms 125.0706 Ops/s 126.1599 Ops/s $\color{#d91a1a}-0.86\%$
test_redq_speed 12.3049ms 10.2520ms 97.5420 Ops/s 97.1138 Ops/s $\color{#35bf28}+0.44\%$
test_redq_deprec_speed 11.3553ms 10.9291ms 91.4990 Ops/s 88.5428 Ops/s $\color{#35bf28}+3.34\%$
test_td3_speed 8.1671ms 7.9370ms 125.9917 Ops/s 127.3653 Ops/s $\color{#d91a1a}-1.08\%$
test_cql_speed 26.5661ms 25.7136ms 38.8899 Ops/s 40.5020 Ops/s $\color{#d91a1a}-3.98\%$
test_a2c_speed 7.8445ms 5.6287ms 177.6610 Ops/s 188.9236 Ops/s $\textbf{\color{#d91a1a}-5.96\%}$
test_ppo_speed 6.2224ms 5.9791ms 167.2506 Ops/s 181.4292 Ops/s $\textbf{\color{#d91a1a}-7.81\%}$
test_reinforce_speed 4.7803ms 4.4900ms 222.7167 Ops/s 237.5667 Ops/s $\textbf{\color{#d91a1a}-6.25\%}$
test_iql_speed 20.2224ms 19.7090ms 50.7382 Ops/s 52.7317 Ops/s $\color{#d91a1a}-3.78\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.9056ms 6.6841ms 149.6096 Ops/s 150.3283 Ops/s $\color{#d91a1a}-0.48\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.6722ms 0.5175ms 1.9324 KOps/s 1.9176 KOps/s $\color{#35bf28}+0.78\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7196ms 0.4971ms 2.0117 KOps/s 2.0120 KOps/s $\color{#d91a1a}-0.01\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9200ms 6.5810ms 151.9536 Ops/s 152.2572 Ops/s $\color{#d91a1a}-0.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0516ms 0.5129ms 1.9496 KOps/s 1.9636 KOps/s $\color{#d91a1a}-0.71\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7046ms 0.4903ms 2.0396 KOps/s 2.0474 KOps/s $\color{#d91a1a}-0.38\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.1936ms 1.9905ms 502.3794 Ops/s 510.8938 Ops/s $\color{#d91a1a}-1.67\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.0150ms 1.8749ms 533.3502 Ops/s 532.6153 Ops/s $\color{#35bf28}+0.14\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.0196ms 6.8039ms 146.9747 Ops/s 147.6967 Ops/s $\color{#d91a1a}-0.49\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8880ms 0.6682ms 1.4965 KOps/s 1.5086 KOps/s $\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8498ms 0.6458ms 1.5484 KOps/s 1.5654 KOps/s $\color{#d91a1a}-1.09\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 9.0828ms 6.8799ms 145.3510 Ops/s 150.7179 Ops/s $\color{#d91a1a}-3.56\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8683ms 0.5171ms 1.9339 KOps/s 1.9417 KOps/s $\color{#d91a1a}-0.41\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7095ms 0.4958ms 2.0169 KOps/s 2.0257 KOps/s $\color{#d91a1a}-0.43\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.9780ms 6.6276ms 150.8848 Ops/s 151.1130 Ops/s $\color{#d91a1a}-0.15\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1315s 0.6988ms 1.4311 KOps/s 1.9557 KOps/s $\textbf{\color{#d91a1a}-26.82\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6784ms 0.4957ms 2.0172 KOps/s 2.0477 KOps/s $\color{#d91a1a}-1.49\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.0813ms 6.8868ms 145.2043 Ops/s 147.1221 Ops/s $\color{#d91a1a}-1.30\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.1908ms 0.6721ms 1.4879 KOps/s 1.5093 KOps/s $\color{#d91a1a}-1.42\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8217ms 0.6484ms 1.5422 KOps/s 1.5563 KOps/s $\color{#d91a1a}-0.91\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1318s 7.6954ms 129.9474 Ops/s 97.0461 Ops/s $\textbf{\color{#35bf28}+33.90\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.8199ms 16.2722ms 61.4546 Ops/s 61.0451 Ops/s $\color{#35bf28}+0.67\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1762ms 1.2105ms 826.1021 Ops/s 830.9386 Ops/s $\color{#d91a1a}-0.58\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1303s 10.1231ms 98.7841 Ops/s 130.2464 Ops/s $\textbf{\color{#d91a1a}-24.16\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.5111ms 16.2006ms 61.7261 Ops/s 60.8911 Ops/s $\color{#35bf28}+1.37\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.1480ms 1.3346ms 749.2764 Ops/s 845.8472 Ops/s $\textbf{\color{#d91a1a}-11.42\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1290s 7.8864ms 126.8008 Ops/s 127.6668 Ops/s $\color{#d91a1a}-0.68\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.9410ms 16.4912ms 60.6386 Ops/s 60.7882 Ops/s $\color{#d91a1a}-0.25\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.3780ms 1.3098ms 763.4700 Ops/s 673.5357 Ops/s $\textbf{\color{#35bf28}+13.35\%}$

@vmoens vmoens merged commit afe8596 into main Aug 6, 2024
60 of 68 checks passed
@vmoens vmoens deleted the pin-mujoco branch August 6, 2024 22:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot