Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] Allow any torch version for local builds #2130

Merged
merged 1 commit into from
Apr 29, 2024
Merged

[Versioning] Allow any torch version for local builds #2130

merged 1 commit into from
Apr 29, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 29, 2024 •
edited
Loading

Closing #2124

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 29, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2130

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 3 Unrelated Failures

As of commit 78ce8b5 with merge base 583e2a1 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 29, 2024
@vmoens vmoens added the versioning Versioning change (version number etc) label Apr 29, 2024
@vmoens vmoens merged commit 3c6b9c6 into main Apr 29, 2024
39 of 47 checks passed
@vmoens vmoens deleted the allow-any-torch branch April 29, 2024 07:50
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 54.3557ms 53.6624ms 18.6350 Ops/s 18.6051 Ops/s $\color{#35bf28}+0.16\%$
test_sync 45.0630ms 30.6488ms 32.6277 Ops/s 33.1271 Ops/s $\color{#d91a1a}-1.51\%$
test_async 56.5133ms 29.0026ms 34.4797 Ops/s 35.3645 Ops/s $\color{#d91a1a}-2.50\%$
test_simple 0.4120s 0.3527s 2.8356 Ops/s 2.9866 Ops/s $\textbf{\color{#d91a1a}-5.05\%}$
test_transformed 0.5551s 0.4939s 2.0248 Ops/s 2.0848 Ops/s $\color{#d91a1a}-2.88\%$
test_serial 1.2331s 1.1894s 0.8408 Ops/s 0.8323 Ops/s $\color{#35bf28}+1.02\%$
test_parallel 1.0664s 1.0193s 0.9811 Ops/s 0.9931 Ops/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-True-True-True-True] 0.1179ms 21.3949μs 46.7400 KOps/s 46.5762 KOps/s $\color{#35bf28}+0.35\%$
test_step_mdp_speed[True-True-True-True-False] 57.5420μs 13.0365μs 76.7075 KOps/s 76.3429 KOps/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[True-True-True-False-True] 56.4260μs 12.6490μs 79.0578 KOps/s 79.4617 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[True-True-True-False-False] 25.5880μs 7.7565μs 128.9240 KOps/s 129.8728 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[True-True-False-True-True] 70.6430μs 23.0044μs 43.4700 KOps/s 43.1745 KOps/s $\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-True-False-True-False] 57.3370μs 14.3684μs 69.5973 KOps/s 69.0267 KOps/s $\color{#35bf28}+0.83\%$
test_step_mdp_speed[True-True-False-False-True] 56.0650μs 13.9614μs 71.6261 KOps/s 70.9595 KOps/s $\color{#35bf28}+0.94\%$
test_step_mdp_speed[True-True-False-False-False] 26.6800μs 9.0037μs 111.0651 KOps/s 110.2783 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-False-True-True-True] 75.9120μs 24.8774μs 40.1971 KOps/s 41.0623 KOps/s $\color{#d91a1a}-2.11\%$
test_step_mdp_speed[True-False-True-True-False] 41.1570μs 15.7842μs 63.3544 KOps/s 62.4070 KOps/s $\color{#35bf28}+1.52\%$
test_step_mdp_speed[True-False-True-False-True] 36.7000μs 14.0960μs 70.9420 KOps/s 71.3948 KOps/s $\color{#d91a1a}-0.63\%$
test_step_mdp_speed[True-False-True-False-False] 43.7020μs 9.0210μs 110.8530 KOps/s 111.0170 KOps/s $\color{#d91a1a}-0.15\%$
test_step_mdp_speed[True-False-False-True-True] 81.2620μs 25.6603μs 38.9707 KOps/s 38.9162 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-False-False-True-False] 70.6630μs 16.8990μs 59.1751 KOps/s 58.3961 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[True-False-False-False-True] 43.8820μs 15.1393μs 66.0535 KOps/s 65.5757 KOps/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-False-False-False-False] 59.4610μs 10.0545μs 99.4581 KOps/s 97.7195 KOps/s $\color{#35bf28}+1.78\%$
test_step_mdp_speed[False-True-True-True-True] 50.4540μs 24.4025μs 40.9794 KOps/s 40.7538 KOps/s $\color{#35bf28}+0.55\%$
test_step_mdp_speed[False-True-True-True-False] 67.8680μs 15.9178μs 62.8228 KOps/s 62.6414 KOps/s $\color{#35bf28}+0.29\%$
test_step_mdp_speed[False-True-True-False-True] 43.5920μs 16.2043μs 61.7119 KOps/s 61.4103 KOps/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[False-True-True-False-False] 34.2540μs 10.1253μs 98.7622 KOps/s 97.4476 KOps/s $\color{#35bf28}+1.35\%$
test_step_mdp_speed[False-True-False-True-True] 87.9250μs 25.4469μs 39.2975 KOps/s 38.8908 KOps/s $\color{#35bf28}+1.05\%$
test_step_mdp_speed[False-True-False-True-False] 43.4510μs 16.7235μs 59.7960 KOps/s 58.4391 KOps/s $\color{#35bf28}+2.32\%$
test_step_mdp_speed[False-True-False-False-True] 62.1000μs 17.2179μs 58.0789 KOps/s 57.0817 KOps/s $\color{#35bf28}+1.75\%$
test_step_mdp_speed[False-True-False-False-False] 36.9990μs 11.1057μs 90.0437 KOps/s 86.7851 KOps/s $\color{#35bf28}+3.75\%$
test_step_mdp_speed[False-False-True-True-True] 77.9060μs 26.6894μs 37.4681 KOps/s 36.7806 KOps/s $\color{#35bf28}+1.87\%$
test_step_mdp_speed[False-False-True-True-False] 67.8770μs 18.0429μs 55.4235 KOps/s 53.1750 KOps/s $\color{#35bf28}+4.23\%$
test_step_mdp_speed[False-False-True-False-True] 61.6360μs 17.2132μs 58.0951 KOps/s 56.9231 KOps/s $\color{#35bf28}+2.06\%$
test_step_mdp_speed[False-False-True-False-False] 49.7930μs 11.2474μs 88.9092 KOps/s 86.7167 KOps/s $\color{#35bf28}+2.53\%$
test_step_mdp_speed[False-False-False-True-True] 45.5450μs 28.2139μs 35.4435 KOps/s 35.2453 KOps/s $\color{#35bf28}+0.56\%$
test_step_mdp_speed[False-False-False-True-False] 44.4140μs 19.2648μs 51.9082 KOps/s 51.3122 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-False-False-False-True] 73.5780μs 18.6025μs 53.7563 KOps/s 54.2328 KOps/s $\color{#d91a1a}-0.88\%$
test_step_mdp_speed[False-False-False-False-False] 34.5250μs 12.4816μs 80.1180 KOps/s 79.7928 KOps/s $\color{#35bf28}+0.41\%$
test_values[generalized_advantage_estimate-True-True] 12.1402ms 9.4423ms 105.9066 Ops/s 106.3332 Ops/s $\color{#d91a1a}-0.40\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.6333ms 35.2005ms 28.4087 Ops/s 27.9229 Ops/s $\color{#35bf28}+1.74\%$
test_values[td0_return_estimate-False-False] 0.2238ms 0.1880ms 5.3189 KOps/s 6.0667 KOps/s $\textbf{\color{#d91a1a}-12.33\%}$
test_values[td1_return_estimate-False-False] 26.2672ms 23.9041ms 41.8339 Ops/s 42.8175 Ops/s $\color{#d91a1a}-2.30\%$
test_values[vec_td1_return_estimate-False-False] 38.3816ms 35.7121ms 28.0017 Ops/s 28.0390 Ops/s $\color{#d91a1a}-0.13\%$
test_values[td_lambda_return_estimate-True-False] 33.9916ms 33.6036ms 29.7587 Ops/s 29.6881 Ops/s $\color{#35bf28}+0.24\%$
test_values[vec_td_lambda_return_estimate-True-False] 38.0034ms 35.4853ms 28.1807 Ops/s 27.1410 Ops/s $\color{#35bf28}+3.83\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.1629ms 8.0663ms 123.9724 Ops/s 121.2065 Ops/s $\color{#35bf28}+2.28\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.2418ms 1.9323ms 517.5160 Ops/s 495.9757 Ops/s $\color{#35bf28}+4.34\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4481ms 0.3442ms 2.9051 KOps/s 2.7823 KOps/s $\color{#35bf28}+4.41\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.5362ms 45.8127ms 21.8280 Ops/s 21.6506 Ops/s $\color{#35bf28}+0.82\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.7202ms 3.0214ms 330.9748 Ops/s 323.3152 Ops/s $\color{#35bf28}+2.37\%$
test_dqn_speed 1.7790ms 1.3460ms 742.9183 Ops/s 732.4434 Ops/s $\color{#35bf28}+1.43\%$
test_ddpg_speed 3.0650ms 2.8235ms 354.1733 Ops/s 344.0032 Ops/s $\color{#35bf28}+2.96\%$
test_sac_speed 10.1163ms 8.3866ms 119.2373 Ops/s 114.3791 Ops/s $\color{#35bf28}+4.25\%$
test_redq_speed 14.9129ms 13.0180ms 76.8164 Ops/s 74.6323 Ops/s $\color{#35bf28}+2.93\%$
test_redq_deprec_speed 15.1434ms 13.4836ms 74.1640 Ops/s 71.6250 Ops/s $\color{#35bf28}+3.54\%$
test_td3_speed 15.9621ms 8.3914ms 119.1691 Ops/s 115.9982 Ops/s $\color{#35bf28}+2.73\%$
test_cql_speed 39.0015ms 36.8610ms 27.1289 Ops/s 27.3420 Ops/s $\color{#d91a1a}-0.78\%$
test_a2c_speed 8.7362ms 7.6556ms 130.6241 Ops/s 130.4296 Ops/s $\color{#35bf28}+0.15\%$
test_ppo_speed 8.6569ms 7.8970ms 126.6298 Ops/s 129.0607 Ops/s $\color{#d91a1a}-1.88\%$
test_reinforce_speed 7.4082ms 6.6654ms 150.0296 Ops/s 147.8895 Ops/s $\color{#35bf28}+1.45\%$
test_iql_speed 34.5059ms 32.8004ms 30.4875 Ops/s 29.7204 Ops/s $\color{#35bf28}+2.58\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.2963ms 2.2620ms 442.0866 Ops/s 447.1735 Ops/s $\color{#d91a1a}-1.14\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5926ms 0.4959ms 2.0166 KOps/s 1.9582 KOps/s $\color{#35bf28}+2.99\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6735ms 0.4768ms 2.0973 KOps/s 2.0713 KOps/s $\color{#35bf28}+1.26\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.4988ms 2.2245ms 449.5492 Ops/s 450.8075 Ops/s $\color{#d91a1a}-0.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6914ms 0.4922ms 2.0317 KOps/s 2.0261 KOps/s $\color{#35bf28}+0.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.3556ms 0.4758ms 2.1015 KOps/s 2.1270 KOps/s $\color{#d91a1a}-1.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8798ms 1.2158ms 822.5265 Ops/s 814.7757 Ops/s $\color{#35bf28}+0.95\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6169ms 1.1514ms 868.5288 Ops/s 850.0863 Ops/s $\color{#35bf28}+2.17\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.7219ms 2.3328ms 428.6764 Ops/s 399.4288 Ops/s $\textbf{\color{#35bf28}+7.32\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8307ms 0.6152ms 1.6254 KOps/s 1.5647 KOps/s $\color{#35bf28}+3.88\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.5496ms 0.5862ms 1.7058 KOps/s 1.6400 KOps/s $\color{#35bf28}+4.01\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.3974ms 2.1880ms 457.0441 Ops/s 459.0900 Ops/s $\color{#d91a1a}-0.45\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7257ms 0.5030ms 1.9882 KOps/s 1.9951 KOps/s $\color{#d91a1a}-0.34\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6348ms 0.4760ms 2.1007 KOps/s 2.0558 KOps/s $\color{#35bf28}+2.19\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.3419ms 2.2311ms 448.2039 Ops/s 437.5776 Ops/s $\color{#35bf28}+2.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9972ms 0.4982ms 2.0073 KOps/s 2.0198 KOps/s $\color{#d91a1a}-0.62\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6802ms 0.4784ms 2.0903 KOps/s 2.0812 KOps/s $\color{#35bf28}+0.43\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.6415ms 2.4403ms 409.7900 Ops/s 438.9936 Ops/s $\textbf{\color{#d91a1a}-6.65\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.6986ms 0.6231ms 1.6049 KOps/s 1.6033 KOps/s $\color{#35bf28}+0.10\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7938ms 0.6028ms 1.6589 KOps/s 1.6580 KOps/s $\color{#35bf28}+0.05\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1187s 8.0185ms 124.7118 Ops/s 123.4523 Ops/s $\color{#35bf28}+1.02\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 16.9645ms 13.1939ms 75.7924 Ops/s 82.5310 Ops/s $\textbf{\color{#d91a1a}-8.17\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.1266ms 1.0499ms 952.4485 Ops/s 949.5837 Ops/s $\color{#35bf28}+0.30\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1061s 5.7415ms 174.1720 Ops/s 173.0317 Ops/s $\color{#35bf28}+0.66\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 15.0870ms 12.2887ms 81.3754 Ops/s 70.0280 Ops/s $\textbf{\color{#35bf28}+16.20\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.1240ms 1.0507ms 951.7588 Ops/s 981.6598 Ops/s $\color{#d91a1a}-3.05\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1165s 8.4260ms 118.6806 Ops/s 165.4540 Ops/s $\textbf{\color{#d91a1a}-28.27\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 15.2840ms 12.7113ms 78.6703 Ops/s 79.7296 Ops/s $\color{#d91a1a}-1.33\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.2162ms 1.4874ms 672.2950 Ops/s 715.7823 Ops/s $\textbf{\color{#d91a1a}-6.08\%}$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1163s 0.1160s 8.6240 Ops/s 8.3283 Ops/s $\color{#35bf28}+3.55\%$
test_sync 0.1060s 0.1038s 9.6300 Ops/s 9.6191 Ops/s $\color{#35bf28}+0.11\%$
test_async 0.1902s 95.0772ms 10.5178 Ops/s 10.5396 Ops/s $\color{#d91a1a}-0.21\%$
test_single_pixels 0.1980s 0.1359s 7.3591 Ops/s 7.7877 Ops/s $\textbf{\color{#d91a1a}-5.50\%}$
test_sync_pixels 0.1380s 85.1983ms 11.7373 Ops/s 11.6767 Ops/s $\color{#35bf28}+0.52\%$
test_async_pixels 0.1613s 69.7010ms 14.3470 Ops/s 12.4394 Ops/s $\textbf{\color{#35bf28}+15.34\%}$
test_simple 0.7586s 0.7576s 1.3200 Ops/s 1.2757 Ops/s $\color{#35bf28}+3.47\%$
test_transformed 1.0111s 1.0105s 0.9896 Ops/s 0.9631 Ops/s $\color{#35bf28}+2.76\%$
test_serial 2.4947s 2.4364s 0.4104 Ops/s 0.4032 Ops/s $\color{#35bf28}+1.79\%$
test_parallel 2.3557s 2.3117s 0.4326 Ops/s 0.4289 Ops/s $\color{#35bf28}+0.86\%$
test_step_mdp_speed[True-True-True-True-True] 99.6410μs 33.5187μs 29.8341 KOps/s 29.8684 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-True-True-True-False] 47.6600μs 20.0417μs 49.8960 KOps/s 50.4329 KOps/s $\color{#d91a1a}-1.06\%$
test_step_mdp_speed[True-True-True-False-True] 38.2010μs 19.0827μs 52.4036 KOps/s 53.1070 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-True-True-False-False] 41.1110μs 11.3423μs 88.1652 KOps/s 88.2341 KOps/s $\color{#d91a1a}-0.08\%$
test_step_mdp_speed[True-True-False-True-True] 67.1310μs 35.3778μs 28.2663 KOps/s 28.3988 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-True-False-True-False] 38.7800μs 21.9008μs 45.6605 KOps/s 45.8167 KOps/s $\color{#d91a1a}-0.34\%$
test_step_mdp_speed[True-True-False-False-True] 84.0610μs 20.7856μs 48.1101 KOps/s 48.6546 KOps/s $\color{#d91a1a}-1.12\%$
test_step_mdp_speed[True-True-False-False-False] 33.4300μs 13.4606μs 74.2911 KOps/s 75.3479 KOps/s $\color{#d91a1a}-1.40\%$
test_step_mdp_speed[True-False-True-True-True] 64.5000μs 37.8459μs 26.4229 KOps/s 26.6989 KOps/s $\color{#d91a1a}-1.03\%$
test_step_mdp_speed[True-False-True-True-False] 44.1000μs 23.9534μs 41.7478 KOps/s 42.1143 KOps/s $\color{#d91a1a}-0.87\%$
test_step_mdp_speed[True-False-True-False-True] 75.0510μs 20.8769μs 47.8998 KOps/s 48.3285 KOps/s $\color{#d91a1a}-0.89\%$
test_step_mdp_speed[True-False-True-False-False] 59.2710μs 13.4106μs 74.5680 KOps/s 75.3284 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-False-False-True-True] 76.2010μs 39.6158μs 25.2425 KOps/s 25.6210 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[True-False-False-True-False] 0.1194ms 25.7491μs 38.8363 KOps/s 39.4121 KOps/s $\color{#d91a1a}-1.46\%$
test_step_mdp_speed[True-False-False-False-True] 49.3810μs 22.7289μs 43.9969 KOps/s 44.9725 KOps/s $\color{#d91a1a}-2.17\%$
test_step_mdp_speed[True-False-False-False-False] 32.2100μs 15.3474μs 65.1577 KOps/s 66.2968 KOps/s $\color{#d91a1a}-1.72\%$
test_step_mdp_speed[False-True-True-True-True] 55.6200μs 37.4045μs 26.7347 KOps/s 26.9798 KOps/s $\color{#d91a1a}-0.91\%$
test_step_mdp_speed[False-True-True-True-False] 82.8900μs 24.1563μs 41.3970 KOps/s 42.4707 KOps/s $\color{#d91a1a}-2.53\%$
test_step_mdp_speed[False-True-True-False-True] 77.3010μs 24.8359μs 40.2642 KOps/s 40.8285 KOps/s $\color{#d91a1a}-1.38\%$
test_step_mdp_speed[False-True-True-False-False] 40.8210μs 15.3844μs 65.0011 KOps/s 66.7560 KOps/s $\color{#d91a1a}-2.63\%$
test_step_mdp_speed[False-True-False-True-True] 64.8610μs 39.2013μs 25.5094 KOps/s 25.5573 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[False-True-False-True-False] 43.0000μs 25.6804μs 38.9402 KOps/s 38.8158 KOps/s $\color{#35bf28}+0.32\%$
test_step_mdp_speed[False-True-False-False-True] 42.2710μs 26.7217μs 37.4227 KOps/s 37.9967 KOps/s $\color{#d91a1a}-1.51\%$
test_step_mdp_speed[False-True-False-False-False] 33.3600μs 16.8140μs 59.4743 KOps/s 59.1162 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-False-True-True-True] 60.8810μs 41.4469μs 24.1273 KOps/s 24.1460 KOps/s $\color{#d91a1a}-0.08\%$
test_step_mdp_speed[False-False-True-True-False] 53.6410μs 27.9631μs 35.7614 KOps/s 36.3237 KOps/s $\color{#d91a1a}-1.55\%$
test_step_mdp_speed[False-False-True-False-True] 43.5110μs 26.7561μs 37.3747 KOps/s 37.7302 KOps/s $\color{#d91a1a}-0.94\%$
test_step_mdp_speed[False-False-True-False-False] 32.5200μs 17.1221μs 58.4040 KOps/s 58.5778 KOps/s $\color{#d91a1a}-0.30\%$
test_step_mdp_speed[False-False-False-True-True] 71.7010μs 43.3956μs 23.0438 KOps/s 23.4499 KOps/s $\color{#d91a1a}-1.73\%$
test_step_mdp_speed[False-False-False-True-False] 50.8900μs 29.7895μs 33.5689 KOps/s 33.7335 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[False-False-False-False-True] 48.6800μs 27.9615μs 35.7634 KOps/s 35.2271 KOps/s $\color{#35bf28}+1.52\%$
test_step_mdp_speed[False-False-False-False-False] 35.1710μs 18.9378μs 52.8044 KOps/s 53.0522 KOps/s $\color{#d91a1a}-0.47\%$
test_values[generalized_advantage_estimate-True-True] 26.0404ms 25.0348ms 39.9444 Ops/s 39.5034 Ops/s $\color{#35bf28}+1.12\%$
test_values[vec_generalized_advantage_estimate-True-True] 80.9931ms 3.1904ms 313.4449 Ops/s 311.4455 Ops/s $\color{#35bf28}+0.64\%$
test_values[td0_return_estimate-False-False] 86.5610μs 64.2459μs 15.5652 KOps/s 15.4510 KOps/s $\color{#35bf28}+0.74\%$
test_values[td1_return_estimate-False-False] 53.0609ms 52.5067ms 19.0452 Ops/s 18.7652 Ops/s $\color{#35bf28}+1.49\%$
test_values[vec_td1_return_estimate-False-False] 2.0519ms 1.7667ms 566.0115 Ops/s 565.2456 Ops/s $\color{#35bf28}+0.14\%$
test_values[td_lambda_return_estimate-True-False] 84.4788ms 83.7995ms 11.9332 Ops/s 11.8347 Ops/s $\color{#35bf28}+0.83\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.1077ms 1.7617ms 567.6458 Ops/s 566.1268 Ops/s $\color{#35bf28}+0.27\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.8841ms 24.1781ms 41.3597 Ops/s 41.8988 Ops/s $\color{#d91a1a}-1.29\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8916ms 0.6990ms 1.4307 KOps/s 1.4201 KOps/s $\color{#35bf28}+0.75\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7340ms 0.6528ms 1.5319 KOps/s 1.5269 KOps/s $\color{#35bf28}+0.32\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5445ms 1.4529ms 688.2556 Ops/s 686.6763 Ops/s $\color{#35bf28}+0.23\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9322ms 0.6735ms 1.4847 KOps/s 1.4817 KOps/s $\color{#35bf28}+0.20\%$
test_dqn_speed 75.2253ms 1.6248ms 615.4508 Ops/s 679.1596 Ops/s $\textbf{\color{#d91a1a}-9.38\%}$
test_ddpg_speed 3.2888ms 2.9880ms 334.6758 Ops/s 336.5636 Ops/s $\color{#d91a1a}-0.56\%$
test_sac_speed 9.5552ms 8.6587ms 115.4904 Ops/s 116.2695 Ops/s $\color{#d91a1a}-0.67\%$
test_redq_speed 12.5041ms 10.4637ms 95.5683 Ops/s 94.8931 Ops/s $\color{#35bf28}+0.71\%$
test_redq_deprec_speed 12.5437ms 11.9883ms 83.4147 Ops/s 86.8892 Ops/s $\color{#d91a1a}-4.00\%$
test_td3_speed 17.4894ms 8.6474ms 115.6414 Ops/s 117.5344 Ops/s $\color{#d91a1a}-1.61\%$
test_cql_speed 28.2319ms 26.2667ms 38.0710 Ops/s 38.0132 Ops/s $\color{#35bf28}+0.15\%$
test_a2c_speed 6.0383ms 5.7917ms 172.6622 Ops/s 175.3514 Ops/s $\color{#d91a1a}-1.53\%$
test_ppo_speed 7.1309ms 6.0970ms 164.0163 Ops/s 165.6514 Ops/s $\color{#d91a1a}-0.99\%$
test_reinforce_speed 5.0434ms 4.7831ms 209.0702 Ops/s 214.7433 Ops/s $\color{#d91a1a}-2.64\%$
test_iql_speed 20.3020ms 19.8117ms 50.4751 Ops/s 50.3913 Ops/s $\color{#35bf28}+0.17\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9068ms 2.8438ms 351.6410 Ops/s 357.1282 Ops/s $\color{#d91a1a}-1.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7380ms 0.5967ms 1.6759 KOps/s 1.6571 KOps/s $\color{#35bf28}+1.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.1019s 0.6527ms 1.5321 KOps/s 1.7422 KOps/s $\textbf{\color{#d91a1a}-12.06\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0272ms 2.8481ms 351.1116 Ops/s 356.5597 Ops/s $\color{#d91a1a}-1.53\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7099ms 0.5888ms 1.6983 KOps/s 1.6887 KOps/s $\color{#35bf28}+0.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.9090ms 0.5687ms 1.7583 KOps/s 1.7645 KOps/s $\color{#d91a1a}-0.35\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6115ms 1.5237ms 656.2798 Ops/s 655.1754 Ops/s $\color{#35bf28}+0.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5792ms 1.4510ms 689.1763 Ops/s 674.9177 Ops/s $\color{#35bf28}+2.11\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1226ms 2.9773ms 335.8705 Ops/s 339.1129 Ops/s $\color{#d91a1a}-0.96\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.6172ms 0.7299ms 1.3700 KOps/s 1.3782 KOps/s $\color{#d91a1a}-0.59\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8434ms 0.7015ms 1.4256 KOps/s 1.4310 KOps/s $\color{#d91a1a}-0.38\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9317ms 2.8481ms 351.1133 Ops/s 354.8740 Ops/s $\color{#d91a1a}-1.06\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7366ms 0.5968ms 1.6756 KOps/s 1.6618 KOps/s $\color{#35bf28}+0.83\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 5.1418ms 0.5796ms 1.7255 KOps/s 1.7470 KOps/s $\color{#d91a1a}-1.23\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9745ms 2.8430ms 351.7431 Ops/s 352.0500 Ops/s $\color{#d91a1a}-0.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7041ms 0.5913ms 1.6913 KOps/s 1.6765 KOps/s $\color{#35bf28}+0.88\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7249ms 0.5636ms 1.7745 KOps/s 1.7359 KOps/s $\color{#35bf28}+2.22\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0420ms 2.9852ms 334.9819 Ops/s 338.0515 Ops/s $\color{#d91a1a}-0.91\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.5111ms 0.7271ms 1.3754 KOps/s 1.3619 KOps/s $\color{#35bf28}+0.99\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8574ms 0.7015ms 1.4255 KOps/s 1.4246 KOps/s $\color{#35bf28}+0.07\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1356s 7.5236ms 132.9154 Ops/s 104.2031 Ops/s $\textbf{\color{#35bf28}+27.55\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 23.2629ms 15.3022ms 65.3499 Ops/s 65.2589 Ops/s $\color{#35bf28}+0.14\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.4401ms 1.2380ms 807.7805 Ops/s 718.7289 Ops/s $\textbf{\color{#35bf28}+12.39\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1189s 9.4406ms 105.9259 Ops/s 139.9129 Ops/s $\textbf{\color{#d91a1a}-24.29\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.5572ms 15.1813ms 65.8704 Ops/s 65.2746 Ops/s $\color{#35bf28}+0.91\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.3070ms 1.2063ms 829.0091 Ops/s 796.3986 Ops/s $\color{#35bf28}+4.09\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1174s 7.5171ms 133.0308 Ops/s 101.7866 Ops/s $\textbf{\color{#35bf28}+30.70\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.9681ms 15.5460ms 64.3252 Ops/s 63.6198 Ops/s $\color{#35bf28}+1.11\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.6365ms 1.5845ms 631.1191 Ops/s 635.2733 Ops/s $\color{#d91a1a}-0.65\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. versioning Versioning change (version number etc)
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot