Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Versioning] Deprecations for 0.4 #2109

Merged
merged 12 commits into from
Apr 25, 2024
Merged

[Versioning] Deprecations for 0.4 #2109

merged 12 commits into from
Apr 25, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 24, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 24, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2109

Note: Links to docs will display an error until the docs builds have been completed.

❌ 13 New Failures, 3 Unrelated Failures

As of commit 4522c02 with merge base 93e9e30 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 24, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 24, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 54.4099ms 53.3654ms 18.7387 Ops/s 18.7823 Ops/s $\color{#d91a1a}-0.23\%$
test_sync 34.0925ms 29.8906ms 33.4554 Ops/s 31.9158 Ops/s $\color{#35bf28}+4.82\%$
test_async 55.5229ms 26.3172ms 37.9980 Ops/s 37.3099 Ops/s $\color{#35bf28}+1.84\%$
test_simple 0.3988s 0.3441s 2.9061 Ops/s 2.9660 Ops/s $\color{#d91a1a}-2.02\%$
test_transformed 0.5320s 0.4844s 2.0646 Ops/s 2.0213 Ops/s $\color{#35bf28}+2.14\%$
test_serial 1.2426s 1.1880s 0.8418 Ops/s 0.8287 Ops/s $\color{#35bf28}+1.58\%$
test_parallel 1.0720s 1.0039s 0.9961 Ops/s 0.9771 Ops/s $\color{#35bf28}+1.95\%$
test_step_mdp_speed[True-True-True-True-True] 0.1355ms 21.0093μs 47.5979 KOps/s 47.5272 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[True-True-True-True-False] 48.1900μs 12.6889μs 78.8088 KOps/s 78.4030 KOps/s $\color{#35bf28}+0.52\%$
test_step_mdp_speed[True-True-True-False-True] 41.5580μs 12.2042μs 81.9392 KOps/s 80.7909 KOps/s $\color{#35bf28}+1.42\%$
test_step_mdp_speed[True-True-True-False-False] 27.6810μs 7.3645μs 135.7859 KOps/s 133.3520 KOps/s $\color{#35bf28}+1.83\%$
test_step_mdp_speed[True-True-False-True-True] 58.0780μs 22.1152μs 45.2178 KOps/s 44.7619 KOps/s $\color{#35bf28}+1.02\%$
test_step_mdp_speed[True-True-False-True-False] 54.4910μs 13.8887μs 72.0008 KOps/s 71.7290 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[True-True-False-False-True] 51.1950μs 13.3511μs 74.8999 KOps/s 74.0870 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-True-False-False-False] 31.2190μs 8.6390μs 115.7535 KOps/s 115.3953 KOps/s $\color{#35bf28}+0.31\%$
test_step_mdp_speed[True-False-True-True-True] 56.3560μs 23.3518μs 42.8233 KOps/s 42.1253 KOps/s $\color{#35bf28}+1.66\%$
test_step_mdp_speed[True-False-True-True-False] 51.2560μs 15.1973μs 65.8011 KOps/s 65.7026 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[True-False-True-False-True] 42.4090μs 13.3555μs 74.8757 KOps/s 73.6333 KOps/s $\color{#35bf28}+1.69\%$
test_step_mdp_speed[True-False-True-False-False] 58.3290μs 8.5968μs 116.3225 KOps/s 115.5449 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[True-False-False-True-True] 69.0690μs 24.5456μs 40.7406 KOps/s 39.9001 KOps/s $\color{#35bf28}+2.11\%$
test_step_mdp_speed[True-False-False-True-False] 48.4210μs 16.5657μs 60.3656 KOps/s 60.8120 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[True-False-False-False-True] 42.1190μs 14.5803μs 68.5857 KOps/s 67.8032 KOps/s $\color{#35bf28}+1.15\%$
test_step_mdp_speed[True-False-False-False-False] 48.7010μs 9.7020μs 103.0715 KOps/s 101.6891 KOps/s $\color{#35bf28}+1.36\%$
test_step_mdp_speed[False-True-True-True-True] 0.1161ms 23.6019μs 42.3695 KOps/s 41.9802 KOps/s $\color{#35bf28}+0.93\%$
test_step_mdp_speed[False-True-True-True-False] 50.6240μs 15.0929μs 66.2563 KOps/s 65.9078 KOps/s $\color{#35bf28}+0.53\%$
test_step_mdp_speed[False-True-True-False-True] 97.3210μs 15.9293μs 62.7772 KOps/s 63.4820 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[False-True-True-False-False] 39.0830μs 9.7465μs 102.6014 KOps/s 102.5158 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-True-False-True-True] 44.6030μs 24.6048μs 40.6425 KOps/s 39.8115 KOps/s $\color{#35bf28}+2.09\%$
test_step_mdp_speed[False-True-False-True-False] 38.9930μs 16.2847μs 61.4075 KOps/s 61.3976 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[False-True-False-False-True] 52.7280μs 16.5767μs 60.3257 KOps/s 59.4433 KOps/s $\color{#35bf28}+1.48\%$
test_step_mdp_speed[False-True-False-False-False] 36.2970μs 10.8774μs 91.9334 KOps/s 91.1743 KOps/s $\color{#35bf28}+0.83\%$
test_step_mdp_speed[False-False-True-True-True] 62.0560μs 25.7785μs 38.7920 KOps/s 38.0717 KOps/s $\color{#35bf28}+1.89\%$
test_step_mdp_speed[False-False-True-True-False] 42.5900μs 17.6000μs 56.8181 KOps/s 56.7981 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[False-False-True-False-True] 40.6460μs 16.6590μs 60.0277 KOps/s 58.0710 KOps/s $\color{#35bf28}+3.37\%$
test_step_mdp_speed[False-False-True-False-False] 39.4530μs 11.0759μs 90.2860 KOps/s 90.5383 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[False-False-False-True-True] 61.5550μs 26.6316μs 37.5494 KOps/s 36.5406 KOps/s $\color{#35bf28}+2.76\%$
test_step_mdp_speed[False-False-False-True-False] 41.8080μs 18.6375μs 53.6553 KOps/s 53.8705 KOps/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[False-False-False-False-True] 64.4600μs 17.6966μs 56.5081 KOps/s 55.6794 KOps/s $\color{#35bf28}+1.49\%$
test_step_mdp_speed[False-False-False-False-False] 38.3320μs 11.9363μs 83.7783 KOps/s 83.3217 KOps/s $\color{#35bf28}+0.55\%$
test_values[generalized_advantage_estimate-True-True] 12.0202ms 9.2152ms 108.5163 Ops/s 108.5097 Ops/s $+0.01\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.9253ms 35.8556ms 27.8897 Ops/s 28.0804 Ops/s $\color{#d91a1a}-0.68\%$
test_values[td0_return_estimate-False-False] 0.2273ms 0.1753ms 5.7054 KOps/s 5.5473 KOps/s $\color{#35bf28}+2.85\%$
test_values[td1_return_estimate-False-False] 26.5121ms 23.3458ms 42.8342 Ops/s 43.3718 Ops/s $\color{#d91a1a}-1.24\%$
test_values[vec_td1_return_estimate-False-False] 42.8595ms 36.4281ms 27.4513 Ops/s 27.8707 Ops/s $\color{#d91a1a}-1.50\%$
test_values[td_lambda_return_estimate-True-False] 34.1086ms 33.6459ms 29.7213 Ops/s 30.0919 Ops/s $\color{#d91a1a}-1.23\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.1626ms 35.8845ms 27.8672 Ops/s 27.8712 Ops/s $\color{#d91a1a}-0.01\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.0879ms 8.0116ms 124.8193 Ops/s 123.1179 Ops/s $\color{#35bf28}+1.38\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.2326ms 1.9374ms 516.1651 Ops/s 496.8728 Ops/s $\color{#35bf28}+3.88\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5363ms 0.3446ms 2.9016 KOps/s 2.8145 KOps/s $\color{#35bf28}+3.10\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 48.5487ms 45.9724ms 21.7522 Ops/s 22.8703 Ops/s $\color{#d91a1a}-4.89\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.6773ms 3.0175ms 331.4031 Ops/s 324.7394 Ops/s $\color{#35bf28}+2.05\%$
test_dqn_speed 7.7076ms 1.3308ms 751.4047 Ops/s 692.4895 Ops/s $\textbf{\color{#35bf28}+8.51\%}$
test_ddpg_speed 3.6023ms 2.8393ms 352.1974 Ops/s 346.1067 Ops/s $\color{#35bf28}+1.76\%$
test_sac_speed 8.9147ms 8.3632ms 119.5720 Ops/s 116.2405 Ops/s $\color{#35bf28}+2.87\%$
test_redq_speed 14.5724ms 13.2321ms 75.5738 Ops/s 73.9623 Ops/s $\color{#35bf28}+2.18\%$
test_redq_deprec_speed 20.5524ms 13.9281ms 71.7973 Ops/s 71.3598 Ops/s $\color{#35bf28}+0.61\%$
test_td3_speed 8.7646ms 8.3094ms 120.3462 Ops/s 116.7880 Ops/s $\color{#35bf28}+3.05\%$
test_cql_speed 38.3909ms 36.6655ms 27.2736 Ops/s 26.8576 Ops/s $\color{#35bf28}+1.55\%$
test_a2c_speed 8.2677ms 7.4965ms 133.3955 Ops/s 132.2314 Ops/s $\color{#35bf28}+0.88\%$
test_ppo_speed 9.1910ms 7.7574ms 128.9094 Ops/s 127.6767 Ops/s $\color{#35bf28}+0.97\%$
test_reinforce_speed 7.2996ms 6.6527ms 150.3149 Ops/s 149.2191 Ops/s $\color{#35bf28}+0.73\%$
test_iql_speed 34.6764ms 33.1447ms 30.1708 Ops/s 30.3595 Ops/s $\color{#d91a1a}-0.62\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.4320ms 2.1645ms 461.9939 Ops/s 445.1651 Ops/s $\color{#35bf28}+3.78\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0695ms 0.5006ms 1.9976 KOps/s 1.9521 KOps/s $\color{#35bf28}+2.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6919ms 0.4791ms 2.0873 KOps/s 2.0730 KOps/s $\color{#35bf28}+0.69\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.6758ms 2.3502ms 425.4902 Ops/s 430.4862 Ops/s $\color{#d91a1a}-1.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7287ms 0.5020ms 1.9921 KOps/s 2.0070 KOps/s $\color{#d91a1a}-0.74\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.3434ms 0.4931ms 2.0281 KOps/s 2.1380 KOps/s $\textbf{\color{#d91a1a}-5.14\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.3301ms 1.2174ms 821.3966 Ops/s 712.8528 Ops/s $\textbf{\color{#35bf28}+15.23\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 4.0383ms 1.1679ms 856.2564 Ops/s 854.1715 Ops/s $\color{#35bf28}+0.24\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.6416ms 2.4083ms 415.2257 Ops/s 437.1155 Ops/s $\textbf{\color{#d91a1a}-5.01\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1522ms 0.6210ms 1.6102 KOps/s 1.6132 KOps/s $\color{#d91a1a}-0.18\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7826ms 0.5876ms 1.7019 KOps/s 1.7101 KOps/s $\color{#d91a1a}-0.48\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.5891ms 2.1353ms 468.3197 Ops/s 449.1297 Ops/s $\color{#35bf28}+4.27\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0710ms 0.4924ms 2.0311 KOps/s 1.9387 KOps/s $\color{#35bf28}+4.76\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6925ms 0.4773ms 2.0951 KOps/s 2.0435 KOps/s $\color{#35bf28}+2.53\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.4087ms 2.3006ms 434.6725 Ops/s 442.4337 Ops/s $\color{#d91a1a}-1.75\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6036ms 0.4903ms 2.0395 KOps/s 1.9963 KOps/s $\color{#35bf28}+2.17\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.8293ms 0.4791ms 2.0871 KOps/s 2.1188 KOps/s $\color{#d91a1a}-1.50\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.5867ms 2.2842ms 437.7976 Ops/s 434.9411 Ops/s $\color{#35bf28}+0.66\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8923ms 0.6179ms 1.6185 KOps/s 1.6061 KOps/s $\color{#35bf28}+0.77\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8319ms 0.5977ms 1.6731 KOps/s 1.6768 KOps/s $\color{#d91a1a}-0.22\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1139s 8.0102ms 124.8403 Ops/s 159.8189 Ops/s $\textbf{\color{#d91a1a}-21.89\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.5010ms 12.0240ms 83.1673 Ops/s 82.3795 Ops/s $\color{#35bf28}+0.96\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.6405ms 1.0867ms 920.2161 Ops/s 930.2751 Ops/s $\color{#d91a1a}-1.08\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1233s 6.1240ms 163.2921 Ops/s 177.2464 Ops/s $\textbf{\color{#d91a1a}-7.87\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.8285ms 12.2613ms 81.5573 Ops/s 83.1615 Ops/s $\color{#d91a1a}-1.93\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.6703ms 1.0918ms 915.9073 Ops/s 941.1469 Ops/s $\color{#d91a1a}-2.68\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1243s 8.9650ms 111.5443 Ops/s 119.7788 Ops/s $\textbf{\color{#d91a1a}-6.87\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 15.2432ms 12.5372ms 79.7629 Ops/s 80.9135 Ops/s $\color{#d91a1a}-1.42\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 4.2628ms 1.4890ms 671.6006 Ops/s 731.0214 Ops/s $\textbf{\color{#d91a1a}-8.13\%}$

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 24, 2024 •
edited
Loading

Result of GPU Benchmark Tests

Expand to view detailed results
Name Max Mean Ops
test_single 0.1007s 0.1006s 9.9381 Ops/s
test_sync 88.3805ms 87.6117ms 11.4140 Ops/s
test_async 0.1719s 85.8224ms 11.6520 Ops/s
test_single_pixels 0.1115s 0.1110s 9.0079 Ops/s
test_sync_pixels 68.4065ms 65.6025ms 15.2433 Ops/s
test_async_pixels 0.1157s 61.1616ms 16.3501 Ops/s
test_simple 0.7493s 0.6883s 1.4528 Ops/s
test_transformed 0.9696s 0.9107s 1.0980 Ops/s
test_serial 2.1560s 2.0979s 0.4767 Ops/s
test_parallel 1.8893s 1.7801s 0.5618 Ops/s
test_step_mdp_speed[True-True-True-True-True] 72.4340μs 33.2210μs 30.1015 KOps/s
test_step_mdp_speed[True-True-True-True-False] 46.3420μs 19.9576μs 50.1063 KOps/s
test_step_mdp_speed[True-True-True-False-True] 37.8320μs 19.2825μs 51.8605 KOps/s
test_step_mdp_speed[True-True-True-False-False] 28.3010μs 11.4659μs 87.2149 KOps/s
test_step_mdp_speed[True-True-False-True-True] 51.5320μs 35.5324μs 28.1433 KOps/s
test_step_mdp_speed[True-True-False-True-False] 46.5930μs 21.8727μs 45.7192 KOps/s
test_step_mdp_speed[True-True-False-False-True] 40.3620μs 20.9843μs 47.6546 KOps/s
test_step_mdp_speed[True-True-False-False-False] 38.0920μs 13.3216μs 75.0663 KOps/s
test_step_mdp_speed[True-False-True-True-True] 57.3830μs 37.4070μs 26.7330 KOps/s
test_step_mdp_speed[True-False-True-True-False] 42.7520μs 23.5225μs 42.5124 KOps/s
test_step_mdp_speed[True-False-True-False-True] 40.9120μs 20.8154μs 48.0413 KOps/s
test_step_mdp_speed[True-False-True-False-False] 29.0420μs 13.2020μs 75.7460 KOps/s
test_step_mdp_speed[True-False-False-True-True] 63.9730μs 38.9388μs 25.6813 KOps/s
test_step_mdp_speed[True-False-False-True-False] 43.6130μs 25.2247μs 39.6437 KOps/s
test_step_mdp_speed[True-False-False-False-True] 39.7620μs 22.6588μs 44.1329 KOps/s
test_step_mdp_speed[True-False-False-False-False] 29.9020μs 15.1174μs 66.1491 KOps/s
test_step_mdp_speed[False-True-True-True-True] 57.7830μs 37.1277μs 26.9340 KOps/s
test_step_mdp_speed[False-True-True-True-False] 42.8620μs 23.7559μs 42.0949 KOps/s
test_step_mdp_speed[False-True-True-False-True] 52.2820μs 25.1381μs 39.7802 KOps/s
test_step_mdp_speed[False-True-True-False-False] 30.7920μs 15.1950μs 65.8110 KOps/s
test_step_mdp_speed[False-True-False-True-True] 70.3640μs 39.7989μs 25.1264 KOps/s
test_step_mdp_speed[False-True-False-True-False] 48.0720μs 25.8173μs 38.7337 KOps/s
test_step_mdp_speed[False-True-False-False-True] 44.8630μs 26.9888μs 37.0524 KOps/s
test_step_mdp_speed[False-True-False-False-False] 37.2420μs 17.2308μs 58.0356 KOps/s
test_step_mdp_speed[False-False-True-True-True] 0.1431ms 41.0569μs 24.3564 KOps/s
test_step_mdp_speed[False-False-True-True-False] 48.3430μs 27.9275μs 35.8070 KOps/s
test_step_mdp_speed[False-False-True-False-True] 46.2920μs 26.7027μs 37.4494 KOps/s
test_step_mdp_speed[False-False-True-False-False] 38.8920μs 17.3439μs 57.6573 KOps/s
test_step_mdp_speed[False-False-False-True-True] 63.3030μs 42.8813μs 23.3202 KOps/s
test_step_mdp_speed[False-False-False-True-False] 94.5650μs 29.3801μs 34.0366 KOps/s
test_step_mdp_speed[False-False-False-False-True] 47.0730μs 28.3260μs 35.3032 KOps/s
test_step_mdp_speed[False-False-False-False-False] 35.7420μs 18.9017μs 52.9054 KOps/s
test_values[generalized_advantage_estimate-True-True] 25.3913ms 24.0519ms 41.5767 Ops/s
test_values[vec_generalized_advantage_estimate-True-True] 80.9880ms 3.1860ms 313.8729 Ops/s
test_values[td0_return_estimate-False-False] 92.7550μs 63.5257μs 15.7417 KOps/s
test_values[td1_return_estimate-False-False] 55.5438ms 53.6304ms 18.6462 Ops/s
test_values[vec_td1_return_estimate-False-False] 2.0968ms 1.7683ms 565.5070 Ops/s
test_values[td_lambda_return_estimate-True-False] 87.9551ms 87.3483ms 11.4484 Ops/s
test_values[vec_td_lambda_return_estimate-True-False] 2.1197ms 1.7606ms 567.9914 Ops/s
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.8880ms 24.5677ms 40.7038 Ops/s
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8891ms 0.6940ms 1.4409 KOps/s
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8223ms 0.6705ms 1.4915 KOps/s
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.6062ms 1.4572ms 686.2638 Ops/s
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9700ms 0.6686ms 1.4957 KOps/s
test_dqn_speed 1.9051ms 1.4568ms 686.4424 Ops/s
test_ddpg_speed 3.2503ms 2.9787ms 335.7193 Ops/s
test_sac_speed 9.6939ms 8.6076ms 116.1757 Ops/s
test_redq_speed 12.8620ms 10.4776ms 95.4419 Ops/s
test_redq_deprec_speed 12.3300ms 11.7201ms 85.3231 Ops/s
test_td3_speed 8.5763ms 8.4461ms 118.3984 Ops/s
test_cql_speed 27.0847ms 26.1060ms 38.3054 Ops/s
test_a2c_speed 5.8417ms 5.6758ms 176.1858 Ops/s
test_ppo_speed 6.1290ms 5.9135ms 169.1055 Ops/s
test_reinforce_speed 5.4874ms 4.6877ms 213.3225 Ops/s
test_iql_speed 20.4875ms 19.9198ms 50.2014 Ops/s
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0458ms 2.8306ms 353.2837 Ops/s
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.2410ms 0.5394ms 1.8538 KOps/s
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7270ms 0.5195ms 1.9248 KOps/s
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1462ms 2.8404ms 352.0618 Ops/s
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.3809ms 0.5318ms 1.8805 KOps/s
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6845ms 0.5109ms 1.9573 KOps/s
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5763ms 1.4292ms 699.6786 Ops/s
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5111ms 1.3684ms 730.7881 Ops/s
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0910ms 2.9494ms 339.0488 Ops/s
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8602ms 0.6633ms 1.5077 KOps/s
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.4756ms 0.6429ms 1.5554 KOps/s
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9890ms 2.7845ms 359.1342 Ops/s
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7285ms 0.5385ms 1.8571 KOps/s
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.3181ms 0.5203ms 1.9221 KOps/s
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0864ms 2.8422ms 351.8428 Ops/s
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.3078ms 0.5348ms 1.8700 KOps/s
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7777ms 0.5151ms 1.9415 KOps/s
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1358ms 2.9751ms 336.1196 Ops/s
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8029ms 0.6657ms 1.5022 KOps/s
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.7018ms 0.6541ms 1.5288 KOps/s
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1275s 9.8205ms 101.8278 Ops/s
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.0019ms 15.3269ms 65.2447 Ops/s
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.2862ms 1.1513ms 868.6126 Ops/s
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1179s 7.2680ms 137.5892 Ops/s
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.5416ms 14.9507ms 66.8866 Ops/s
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.3314ms 1.1657ms 857.8396 Ops/s
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1215s 9.9665ms 100.3359 Ops/s
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.3797ms 15.8714ms 63.0062 Ops/s
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.6854ms 1.5050ms 664.4395 Ops/s

@vmoens vmoens added the bc breaking backward compatibility breaking change label Apr 24, 2024
@vmoens vmoens added Environments Adds or modifies an environment wrapper Data Data-related PR, will launch data-related jobs labels Apr 24, 2024
@vmoens vmoens merged commit 36e1309 into main Apr 25, 2024
52 of 68 checks passed
@vmoens vmoens deleted the deprec-v0.4 branch April 25, 2024 10:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
bc breaking backward compatibility breaking change CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Data Data-related PR, will launch data-related jobs Environments Adds or modifies an environment wrapper
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot