Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Minor] Move distributed examples to examples #2097

Merged
merged 1 commit into from
Apr 22, 2024
Merged

[Minor] Move distributed examples to examples #2097

merged 1 commit into from
Apr 22, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 22, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 22, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2097

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 15 Unrelated Failures

As of commit c088fff with merge base 32533a5 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 22, 2024
@vmoens vmoens added the quality code quality label Apr 22, 2024
@vmoens vmoens merged commit 0ea236d into main Apr 22, 2024
34 of 52 checks passed
@vmoens vmoens deleted the move-dist-examples branch April 22, 2024 15:18
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1016s 0.1006s 9.9447 Ops/s 9.5538 Ops/s $\color{#35bf28}+4.09\%$
test_sync 94.0222ms 88.5969ms 11.2871 Ops/s 11.4273 Ops/s $\color{#d91a1a}-1.23\%$
test_async 0.1618s 70.3432ms 14.2160 Ops/s 14.0691 Ops/s $\color{#35bf28}+1.04\%$
test_single_pixels 0.1108s 0.1103s 9.0621 Ops/s 9.0705 Ops/s $\color{#d91a1a}-0.09\%$
test_sync_pixels 69.3730ms 67.2397ms 14.8722 Ops/s 15.0115 Ops/s $\color{#d91a1a}-0.93\%$
test_async_pixels 0.1238s 55.5631ms 17.9976 Ops/s 17.8061 Ops/s $\color{#35bf28}+1.08\%$
test_simple 0.6982s 0.6837s 1.4626 Ops/s 1.4588 Ops/s $\color{#35bf28}+0.26\%$
test_transformed 0.9072s 0.9012s 1.1096 Ops/s 1.1086 Ops/s $\color{#35bf28}+0.09\%$
test_serial 2.1468s 2.0890s 0.4787 Ops/s 0.4795 Ops/s $\color{#d91a1a}-0.17\%$
test_parallel 1.8490s 1.7984s 0.5560 Ops/s 0.5583 Ops/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[True-True-True-True-True] 83.3940μs 33.0272μs 30.2780 KOps/s 30.3794 KOps/s $\color{#d91a1a}-0.33\%$
test_step_mdp_speed[True-True-True-True-False] 43.8620μs 19.6875μs 50.7938 KOps/s 50.9853 KOps/s $\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-True-True-False-True] 36.0210μs 18.7709μs 53.2740 KOps/s 54.5929 KOps/s $\color{#d91a1a}-2.42\%$
test_step_mdp_speed[True-True-True-False-False] 35.9210μs 11.2236μs 89.0976 KOps/s 90.7065 KOps/s $\color{#d91a1a}-1.77\%$
test_step_mdp_speed[True-True-False-True-True] 63.4630μs 34.9141μs 28.6417 KOps/s 28.5947 KOps/s $\color{#35bf28}+0.16\%$
test_step_mdp_speed[True-True-False-True-False] 35.7910μs 21.4584μs 46.6017 KOps/s 46.5802 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-True-False-False-True] 38.3720μs 20.5313μs 48.7061 KOps/s 49.2046 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-True-False-False-False] 31.5810μs 13.2875μs 75.2589 KOps/s 76.3686 KOps/s $\color{#d91a1a}-1.45\%$
test_step_mdp_speed[True-False-True-True-True] 0.1037ms 37.1826μs 26.8943 KOps/s 27.1486 KOps/s $\color{#d91a1a}-0.94\%$
test_step_mdp_speed[True-False-True-True-False] 43.3120μs 23.6156μs 42.3449 KOps/s 42.6905 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[True-False-True-False-True] 38.4710μs 20.6687μs 48.3823 KOps/s 48.7729 KOps/s $\color{#d91a1a}-0.80\%$
test_step_mdp_speed[True-False-True-False-False] 35.9910μs 13.1684μs 75.9394 KOps/s 77.1445 KOps/s $\color{#d91a1a}-1.56\%$
test_step_mdp_speed[True-False-False-True-True] 58.4620μs 38.1024μs 26.2451 KOps/s 26.0249 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[True-False-False-True-False] 96.7250μs 25.2671μs 39.5772 KOps/s 39.7004 KOps/s $\color{#d91a1a}-0.31\%$
test_step_mdp_speed[True-False-False-False-True] 47.2320μs 22.1582μs 45.1300 KOps/s 45.3079 KOps/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[True-False-False-False-False] 30.5310μs 14.8873μs 67.1714 KOps/s 68.0038 KOps/s $\color{#d91a1a}-1.22\%$
test_step_mdp_speed[False-True-True-True-True] 58.2430μs 36.6786μs 27.2639 KOps/s 27.4069 KOps/s $\color{#d91a1a}-0.52\%$
test_step_mdp_speed[False-True-True-True-False] 40.7220μs 23.6207μs 42.3357 KOps/s 42.4066 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[False-True-True-False-True] 42.8420μs 24.5425μs 40.7456 KOps/s 40.9098 KOps/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[False-True-True-False-False] 34.8220μs 15.1630μs 65.9502 KOps/s 66.4723 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[False-True-False-True-True] 66.2830μs 39.0653μs 25.5982 KOps/s 25.6508 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[False-True-False-True-False] 42.8020μs 25.6104μs 39.0466 KOps/s 39.0342 KOps/s $\color{#35bf28}+0.03\%$
test_step_mdp_speed[False-True-False-False-True] 41.6920μs 26.2058μs 38.1595 KOps/s 38.2622 KOps/s $\color{#d91a1a}-0.27\%$
test_step_mdp_speed[False-True-False-False-False] 40.5920μs 16.8062μs 59.5017 KOps/s 60.0312 KOps/s $\color{#d91a1a}-0.88\%$
test_step_mdp_speed[False-False-True-True-True] 65.9830μs 40.4993μs 24.6918 KOps/s 24.2852 KOps/s $\color{#35bf28}+1.67\%$
test_step_mdp_speed[False-False-True-True-False] 93.8940μs 27.3574μs 36.5532 KOps/s 36.8501 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[False-False-True-False-True] 41.3620μs 26.1069μs 38.3041 KOps/s 38.3432 KOps/s $\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-False-True-False-False] 37.4620μs 16.6849μs 59.9344 KOps/s 59.6674 KOps/s $\color{#35bf28}+0.45\%$
test_step_mdp_speed[False-False-False-True-True] 72.2540μs 42.3277μs 23.6252 KOps/s 23.5911 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[False-False-False-True-False] 48.4530μs 29.3091μs 34.1191 KOps/s 34.3514 KOps/s $\color{#d91a1a}-0.68\%$
test_step_mdp_speed[False-False-False-False-True] 53.3520μs 27.7153μs 36.0811 KOps/s 36.2356 KOps/s $\color{#d91a1a}-0.43\%$
test_step_mdp_speed[False-False-False-False-False] 48.8720μs 18.4564μs 54.1816 KOps/s 54.2414 KOps/s $\color{#d91a1a}-0.11\%$
test_values[generalized_advantage_estimate-True-True] 26.1216ms 24.9525ms 40.0762 Ops/s 40.7803 Ops/s $\color{#d91a1a}-1.73\%$
test_values[vec_generalized_advantage_estimate-True-True] 83.7785ms 3.2468ms 307.9960 Ops/s 314.4541 Ops/s $\color{#d91a1a}-2.05\%$
test_values[td0_return_estimate-False-False] 93.8050μs 65.3454μs 15.3033 KOps/s 15.6857 KOps/s $\color{#d91a1a}-2.44\%$
test_values[td1_return_estimate-False-False] 56.4595ms 53.6763ms 18.6302 Ops/s 18.9290 Ops/s $\color{#d91a1a}-1.58\%$
test_values[vec_td1_return_estimate-False-False] 2.0744ms 1.7719ms 564.3508 Ops/s 567.9319 Ops/s $\color{#d91a1a}-0.63\%$
test_values[td_lambda_return_estimate-True-False] 89.9913ms 86.5818ms 11.5498 Ops/s 11.9665 Ops/s $\color{#d91a1a}-3.48\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.1379ms 1.7685ms 565.4569 Ops/s 568.8012 Ops/s $\color{#d91a1a}-0.59\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.7647ms 24.0603ms 41.5622 Ops/s 43.0077 Ops/s $\color{#d91a1a}-3.36\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8963ms 0.7087ms 1.4110 KOps/s 1.4202 KOps/s $\color{#d91a1a}-0.65\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7153ms 0.6578ms 1.5202 KOps/s 1.5370 KOps/s $\color{#d91a1a}-1.09\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4983ms 1.4574ms 686.1472 Ops/s 687.7102 Ops/s $\color{#d91a1a}-0.23\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9547ms 0.6768ms 1.4776 KOps/s 1.4896 KOps/s $\color{#d91a1a}-0.81\%$
test_dqn_speed 8.7317ms 1.4758ms 677.5928 Ops/s 700.2114 Ops/s $\color{#d91a1a}-3.23\%$
test_ddpg_speed 3.1940ms 2.7812ms 359.5520 Ops/s 364.8077 Ops/s $\color{#d91a1a}-1.44\%$
test_sac_speed 9.3734ms 8.4623ms 118.1716 Ops/s 111.7905 Ops/s $\textbf{\color{#35bf28}+5.71\%}$
test_redq_speed 12.1259ms 10.8522ms 92.1469 Ops/s 95.8765 Ops/s $\color{#d91a1a}-3.89\%$
test_redq_deprec_speed 11.9450ms 11.3355ms 88.2182 Ops/s 84.8538 Ops/s $\color{#35bf28}+3.96\%$
test_td3_speed 18.0914ms 8.3906ms 119.1816 Ops/s 122.8090 Ops/s $\color{#d91a1a}-2.95\%$
test_cql_speed 27.6037ms 26.5297ms 37.6936 Ops/s 38.9340 Ops/s $\color{#d91a1a}-3.19\%$
test_a2c_speed 6.1721ms 5.6725ms 176.2878 Ops/s 174.3811 Ops/s $\color{#35bf28}+1.09\%$
test_ppo_speed 6.1692ms 5.9574ms 167.8592 Ops/s 166.2561 Ops/s $\color{#35bf28}+0.96\%$
test_reinforce_speed 5.5725ms 4.6430ms 215.3757 Ops/s 214.1589 Ops/s $\color{#35bf28}+0.57\%$
test_iql_speed 20.6707ms 19.7508ms 50.6308 Ops/s 49.7356 Ops/s $\color{#35bf28}+1.80\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0151ms 2.9364ms 340.5579 Ops/s 348.1163 Ops/s $\color{#d91a1a}-2.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.4507ms 0.5704ms 1.7531 KOps/s 1.8052 KOps/s $\color{#d91a1a}-2.89\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7537ms 0.5483ms 1.8238 KOps/s 1.8352 KOps/s $\color{#d91a1a}-0.62\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1302ms 2.9516ms 338.7993 Ops/s 341.5713 Ops/s $\color{#d91a1a}-0.81\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.4053ms 0.5481ms 1.8245 KOps/s 1.8029 KOps/s $\color{#35bf28}+1.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7070ms 0.5302ms 1.8862 KOps/s 1.8760 KOps/s $\color{#35bf28}+0.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6505ms 1.4943ms 669.1880 Ops/s 685.1603 Ops/s $\color{#d91a1a}-2.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6448ms 1.4444ms 692.3065 Ops/s 709.6506 Ops/s $\color{#d91a1a}-2.44\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1869ms 3.0552ms 327.3143 Ops/s 329.5943 Ops/s $\color{#d91a1a}-0.69\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8296ms 0.6976ms 1.4334 KOps/s 1.4564 KOps/s $\color{#d91a1a}-1.58\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.1367s 0.8976ms 1.1140 KOps/s 1.4892 KOps/s $\textbf{\color{#d91a1a}-25.19\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.1565ms 2.9601ms 337.8267 Ops/s 344.8071 Ops/s $\color{#d91a1a}-2.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6950ms 0.5581ms 1.7919 KOps/s 1.7736 KOps/s $\color{#35bf28}+1.04\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.4026ms 0.5473ms 1.8271 KOps/s 1.8241 KOps/s $\color{#35bf28}+0.16\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1958ms 2.9857ms 334.9243 Ops/s 341.5174 Ops/s $\color{#d91a1a}-1.93\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1192s 0.7255ms 1.3783 KOps/s 1.7916 KOps/s $\textbf{\color{#d91a1a}-23.07\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6636ms 0.5378ms 1.8595 KOps/s 1.8588 KOps/s $\color{#35bf28}+0.04\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.2167ms 3.0770ms 324.9916 Ops/s 330.6078 Ops/s $\color{#d91a1a}-1.70\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8307ms 0.6855ms 1.4589 KOps/s 1.4880 KOps/s $\color{#d91a1a}-1.95\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.7891ms 0.6662ms 1.5010 KOps/s 1.5178 KOps/s $\color{#d91a1a}-1.11\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1288s 7.3303ms 136.4201 Ops/s 101.9497 Ops/s $\textbf{\color{#35bf28}+33.81\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1321s 17.0338ms 58.7068 Ops/s 68.2174 Ops/s $\textbf{\color{#d91a1a}-13.94\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.2391ms 1.1458ms 872.7734 Ops/s 881.2943 Ops/s $\color{#d91a1a}-0.97\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1203s 7.1857ms 139.1661 Ops/s 140.0983 Ops/s $\color{#d91a1a}-0.67\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.0685ms 14.6519ms 68.2506 Ops/s 68.4275 Ops/s $\color{#d91a1a}-0.26\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.2833ms 1.1711ms 853.9009 Ops/s 864.6230 Ops/s $\color{#d91a1a}-1.24\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1270s 7.7204ms 129.5266 Ops/s 133.7696 Ops/s $\color{#d91a1a}-3.17\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.5812ms 15.0909ms 66.2650 Ops/s 66.3459 Ops/s $\color{#d91a1a}-0.12\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.5653ms 1.5224ms 656.8492 Ops/s 665.1716 Ops/s $\color{#d91a1a}-1.25\%$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 57.3207ms 54.7007ms 18.2813 Ops/s 17.4068 Ops/s $\textbf{\color{#35bf28}+5.02\%}$
test_sync 38.6017ms 31.1432ms 32.1098 Ops/s 30.9645 Ops/s $\color{#35bf28}+3.70\%$
test_async 56.1547ms 27.0627ms 36.9512 Ops/s 35.2475 Ops/s $\color{#35bf28}+4.83\%$
test_simple 0.4246s 0.3550s 2.8165 Ops/s 2.9396 Ops/s $\color{#d91a1a}-4.19\%$
test_transformed 0.5769s 0.5165s 1.9363 Ops/s 1.9802 Ops/s $\color{#d91a1a}-2.22\%$
test_serial 1.2983s 1.2410s 0.8058 Ops/s 0.8133 Ops/s $\color{#d91a1a}-0.92\%$
test_parallel 1.0850s 1.0251s 0.9755 Ops/s 0.9754 Ops/s $+0.01\%$
test_step_mdp_speed[True-True-True-True-True] 0.1374ms 21.8898μs 45.6835 KOps/s 47.0859 KOps/s $\color{#d91a1a}-2.98\%$
test_step_mdp_speed[True-True-True-True-False] 55.3710μs 13.0096μs 76.8661 KOps/s 77.0146 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-True-True-False-True] 48.0490μs 13.0589μs 76.5761 KOps/s 80.4632 KOps/s $\color{#d91a1a}-4.83\%$
test_step_mdp_speed[True-True-True-False-False] 0.1116ms 7.7471μs 129.0803 KOps/s 131.3899 KOps/s $\color{#d91a1a}-1.76\%$
test_step_mdp_speed[True-True-False-True-True] 50.2030μs 23.2524μs 43.0063 KOps/s 43.7830 KOps/s $\color{#d91a1a}-1.77\%$
test_step_mdp_speed[True-True-False-True-False] 44.5130μs 14.5527μs 68.7157 KOps/s 70.2880 KOps/s $\color{#d91a1a}-2.24\%$
test_step_mdp_speed[True-True-False-False-True] 39.4440μs 14.1570μs 70.6362 KOps/s 73.4783 KOps/s $\color{#d91a1a}-3.87\%$
test_step_mdp_speed[True-True-False-False-False] 25.6880μs 9.1131μs 109.7322 KOps/s 114.3720 KOps/s $\color{#d91a1a}-4.06\%$
test_step_mdp_speed[True-False-True-True-True] 54.0710μs 24.8299μs 40.2741 KOps/s 41.4855 KOps/s $\color{#d91a1a}-2.92\%$
test_step_mdp_speed[True-False-True-True-False] 44.9040μs 15.8638μs 63.0367 KOps/s 63.7373 KOps/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-False-True-False-True] 35.6860μs 14.2934μs 69.9624 KOps/s 70.9560 KOps/s $\color{#d91a1a}-1.40\%$
test_step_mdp_speed[True-False-True-False-False] 26.1990μs 9.0609μs 110.3645 KOps/s 112.5619 KOps/s $\color{#d91a1a}-1.95\%$
test_step_mdp_speed[True-False-False-True-True] 53.2490μs 25.8863μs 38.6305 KOps/s 39.7686 KOps/s $\color{#d91a1a}-2.86\%$
test_step_mdp_speed[True-False-False-True-False] 45.3250μs 16.9266μs 59.0785 KOps/s 59.8294 KOps/s $\color{#d91a1a}-1.26\%$
test_step_mdp_speed[True-False-False-False-True] 68.1370μs 15.5522μs 64.2996 KOps/s 67.7450 KOps/s $\textbf{\color{#d91a1a}-5.09\%}$
test_step_mdp_speed[True-False-False-False-False] 29.5460μs 10.0763μs 99.2432 KOps/s 100.6590 KOps/s $\color{#d91a1a}-1.41\%$
test_step_mdp_speed[False-True-True-True-True] 50.7340μs 24.6461μs 40.5745 KOps/s 41.3104 KOps/s $\color{#d91a1a}-1.78\%$
test_step_mdp_speed[False-True-True-True-False] 52.9190μs 15.8832μs 62.9595 KOps/s 63.3800 KOps/s $\color{#d91a1a}-0.66\%$
test_step_mdp_speed[False-True-True-False-True] 41.0170μs 16.6428μs 60.0861 KOps/s 62.0866 KOps/s $\color{#d91a1a}-3.22\%$
test_step_mdp_speed[False-True-True-False-False] 43.1800μs 10.3490μs 96.6273 KOps/s 100.3313 KOps/s $\color{#d91a1a}-3.69\%$
test_step_mdp_speed[False-True-False-True-True] 41.9980μs 26.2485μs 38.0974 KOps/s 38.4995 KOps/s $\color{#d91a1a}-1.04\%$
test_step_mdp_speed[False-True-False-True-False] 45.5740μs 16.9061μs 59.1504 KOps/s 58.8485 KOps/s $\color{#35bf28}+0.51\%$
test_step_mdp_speed[False-True-False-False-True] 51.2550μs 17.7247μs 56.4186 KOps/s 58.7353 KOps/s $\color{#d91a1a}-3.94\%$
test_step_mdp_speed[False-True-False-False-False] 61.4950μs 11.3432μs 88.1582 KOps/s 88.9342 KOps/s $\color{#d91a1a}-0.87\%$
test_step_mdp_speed[False-False-True-True-True] 75.4410μs 27.0088μs 37.0249 KOps/s 37.9986 KOps/s $\color{#d91a1a}-2.56\%$
test_step_mdp_speed[False-False-True-True-False] 44.2920μs 18.1422μs 55.1200 KOps/s 55.1900 KOps/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[False-False-True-False-True] 40.1840μs 17.6265μs 56.7328 KOps/s 58.2995 KOps/s $\color{#d91a1a}-2.69\%$
test_step_mdp_speed[False-False-True-False-False] 49.3020μs 11.4643μs 87.2274 KOps/s 89.4344 KOps/s $\color{#d91a1a}-2.47\%$
test_step_mdp_speed[False-False-False-True-True] 61.9450μs 27.9129μs 35.8258 KOps/s 36.5122 KOps/s $\color{#d91a1a}-1.88\%$
test_step_mdp_speed[False-False-False-True-False] 44.0520μs 19.0925μs 52.3765 KOps/s 52.0664 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-False-False-False-True] 46.3260μs 18.5934μs 53.7826 KOps/s 55.5030 KOps/s $\color{#d91a1a}-3.10\%$
test_step_mdp_speed[False-False-False-False-False] 35.3970μs 12.4447μs 80.3558 KOps/s 81.5457 KOps/s $\color{#d91a1a}-1.46\%$
test_values[generalized_advantage_estimate-True-True] 10.1243ms 9.3760ms 106.6548 Ops/s 103.9014 Ops/s $\color{#35bf28}+2.65\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.0260ms 33.5522ms 29.8043 Ops/s 28.0544 Ops/s $\textbf{\color{#35bf28}+6.24\%}$
test_values[td0_return_estimate-False-False] 0.2434ms 0.1785ms 5.6016 KOps/s 5.3567 KOps/s $\color{#35bf28}+4.57\%$
test_values[td1_return_estimate-False-False] 23.8777ms 23.3807ms 42.7703 Ops/s 40.9808 Ops/s $\color{#35bf28}+4.37\%$
test_values[vec_td1_return_estimate-False-False] 34.8952ms 33.5894ms 29.7713 Ops/s 28.0769 Ops/s $\textbf{\color{#35bf28}+6.04\%}$
test_values[td_lambda_return_estimate-True-False] 36.6325ms 33.8781ms 29.5176 Ops/s 28.3735 Ops/s $\color{#35bf28}+4.03\%$
test_values[vec_td_lambda_return_estimate-True-False] 34.9907ms 33.5475ms 29.8085 Ops/s 28.0870 Ops/s $\textbf{\color{#35bf28}+6.13\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.6284ms 8.2459ms 121.2731 Ops/s 118.0400 Ops/s $\color{#35bf28}+2.74\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3333ms 1.9977ms 500.5755 Ops/s 519.1849 Ops/s $\color{#d91a1a}-3.58\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4359ms 0.3508ms 2.8508 KOps/s 2.7359 KOps/s $\color{#35bf28}+4.20\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 43.0977ms 41.2407ms 24.2479 Ops/s 21.2535 Ops/s $\textbf{\color{#35bf28}+14.09\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.7195ms 3.0331ms 329.6930 Ops/s 316.6665 Ops/s $\color{#35bf28}+4.11\%$
test_dqn_speed 7.0612ms 1.4068ms 710.8466 Ops/s 683.2798 Ops/s $\color{#35bf28}+4.03\%$
test_ddpg_speed 3.4146ms 2.7566ms 362.7694 Ops/s 359.6882 Ops/s $\color{#35bf28}+0.86\%$
test_sac_speed 9.5881ms 8.5559ms 116.8780 Ops/s 108.4685 Ops/s $\textbf{\color{#35bf28}+7.75\%}$
test_redq_speed 93.7628ms 14.6411ms 68.3011 Ops/s 73.2146 Ops/s $\textbf{\color{#d91a1a}-6.71\%}$
test_redq_deprec_speed 15.2696ms 13.9233ms 71.8219 Ops/s 71.0055 Ops/s $\color{#35bf28}+1.15\%$
test_td3_speed 10.5591ms 8.4670ms 118.1060 Ops/s 118.5213 Ops/s $\color{#d91a1a}-0.35\%$
test_cql_speed 39.8386ms 37.4007ms 26.7375 Ops/s 26.7905 Ops/s $\color{#d91a1a}-0.20\%$
test_a2c_speed 11.7556ms 7.8237ms 127.8176 Ops/s 127.0980 Ops/s $\color{#35bf28}+0.57\%$
test_ppo_speed 8.3707ms 7.9245ms 126.1904 Ops/s 124.0037 Ops/s $\color{#35bf28}+1.76\%$
test_reinforce_speed 7.7301ms 6.6182ms 151.0987 Ops/s 148.6455 Ops/s $\color{#35bf28}+1.65\%$
test_iql_speed 33.7979ms 32.8077ms 30.4807 Ops/s 29.9037 Ops/s $\color{#35bf28}+1.93\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.4517ms 2.4127ms 414.4735 Ops/s 417.5931 Ops/s $\color{#d91a1a}-0.75\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.1331ms 0.5133ms 1.9481 KOps/s 1.9362 KOps/s $\color{#35bf28}+0.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.2433ms 0.4999ms 2.0005 KOps/s 2.0533 KOps/s $\color{#d91a1a}-2.57\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.5964ms 2.4911ms 401.4329 Ops/s 400.4550 Ops/s $\color{#35bf28}+0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0678ms 0.5087ms 1.9656 KOps/s 1.8817 KOps/s $\color{#35bf28}+4.46\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6598ms 0.4899ms 2.0411 KOps/s 1.9815 KOps/s $\color{#35bf28}+3.01\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6608ms 1.2236ms 817.2812 Ops/s 801.3808 Ops/s $\color{#35bf28}+1.98\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.0409ms 1.1640ms 859.1293 Ops/s 848.4121 Ops/s $\color{#35bf28}+1.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.7462ms 2.5649ms 389.8820 Ops/s 384.3418 Ops/s $\color{#35bf28}+1.44\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7762ms 0.6374ms 1.5689 KOps/s 1.5573 KOps/s $\color{#35bf28}+0.74\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.7070ms 0.6073ms 1.6465 KOps/s 1.6224 KOps/s $\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9077ms 2.4505ms 408.0854 Ops/s 402.7526 Ops/s $\color{#35bf28}+1.32\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7419ms 0.5212ms 1.9188 KOps/s 1.9109 KOps/s $\color{#35bf28}+0.41\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.6540ms 0.4908ms 2.0375 KOps/s 2.0174 KOps/s $\color{#35bf28}+1.00\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.6426ms 2.4168ms 413.7779 Ops/s 404.7338 Ops/s $\color{#35bf28}+2.23\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.2393ms 0.5027ms 1.9894 KOps/s 1.9223 KOps/s $\color{#35bf28}+3.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6517ms 0.4848ms 2.0628 KOps/s 2.0128 KOps/s $\color{#35bf28}+2.49\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0761ms 2.4821ms 402.8816 Ops/s 384.2985 Ops/s $\color{#35bf28}+4.84\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9294ms 0.6215ms 1.6089 KOps/s 1.5289 KOps/s $\textbf{\color{#35bf28}+5.24\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.6380ms 0.6070ms 1.6474 KOps/s 1.6228 KOps/s $\color{#35bf28}+1.52\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1163s 7.9692ms 125.4829 Ops/s 119.2327 Ops/s $\textbf{\color{#35bf28}+5.24\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.3387ms 12.1114ms 82.5667 Ops/s 80.6175 Ops/s $\color{#35bf28}+2.42\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.7190ms 1.0598ms 943.5787 Ops/s 878.4310 Ops/s $\textbf{\color{#35bf28}+7.42\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1102s 5.8153ms 171.9604 Ops/s 168.8049 Ops/s $\color{#35bf28}+1.87\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.8549ms 12.3472ms 80.9900 Ops/s 67.4649 Ops/s $\textbf{\color{#35bf28}+20.05\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.7438ms 1.0600ms 943.3717 Ops/s 845.5017 Ops/s $\textbf{\color{#35bf28}+11.58\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1083s 8.2206ms 121.6461 Ops/s 158.8985 Ops/s $\textbf{\color{#d91a1a}-23.44\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 15.4973ms 12.5406ms 79.7411 Ops/s 77.0793 Ops/s $\color{#35bf28}+3.45\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.8989ms 1.3662ms 731.9578 Ops/s 692.6331 Ops/s $\textbf{\color{#35bf28}+5.68\%}$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. quality code quality
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot