Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Refactor README #2352

Merged
merged 1 commit into from
Aug 3, 2024
Merged

[Doc] Refactor README #2352

merged 1 commit into from
Aug 3, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Aug 3, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Aug 3, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2352

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 1 Cancelled Job, 16 Unrelated Failures

As of commit b57d37e with merge base 3267533 (image):

NEW FAILURES - The following jobs have failed:

CANCELLED JOB - The following job was cancelled. Please retry:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 3, 2024
@vmoens vmoens added the documentation Improvements or additions to documentation label Aug 3, 2024
@vmoens vmoens merged commit 829a9a2 into main Aug 3, 2024
41 of 57 checks passed
@vmoens vmoens deleted the upgrade-readme branch August 3, 2024 20:53
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 3, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 61.4793ms 58.3034ms 17.1517 Ops/s 17.1134 Ops/s $\color{#35bf28}+0.22\%$
test_sync 39.6389ms 32.5362ms 30.7350 Ops/s 30.8949 Ops/s $\color{#d91a1a}-0.52\%$
test_async 49.9269ms 29.8765ms 33.4711 Ops/s 33.4082 Ops/s $\color{#35bf28}+0.19\%$
test_simple 0.4789s 0.4101s 2.4382 Ops/s 2.4054 Ops/s $\color{#35bf28}+1.36\%$
test_transformed 0.6362s 0.5702s 1.7539 Ops/s 1.7422 Ops/s $\color{#35bf28}+0.67\%$
test_serial 1.3354s 1.2741s 0.7849 Ops/s 0.7908 Ops/s $\color{#d91a1a}-0.75\%$
test_parallel 1.1668s 1.1073s 0.9031 Ops/s 0.9053 Ops/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[True-True-True-True-True] 0.1570ms 24.1366μs 41.4309 KOps/s 40.9710 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[True-True-True-True-False] 51.5670μs 14.1590μs 70.6264 KOps/s 71.1578 KOps/s $\color{#d91a1a}-0.75\%$
test_step_mdp_speed[True-True-True-False-True] 45.2440μs 13.9588μs 71.6396 KOps/s 71.7641 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[True-True-True-False-False] 36.8890μs 8.0882μs 123.6371 KOps/s 121.8560 KOps/s $\color{#35bf28}+1.46\%$
test_step_mdp_speed[True-True-False-True-True] 58.7700μs 25.4608μs 39.2761 KOps/s 38.3421 KOps/s $\color{#35bf28}+2.44\%$
test_step_mdp_speed[True-True-False-True-False] 52.7490μs 15.4931μs 64.5449 KOps/s 64.5553 KOps/s $\color{#d91a1a}-0.02\%$
test_step_mdp_speed[True-True-False-False-True] 39.9450μs 15.4796μs 64.6013 KOps/s 65.1314 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[True-True-False-False-False] 33.2530μs 9.5368μs 104.8566 KOps/s 103.6496 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[True-False-True-True-True] 55.9850μs 27.1952μs 36.7712 KOps/s 36.5109 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-False-True-True-False] 41.5180μs 16.8610μs 59.3085 KOps/s 58.8646 KOps/s $\color{#35bf28}+0.75\%$
test_step_mdp_speed[True-False-True-False-True] 49.5630μs 15.3892μs 64.9807 KOps/s 65.5404 KOps/s $\color{#d91a1a}-0.85\%$
test_step_mdp_speed[True-False-True-False-False] 46.4470μs 9.5625μs 104.5752 KOps/s 104.4290 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-False-False-True-True] 68.3580μs 28.6127μs 34.9495 KOps/s 34.9714 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-False-False-True-False] 53.6600μs 18.3806μs 54.4052 KOps/s 54.3226 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[True-False-False-False-True] 41.3470μs 16.8161μs 59.4667 KOps/s 60.0392 KOps/s $\color{#d91a1a}-0.95\%$
test_step_mdp_speed[True-False-False-False-False] 36.3570μs 10.8135μs 92.4766 KOps/s 90.6325 KOps/s $\color{#35bf28}+2.03\%$
test_step_mdp_speed[False-True-True-True-True] 63.4490μs 27.0455μs 36.9748 KOps/s 36.7818 KOps/s $\color{#35bf28}+0.52\%$
test_step_mdp_speed[False-True-True-True-False] 50.6850μs 17.1804μs 58.2060 KOps/s 58.1578 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-True-True-False-True] 48.8210μs 17.7564μs 56.3179 KOps/s 56.1663 KOps/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[False-True-True-False-False] 59.7520μs 10.7500μs 93.0231 KOps/s 92.3287 KOps/s $\color{#35bf28}+0.75\%$
test_step_mdp_speed[False-True-False-True-True] 69.8510μs 27.9940μs 35.7220 KOps/s 34.9763 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[False-True-False-True-False] 86.4420μs 18.2618μs 54.7590 KOps/s 53.5241 KOps/s $\color{#35bf28}+2.31\%$
test_step_mdp_speed[False-True-False-False-True] 64.7010μs 19.0354μs 52.5336 KOps/s 52.2374 KOps/s $\color{#35bf28}+0.57\%$
test_step_mdp_speed[False-True-False-False-False] 58.2190μs 12.0234μs 83.1710 KOps/s 81.1759 KOps/s $\color{#35bf28}+2.46\%$
test_step_mdp_speed[False-False-True-True-True] 3.3588ms 30.0890μs 33.2347 KOps/s 33.2355 KOps/s $-0.00\%$
test_step_mdp_speed[False-False-True-True-False] 51.6760μs 19.7968μs 50.5131 KOps/s 49.6400 KOps/s $\color{#35bf28}+1.76\%$
test_step_mdp_speed[False-False-True-False-True] 68.3570μs 19.1577μs 52.1983 KOps/s 51.8340 KOps/s $\color{#35bf28}+0.70\%$
test_step_mdp_speed[False-False-True-False-False] 41.1070μs 12.0742μs 82.8211 KOps/s 81.6698 KOps/s $\color{#35bf28}+1.41\%$
test_step_mdp_speed[False-False-False-True-True] 72.7970μs 31.1896μs 32.0619 KOps/s 31.9274 KOps/s $\color{#35bf28}+0.42\%$
test_step_mdp_speed[False-False-False-True-False] 63.5290μs 21.0088μs 47.5991 KOps/s 47.1521 KOps/s $\color{#35bf28}+0.95\%$
test_step_mdp_speed[False-False-False-False-True] 53.8800μs 20.0920μs 49.7710 KOps/s 49.2883 KOps/s $\color{#35bf28}+0.98\%$
test_step_mdp_speed[False-False-False-False-False] 39.6840μs 13.4015μs 74.6186 KOps/s 74.2076 KOps/s $\color{#35bf28}+0.55\%$
test_values[generalized_advantage_estimate-True-True] 12.6752ms 9.6820ms 103.2842 Ops/s 105.4923 Ops/s $\color{#d91a1a}-2.09\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.9572ms 36.0501ms 27.7392 Ops/s 28.2218 Ops/s $\color{#d91a1a}-1.71\%$
test_values[td0_return_estimate-False-False] 0.2289ms 0.1629ms 6.1398 KOps/s 6.0490 KOps/s $\color{#35bf28}+1.50\%$
test_values[td1_return_estimate-False-False] 24.2472ms 23.7365ms 42.1292 Ops/s 42.3286 Ops/s $\color{#d91a1a}-0.47\%$
test_values[vec_td1_return_estimate-False-False] 38.6068ms 36.1796ms 27.6399 Ops/s 28.1828 Ops/s $\color{#d91a1a}-1.93\%$
test_values[td_lambda_return_estimate-True-False] 37.5556ms 34.4100ms 29.0614 Ops/s 29.3118 Ops/s $\color{#d91a1a}-0.85\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.5393ms 36.2641ms 27.5755 Ops/s 28.0932 Ops/s $\color{#d91a1a}-1.84\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.7448ms 8.5149ms 117.4405 Ops/s 120.7320 Ops/s $\color{#d91a1a}-2.73\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3641ms 1.9484ms 513.2361 Ops/s 522.5254 Ops/s $\color{#d91a1a}-1.78\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4348ms 0.3613ms 2.7675 KOps/s 2.7825 KOps/s $\color{#d91a1a}-0.54\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 48.3340ms 47.2536ms 21.1624 Ops/s 21.1785 Ops/s $\color{#d91a1a}-0.08\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.8911ms 3.0405ms 328.8894 Ops/s 329.6086 Ops/s $\color{#d91a1a}-0.22\%$
test_dqn_speed 6.2782ms 1.3018ms 768.1456 Ops/s 781.1445 Ops/s $\color{#d91a1a}-1.66\%$
test_ddpg_speed 3.5377ms 2.7210ms 367.5100 Ops/s 373.5741 Ops/s $\color{#d91a1a}-1.62\%$
test_sac_speed 8.5935ms 8.0537ms 124.1666 Ops/s 127.0822 Ops/s $\color{#d91a1a}-2.29\%$
test_redq_speed 14.4242ms 12.6707ms 78.9221 Ops/s 79.4111 Ops/s $\color{#d91a1a}-0.62\%$
test_redq_deprec_speed 14.4703ms 12.7849ms 78.2170 Ops/s 79.8023 Ops/s $\color{#d91a1a}-1.99\%$
test_td3_speed 8.2655ms 7.9136ms 126.3644 Ops/s 128.7423 Ops/s $\color{#d91a1a}-1.85\%$
test_cql_speed 36.6586ms 35.2807ms 28.3441 Ops/s 28.1371 Ops/s $\color{#35bf28}+0.74\%$
test_a2c_speed 8.7835ms 7.2434ms 138.0571 Ops/s 138.7661 Ops/s $\color{#d91a1a}-0.51\%$
test_ppo_speed 8.8379ms 7.5230ms 132.9263 Ops/s 132.8572 Ops/s $\color{#35bf28}+0.05\%$
test_reinforce_speed 7.5998ms 6.4364ms 155.3669 Ops/s 156.2115 Ops/s $\color{#d91a1a}-0.54\%$
test_iql_speed 33.2484ms 31.8469ms 31.4002 Ops/s 31.5539 Ops/s $\color{#d91a1a}-0.49\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.2329ms 4.7442ms 210.7858 Ops/s 211.8949 Ops/s $\color{#d91a1a}-0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8933ms 0.4785ms 2.0898 KOps/s 2.1030 KOps/s $\color{#d91a1a}-0.63\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6677ms 0.4504ms 2.2205 KOps/s 2.2114 KOps/s $\color{#35bf28}+0.41\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.0919ms 4.7299ms 211.4225 Ops/s 212.6292 Ops/s $\color{#d91a1a}-0.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8472ms 0.4761ms 2.1003 KOps/s 2.1336 KOps/s $\color{#d91a1a}-1.56\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6131ms 0.4458ms 2.2429 KOps/s 2.2313 KOps/s $\color{#35bf28}+0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.2152ms 1.6946ms 590.1240 Ops/s 596.6913 Ops/s $\color{#d91a1a}-1.10\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.1236ms 1.6051ms 623.0215 Ops/s 630.4365 Ops/s $\color{#d91a1a}-1.18\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.1342ms 4.8859ms 204.6695 Ops/s 203.0940 Ops/s $\color{#35bf28}+0.78\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8208ms 0.6176ms 1.6193 KOps/s 1.6301 KOps/s $\color{#d91a1a}-0.66\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9650ms 0.5985ms 1.6708 KOps/s 1.6645 KOps/s $\color{#35bf28}+0.38\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.6043ms 4.8698ms 205.3479 Ops/s 204.6226 Ops/s $\color{#35bf28}+0.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7587ms 0.4886ms 2.0466 KOps/s 2.0882 KOps/s $\color{#d91a1a}-1.99\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6540ms 0.4594ms 2.1767 KOps/s 2.2248 KOps/s $\color{#d91a1a}-2.16\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.1230ms 4.7878ms 208.8634 Ops/s 212.2499 Ops/s $\color{#d91a1a}-1.60\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.4477ms 0.4806ms 2.0809 KOps/s 2.1153 KOps/s $\color{#d91a1a}-1.63\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6282ms 0.4588ms 2.1796 KOps/s 2.2528 KOps/s $\color{#d91a1a}-3.25\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.3936ms 5.0925ms 196.3690 Ops/s 207.3025 Ops/s $\textbf{\color{#d91a1a}-5.27\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8471ms 0.6243ms 1.6017 KOps/s 1.6418 KOps/s $\color{#d91a1a}-2.44\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 7.1541ms 0.6054ms 1.6518 KOps/s 1.7234 KOps/s $\color{#d91a1a}-4.16\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1185s 8.0124ms 124.8065 Ops/s 168.0489 Ops/s $\textbf{\color{#d91a1a}-25.73\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 19.1972ms 12.9925ms 76.9677 Ops/s 78.3135 Ops/s $\color{#d91a1a}-1.72\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.6169ms 1.0888ms 918.4345 Ops/s 882.0170 Ops/s $\color{#35bf28}+4.13\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1050s 5.8199ms 171.8235 Ops/s 174.9436 Ops/s $\color{#d91a1a}-1.78\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.1438ms 12.9158ms 77.4244 Ops/s 67.7448 Ops/s $\textbf{\color{#35bf28}+14.29\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.8257ms 1.0907ms 916.8332 Ops/s 902.5216 Ops/s $\color{#35bf28}+1.59\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1040s 5.9231ms 168.8297 Ops/s 169.8225 Ops/s $\color{#d91a1a}-0.58\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.3054ms 13.0976ms 76.3498 Ops/s 77.8099 Ops/s $\color{#d91a1a}-1.88\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 5.0945ms 1.3201ms 757.4966 Ops/s 735.3512 Ops/s $\color{#35bf28}+3.01\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 3, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1079s 0.1052s 9.5068 Ops/s 9.3891 Ops/s $\color{#35bf28}+1.25\%$
test_sync 99.9030ms 94.0954ms 10.6275 Ops/s 10.9858 Ops/s $\color{#d91a1a}-3.26\%$
test_async 0.2591s 90.6651ms 11.0296 Ops/s 11.5188 Ops/s $\color{#d91a1a}-4.25\%$
test_single_pixels 0.1154s 0.1153s 8.6750 Ops/s 8.5640 Ops/s $\color{#35bf28}+1.30\%$
test_sync_pixels 76.8005ms 75.1216ms 13.3118 Ops/s 13.1358 Ops/s $\color{#35bf28}+1.34\%$
test_async_pixels 0.1423s 70.4103ms 14.2025 Ops/s 14.1502 Ops/s $\color{#35bf28}+0.37\%$
test_simple 0.7757s 0.7563s 1.3223 Ops/s 1.2822 Ops/s $\color{#35bf28}+3.13\%$
test_transformed 1.0711s 0.9979s 1.0021 Ops/s 1.0063 Ops/s $\color{#d91a1a}-0.41\%$
test_serial 2.2499s 2.1716s 0.4605 Ops/s 0.4572 Ops/s $\color{#35bf28}+0.72\%$
test_parallel 1.9325s 1.8771s 0.5327 Ops/s 0.5289 Ops/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-True-True-True-True] 0.1108ms 35.5889μs 28.0986 KOps/s 27.2134 KOps/s $\color{#35bf28}+3.25\%$
test_step_mdp_speed[True-True-True-True-False] 36.0310μs 20.2480μs 49.3877 KOps/s 47.7944 KOps/s $\color{#35bf28}+3.33\%$
test_step_mdp_speed[True-True-True-False-True] 36.0010μs 19.9415μs 50.1468 KOps/s 48.2532 KOps/s $\color{#35bf28}+3.92\%$
test_step_mdp_speed[True-True-True-False-False] 30.9100μs 11.6368μs 85.9340 KOps/s 84.8552 KOps/s $\color{#35bf28}+1.27\%$
test_step_mdp_speed[True-True-False-True-True] 65.5010μs 37.6135μs 26.5862 KOps/s 25.7603 KOps/s $\color{#35bf28}+3.21\%$
test_step_mdp_speed[True-True-False-True-False] 37.6110μs 22.2534μs 44.9370 KOps/s 43.4568 KOps/s $\color{#35bf28}+3.41\%$
test_step_mdp_speed[True-True-False-False-True] 39.9210μs 22.4513μs 44.5409 KOps/s 44.5199 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-True-False-False-False] 52.3810μs 13.8278μs 72.3180 KOps/s 71.6641 KOps/s $\color{#35bf28}+0.91\%$
test_step_mdp_speed[True-False-True-True-True] 73.7410μs 40.3706μs 24.7705 KOps/s 24.5162 KOps/s $\color{#35bf28}+1.04\%$
test_step_mdp_speed[True-False-True-True-False] 50.3810μs 24.7312μs 40.4347 KOps/s 39.6764 KOps/s $\color{#35bf28}+1.91\%$
test_step_mdp_speed[True-False-True-False-True] 37.2700μs 21.7319μs 46.0154 KOps/s 44.7653 KOps/s $\color{#35bf28}+2.79\%$
test_step_mdp_speed[True-False-True-False-False] 37.6300μs 13.5304μs 73.9076 KOps/s 72.3471 KOps/s $\color{#35bf28}+2.16\%$
test_step_mdp_speed[True-False-False-True-True] 59.3900μs 41.3288μs 24.1962 KOps/s 23.7353 KOps/s $\color{#35bf28}+1.94\%$
test_step_mdp_speed[True-False-False-True-False] 42.5410μs 26.4453μs 37.8139 KOps/s 36.7814 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[True-False-False-False-True] 43.4100μs 23.9943μs 41.6766 KOps/s 40.9456 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[True-False-False-False-False] 52.9300μs 15.6265μs 63.9940 KOps/s 62.3188 KOps/s $\color{#35bf28}+2.69\%$
test_step_mdp_speed[False-True-True-True-True] 58.2300μs 39.5688μs 25.2725 KOps/s 24.5599 KOps/s $\color{#35bf28}+2.90\%$
test_step_mdp_speed[False-True-True-True-False] 43.5800μs 24.6222μs 40.6138 KOps/s 39.3032 KOps/s $\color{#35bf28}+3.33\%$
test_step_mdp_speed[False-True-True-False-True] 47.7310μs 26.5390μs 37.6803 KOps/s 36.8957 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[False-True-True-False-False] 32.8700μs 15.5926μs 64.1330 KOps/s 62.7376 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[False-True-False-True-True] 65.9810μs 41.1964μs 24.2740 KOps/s 23.3974 KOps/s $\color{#35bf28}+3.75\%$
test_step_mdp_speed[False-True-False-True-False] 43.9410μs 26.8132μs 37.2951 KOps/s 36.8671 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-True-False-False-True] 57.8900μs 28.0184μs 35.6908 KOps/s 34.4841 KOps/s $\color{#35bf28}+3.50\%$
test_step_mdp_speed[False-True-False-False-False] 41.5400μs 17.5825μs 56.8747 KOps/s 55.7521 KOps/s $\color{#35bf28}+2.01\%$
test_step_mdp_speed[False-False-True-True-True] 4.1603ms 44.9014μs 22.2710 KOps/s 21.9193 KOps/s $\color{#35bf28}+1.60\%$
test_step_mdp_speed[False-False-True-True-False] 55.1610μs 28.9736μs 34.5142 KOps/s 33.5722 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[False-False-True-False-True] 51.8310μs 28.3158μs 35.3159 KOps/s 34.6260 KOps/s $\color{#35bf28}+1.99\%$
test_step_mdp_speed[False-False-True-False-False] 31.8400μs 17.6670μs 56.6026 KOps/s 54.9238 KOps/s $\color{#35bf28}+3.06\%$
test_step_mdp_speed[False-False-False-True-True] 65.1410μs 45.4078μs 22.0227 KOps/s 21.3488 KOps/s $\color{#35bf28}+3.16\%$
test_step_mdp_speed[False-False-False-True-False] 54.4410μs 30.7965μs 32.4712 KOps/s 31.3683 KOps/s $\color{#35bf28}+3.52\%$
test_step_mdp_speed[False-False-False-False-True] 54.0910μs 29.7832μs 33.5760 KOps/s 32.9740 KOps/s $\color{#35bf28}+1.83\%$
test_step_mdp_speed[False-False-False-False-False] 35.1610μs 19.3598μs 51.6535 KOps/s 50.9407 KOps/s $\color{#35bf28}+1.40\%$
test_values[generalized_advantage_estimate-True-True] 25.1249ms 24.5825ms 40.6793 Ops/s 40.8691 Ops/s $\color{#d91a1a}-0.46\%$
test_values[vec_generalized_advantage_estimate-True-True] 88.5638ms 2.6731ms 374.0992 Ops/s 372.1432 Ops/s $\color{#35bf28}+0.53\%$
test_values[td0_return_estimate-False-False] 90.4920μs 66.6219μs 15.0101 KOps/s 14.9524 KOps/s $\color{#35bf28}+0.39\%$
test_values[td1_return_estimate-False-False] 55.6029ms 55.1906ms 18.1190 Ops/s 18.1717 Ops/s $\color{#d91a1a}-0.29\%$
test_values[vec_td1_return_estimate-False-False] 1.3806ms 1.0930ms 914.8747 Ops/s 916.2671 Ops/s $\color{#d91a1a}-0.15\%$
test_values[td_lambda_return_estimate-True-False] 88.7287ms 87.9921ms 11.3647 Ops/s 11.4557 Ops/s $\color{#d91a1a}-0.79\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.4060ms 1.0912ms 916.4357 Ops/s 917.4829 Ops/s $\color{#d91a1a}-0.11\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.7865ms 24.6477ms 40.5717 Ops/s 40.7922 Ops/s $\color{#d91a1a}-0.54\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9454ms 0.7254ms 1.3786 KOps/s 1.3800 KOps/s $\color{#d91a1a}-0.10\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7640ms 0.6771ms 1.4769 KOps/s 1.4808 KOps/s $\color{#d91a1a}-0.26\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4993ms 1.4720ms 679.3357 Ops/s 680.2511 Ops/s $\color{#d91a1a}-0.13\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7367ms 0.6934ms 1.4421 KOps/s 1.4479 KOps/s $\color{#d91a1a}-0.40\%$
test_dqn_speed 7.3853ms 1.3417ms 745.3081 Ops/s 736.9243 Ops/s $\color{#35bf28}+1.14\%$
test_ddpg_speed 3.1479ms 2.7044ms 369.7743 Ops/s 363.2884 Ops/s $\color{#35bf28}+1.79\%$
test_sac_speed 8.3652ms 7.7973ms 128.2495 Ops/s 126.0259 Ops/s $\color{#35bf28}+1.76\%$
test_redq_speed 11.0032ms 9.9333ms 100.6718 Ops/s 98.0889 Ops/s $\color{#35bf28}+2.63\%$
test_redq_deprec_speed 10.8552ms 10.5748ms 94.5643 Ops/s 91.6284 Ops/s $\color{#35bf28}+3.20\%$
test_td3_speed 8.1705ms 7.7572ms 128.9126 Ops/s 127.2044 Ops/s $\color{#35bf28}+1.34\%$
test_cql_speed 25.3050ms 24.5748ms 40.6921 Ops/s 39.9612 Ops/s $\color{#35bf28}+1.83\%$
test_a2c_speed 5.6774ms 5.4316ms 184.1090 Ops/s 179.3956 Ops/s $\color{#35bf28}+2.63\%$
test_ppo_speed 6.1044ms 5.7633ms 173.5130 Ops/s 170.0836 Ops/s $\color{#35bf28}+2.02\%$
test_reinforce_speed 4.5507ms 4.4085ms 226.8367 Ops/s 219.6577 Ops/s $\color{#35bf28}+3.27\%$
test_iql_speed 19.8614ms 19.2946ms 51.8280 Ops/s 51.2146 Ops/s $\color{#35bf28}+1.20\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.6154ms 6.5190ms 153.3976 Ops/s 150.6579 Ops/s $\color{#35bf28}+1.82\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8243ms 0.5108ms 1.9576 KOps/s 1.9405 KOps/s $\color{#35bf28}+0.88\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6799ms 0.4901ms 2.0405 KOps/s 2.0210 KOps/s $\color{#35bf28}+0.96\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.6483ms 6.4114ms 155.9713 Ops/s 153.2192 Ops/s $\color{#35bf28}+1.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.7494ms 0.5048ms 1.9810 KOps/s 1.9619 KOps/s $\color{#35bf28}+0.98\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6496ms 0.4867ms 2.0547 KOps/s 2.0518 KOps/s $\color{#35bf28}+0.14\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.0764ms 1.9540ms 511.7739 Ops/s 504.5256 Ops/s $\color{#35bf28}+1.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.0710ms 1.8618ms 537.1229 Ops/s 526.6468 Ops/s $\color{#35bf28}+1.99\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.8327ms 6.6869ms 149.5468 Ops/s 147.2535 Ops/s $\color{#35bf28}+1.56\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1247ms 0.6692ms 1.4943 KOps/s 1.5001 KOps/s $\color{#d91a1a}-0.39\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.5459ms 0.7185ms 1.3918 KOps/s 1.5571 KOps/s $\textbf{\color{#d91a1a}-10.61\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.5784ms 6.5245ms 153.2680 Ops/s 149.8076 Ops/s $\color{#35bf28}+2.31\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9888ms 0.5096ms 1.9622 KOps/s 1.9346 KOps/s $\color{#35bf28}+1.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7511ms 0.4883ms 2.0478 KOps/s 2.0225 KOps/s $\color{#35bf28}+1.25\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.6975ms 6.4392ms 155.2985 Ops/s 152.1080 Ops/s $\color{#35bf28}+2.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1245s 0.6752ms 1.4811 KOps/s 1.9496 KOps/s $\textbf{\color{#d91a1a}-24.03\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7527ms 0.4835ms 2.0684 KOps/s 2.0077 KOps/s $\color{#35bf28}+3.02\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.7877ms 6.6849ms 149.5910 Ops/s 146.6196 Ops/s $\color{#35bf28}+2.03\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7889ms 0.6593ms 1.5168 KOps/s 1.2151 KOps/s $\textbf{\color{#35bf28}+24.83\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.4580ms 0.6429ms 1.5555 KOps/s 1.5581 KOps/s $\color{#d91a1a}-0.16\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1287s 7.5899ms 131.7542 Ops/s 131.9884 Ops/s $\color{#d91a1a}-0.18\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.2366ms 15.7929ms 63.3196 Ops/s 61.2395 Ops/s $\color{#35bf28}+3.40\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1723ms 1.2353ms 809.5457 Ops/s 769.2577 Ops/s $\textbf{\color{#35bf28}+5.24\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1235s 7.5125ms 133.1114 Ops/s 131.9154 Ops/s $\color{#35bf28}+0.91\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1359s 18.5754ms 53.8348 Ops/s 61.6261 Ops/s $\textbf{\color{#d91a1a}-12.64\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.0002ms 1.3570ms 736.8956 Ops/s 791.6871 Ops/s $\textbf{\color{#d91a1a}-6.92\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1236s 7.7450ms 129.1164 Ops/s 129.0911 Ops/s $\color{#35bf28}+0.02\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 19.3862ms 16.6767ms 59.9640 Ops/s 60.0722 Ops/s $\color{#d91a1a}-0.18\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.4298ms 1.5010ms 666.2299 Ops/s 686.4697 Ops/s $\color{#d91a1a}-2.95\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot