Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Fix discord link #1712

Merged
merged 2 commits into from
Nov 24, 2023
Merged

[Doc] Fix discord link #1712

merged 2 commits into from
Nov 24, 2023

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Nov 24, 2023 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Nov 24, 2023 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1712

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 34 Unrelated Failures

As of commit 9b0a05f with merge base c2edf35 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 24, 2023
@vmoens vmoens marked this pull request as ready for review November 24, 2023 10:06
@vmoens vmoens merged commit fa149e4 into main Nov 24, 2023
14 of 40 checks passed
@vmoens vmoens deleted the reset-discord-link branch November 24, 2023 10:07
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}10$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 63.9930ms 62.4943ms 16.0015 Ops/s 15.1567 Ops/s $\textbf{\color{#35bf28}+5.57\%}$
test_sync 39.6437ms 34.5054ms 28.9810 Ops/s 28.8217 Ops/s $\color{#35bf28}+0.55\%$
test_async 64.9286ms 32.5756ms 30.6979 Ops/s 29.5572 Ops/s $\color{#35bf28}+3.86\%$
test_simple 0.4967s 0.4543s 2.2013 Ops/s 2.2685 Ops/s $\color{#d91a1a}-2.96\%$
test_transformed 0.6575s 0.6108s 1.6373 Ops/s 1.6412 Ops/s $\color{#d91a1a}-0.24\%$
test_serial 1.3464s 1.2966s 0.7712 Ops/s 0.7593 Ops/s $\color{#35bf28}+1.57\%$
test_parallel 1.3611s 1.3185s 0.7585 Ops/s 0.7536 Ops/s $\color{#35bf28}+0.64\%$
test_step_mdp_speed[True-True-True-True-True] 0.1389ms 22.6097μs 44.2288 KOps/s 43.0232 KOps/s $\color{#35bf28}+2.80\%$
test_step_mdp_speed[True-True-True-True-False] 35.1860μs 13.7341μs 72.8112 KOps/s 71.4450 KOps/s $\color{#35bf28}+1.91\%$
test_step_mdp_speed[True-True-True-False-True] 42.2290μs 14.1328μs 70.7573 KOps/s 70.6796 KOps/s $\color{#35bf28}+0.11\%$
test_step_mdp_speed[True-True-True-False-False] 31.1680μs 8.3456μs 119.8243 KOps/s 116.5248 KOps/s $\color{#35bf28}+2.83\%$
test_step_mdp_speed[True-True-False-True-True] 56.9380μs 24.6499μs 40.5681 KOps/s 40.4805 KOps/s $\color{#35bf28}+0.22\%$
test_step_mdp_speed[True-True-False-True-False] 38.4520μs 15.2308μs 65.6563 KOps/s 65.2020 KOps/s $\color{#35bf28}+0.70\%$
test_step_mdp_speed[True-True-False-False-True] 42.2690μs 15.5064μs 64.4896 KOps/s 64.4930 KOps/s $-0.01\%$
test_step_mdp_speed[True-True-False-False-False] 44.3320μs 9.7974μs 102.0680 KOps/s 99.9300 KOps/s $\color{#35bf28}+2.14\%$
test_step_mdp_speed[True-False-True-True-True] 75.9420μs 26.0269μs 38.4218 KOps/s 38.5267 KOps/s $\color{#d91a1a}-0.27\%$
test_step_mdp_speed[True-False-True-True-False] 51.3370μs 16.6907μs 59.9137 KOps/s 58.6681 KOps/s $\color{#35bf28}+2.12\%$
test_step_mdp_speed[True-False-True-False-True] 43.7120μs 15.3025μs 65.3490 KOps/s 65.3492 KOps/s $-0.00\%$
test_step_mdp_speed[True-False-True-False-False] 34.2940μs 9.7114μs 102.9715 KOps/s 100.9386 KOps/s $\color{#35bf28}+2.01\%$
test_step_mdp_speed[True-False-False-True-True] 63.9700μs 27.2129μs 36.7472 KOps/s 36.8242 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[True-False-False-True-False] 45.0550μs 17.8084μs 56.1533 KOps/s 55.1995 KOps/s $\color{#35bf28}+1.73\%$
test_step_mdp_speed[True-False-False-False-True] 46.1570μs 16.5783μs 60.3199 KOps/s 59.0141 KOps/s $\color{#35bf28}+2.21\%$
test_step_mdp_speed[True-False-False-False-False] 41.1470μs 10.9679μs 91.1748 KOps/s 90.5601 KOps/s $\color{#35bf28}+0.68\%$
test_step_mdp_speed[False-True-True-True-True] 64.4710μs 25.9066μs 38.6003 KOps/s 38.1258 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[False-True-True-True-False] 47.2690μs 16.4579μs 60.7610 KOps/s 58.9858 KOps/s $\color{#35bf28}+3.01\%$
test_step_mdp_speed[False-True-True-False-True] 56.8860μs 17.5893μs 56.8529 KOps/s 55.4962 KOps/s $\color{#35bf28}+2.44\%$
test_step_mdp_speed[False-True-True-False-False] 40.1650μs 11.0073μs 90.8492 KOps/s 89.4009 KOps/s $\color{#35bf28}+1.62\%$
test_step_mdp_speed[False-True-False-True-True] 65.8040μs 26.8863μs 37.1936 KOps/s 36.6431 KOps/s $\color{#35bf28}+1.50\%$
test_step_mdp_speed[False-True-False-True-False] 42.0490μs 17.9433μs 55.7310 KOps/s 54.8789 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-True-False-False-True] 46.6470μs 18.9893μs 52.6611 KOps/s 52.7560 KOps/s $\color{#d91a1a}-0.18\%$
test_step_mdp_speed[False-True-False-False-False] 35.1760μs 12.4090μs 80.5864 KOps/s 80.7780 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-False-True-True-True] 72.3050μs 28.4139μs 35.1940 KOps/s 34.7757 KOps/s $\color{#35bf28}+1.20\%$
test_step_mdp_speed[False-False-True-True-False] 44.9140μs 19.2515μs 51.9440 KOps/s 51.0973 KOps/s $\color{#35bf28}+1.66\%$
test_step_mdp_speed[False-False-True-False-True] 41.9480μs 18.8749μs 52.9803 KOps/s 52.0502 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[False-False-True-False-False] 35.6470μs 12.1090μs 82.5830 KOps/s 81.3347 KOps/s $\color{#35bf28}+1.53\%$
test_step_mdp_speed[False-False-False-True-True] 73.5580μs 28.9139μs 34.5854 KOps/s 33.8089 KOps/s $\color{#35bf28}+2.30\%$
test_step_mdp_speed[False-False-False-True-False] 49.1920μs 20.1506μs 49.6264 KOps/s 48.9309 KOps/s $\color{#35bf28}+1.42\%$
test_step_mdp_speed[False-False-False-False-True] 99.9400μs 19.9331μs 50.1678 KOps/s 50.2155 KOps/s $\color{#d91a1a}-0.09\%$
test_step_mdp_speed[False-False-False-False-False] 49.1520μs 13.3609μs 74.8454 KOps/s 75.1898 KOps/s $\color{#d91a1a}-0.46\%$
test_values[generalized_advantage_estimate-True-True] 12.2431ms 11.8956ms 84.0648 Ops/s 81.7695 Ops/s $\color{#35bf28}+2.81\%$
test_values[vec_generalized_advantage_estimate-True-True] 34.2076ms 26.6567ms 37.5140 Ops/s 37.7768 Ops/s $\color{#d91a1a}-0.70\%$
test_values[td0_return_estimate-False-False] 0.2497ms 0.1746ms 5.7272 KOps/s 5.7419 KOps/s $\color{#d91a1a}-0.26\%$
test_values[td1_return_estimate-False-False] 28.4594ms 25.3905ms 39.3848 Ops/s 38.6325 Ops/s $\color{#35bf28}+1.95\%$
test_values[vec_td1_return_estimate-False-False] 34.3857ms 26.6533ms 37.5188 Ops/s 37.8361 Ops/s $\color{#d91a1a}-0.84\%$
test_values[td_lambda_return_estimate-True-False] 37.8615ms 35.4972ms 28.1713 Ops/s 27.5794 Ops/s $\color{#35bf28}+2.15\%$
test_values[vec_td_lambda_return_estimate-True-False] 35.1895ms 26.7439ms 37.3917 Ops/s 37.7805 Ops/s $\color{#d91a1a}-1.03\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.1856ms 8.0535ms 124.1694 Ops/s 120.7458 Ops/s $\color{#35bf28}+2.84\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 12.3345ms 1.8793ms 532.1038 Ops/s 513.7512 Ops/s $\color{#35bf28}+3.57\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 1.1355ms 0.4284ms 2.3344 KOps/s 2.3553 KOps/s $\color{#d91a1a}-0.89\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 46.5695ms 39.7956ms 25.1284 Ops/s 25.2913 Ops/s $\color{#d91a1a}-0.64\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 10.7190ms 2.4962ms 400.6082 Ops/s 401.6306 Ops/s $\color{#d91a1a}-0.25\%$
test_dqn_speed 9.7448ms 1.4958ms 668.5447 Ops/s 660.7858 Ops/s $\color{#35bf28}+1.17\%$
test_ddpg_speed 10.9457ms 3.0675ms 325.9976 Ops/s 312.4901 Ops/s $\color{#35bf28}+4.32\%$
test_sac_speed 17.0002ms 8.9548ms 111.6719 Ops/s 110.2978 Ops/s $\color{#35bf28}+1.25\%$
test_redq_speed 22.8337ms 14.8773ms 67.2163 Ops/s 68.4523 Ops/s $\color{#d91a1a}-1.81\%$
test_redq_deprec_speed 22.3355ms 13.6143ms 73.4522 Ops/s 74.0242 Ops/s $\color{#d91a1a}-0.77\%$
test_td3_speed 9.9776ms 9.1200ms 109.6489 Ops/s 103.3303 Ops/s $\textbf{\color{#35bf28}+6.11\%}$
test_cql_speed 44.2172ms 36.7908ms 27.1807 Ops/s 26.7344 Ops/s $\color{#35bf28}+1.67\%$
test_a2c_speed 16.4024ms 7.9157ms 126.3316 Ops/s 126.5118 Ops/s $\color{#d91a1a}-0.14\%$
test_ppo_speed 16.4488ms 8.1936ms 122.0460 Ops/s 115.2994 Ops/s $\textbf{\color{#35bf28}+5.85\%}$
test_reinforce_speed 15.1659ms 7.0597ms 141.6488 Ops/s 133.9065 Ops/s $\textbf{\color{#35bf28}+5.78\%}$
test_iql_speed 40.9518ms 32.6940ms 30.5867 Ops/s 29.3937 Ops/s $\color{#35bf28}+4.06\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.3006ms 1.8342ms 545.1827 Ops/s 559.4190 Ops/s $\color{#d91a1a}-2.54\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 2.6419ms 1.8836ms 530.8937 Ops/s 466.9161 Ops/s $\textbf{\color{#35bf28}+13.70\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.1360s 2.2138ms 451.7215 Ops/s 515.8376 Ops/s $\textbf{\color{#d91a1a}-12.43\%}$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.3642ms 1.7786ms 562.2503 Ops/s 539.8966 Ops/s $\color{#35bf28}+4.14\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1030s 2.1177ms 472.2193 Ops/s 529.4865 Ops/s $\textbf{\color{#d91a1a}-10.82\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 2.7702ms 1.9544ms 511.6719 Ops/s 529.7318 Ops/s $\color{#d91a1a}-3.41\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.9523ms 1.8956ms 527.5462 Ops/s 549.5191 Ops/s $\color{#d91a1a}-4.00\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.5518ms 1.9302ms 518.0903 Ops/s 458.5174 Ops/s $\textbf{\color{#35bf28}+12.99\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 2.5586ms 1.9172ms 521.6057 Ops/s 514.0639 Ops/s $\color{#35bf28}+1.47\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.0656ms 1.8186ms 549.8620 Ops/s 550.8974 Ops/s $\color{#d91a1a}-0.19\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1152s 2.2211ms 450.2246 Ops/s 526.7071 Ops/s $\textbf{\color{#d91a1a}-14.52\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 2.5680ms 1.8806ms 531.7394 Ops/s 521.8354 Ops/s $\color{#35bf28}+1.90\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.1497ms 1.8168ms 550.4055 Ops/s 546.4202 Ops/s $\color{#35bf28}+0.73\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.9491ms 1.8952ms 527.6478 Ops/s 534.0644 Ops/s $\color{#d91a1a}-1.20\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 2.9718ms 1.9078ms 524.1564 Ops/s 528.2178 Ops/s $\color{#d91a1a}-0.77\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.9049ms 1.7784ms 562.3119 Ops/s 449.6337 Ops/s $\textbf{\color{#35bf28}+25.06\%}$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.8811ms 1.8571ms 538.4823 Ops/s 522.4500 Ops/s $\color{#35bf28}+3.07\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 2.7832ms 1.8916ms 528.6640 Ops/s 514.4991 Ops/s $\color{#35bf28}+2.75\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.2089s 19.9685ms 50.0789 Ops/s 50.2326 Ops/s $\color{#d91a1a}-0.31\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1021s 17.6197ms 56.7547 Ops/s 49.6551 Ops/s $\textbf{\color{#35bf28}+14.30\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 0.1042s 19.7017ms 50.7570 Ops/s 54.7842 Ops/s $\textbf{\color{#d91a1a}-7.35\%}$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1070s 17.9157ms 55.8169 Ops/s 56.1579 Ops/s $\color{#d91a1a}-0.61\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1018s 17.5885ms 56.8552 Ops/s 50.1167 Ops/s $\textbf{\color{#35bf28}+13.45\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.1027s 19.5840ms 51.0622 Ops/s 55.8572 Ops/s $\textbf{\color{#d91a1a}-8.58\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1059s 17.9298ms 55.7732 Ops/s 55.5063 Ops/s $\color{#35bf28}+0.48\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1005s 17.7199ms 56.4336 Ops/s 50.6938 Ops/s $\textbf{\color{#35bf28}+11.32\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 0.1038s 19.6607ms 50.8630 Ops/s 56.3808 Ops/s $\textbf{\color{#d91a1a}-9.79\%}$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}9$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1197s 0.1188s 8.4185 Ops/s 8.2104 Ops/s $\color{#35bf28}+2.53\%$
test_sync 0.1024s 0.1021s 9.7986 Ops/s 9.8063 Ops/s $\color{#d91a1a}-0.08\%$
test_async 0.2716s 99.9413ms 10.0059 Ops/s 9.9602 Ops/s $\color{#35bf28}+0.46\%$
test_single_pixels 0.1390s 0.1387s 7.2096 Ops/s 7.4633 Ops/s $\color{#d91a1a}-3.40\%$
test_sync_pixels 97.5996ms 95.3612ms 10.4864 Ops/s 10.4989 Ops/s $\color{#d91a1a}-0.12\%$
test_async_pixels 0.2472s 92.0651ms 10.8619 Ops/s 10.8048 Ops/s $\color{#35bf28}+0.53\%$
test_simple 0.9296s 0.8661s 1.1546 Ops/s 1.1306 Ops/s $\color{#35bf28}+2.12\%$
test_transformed 1.1766s 1.1160s 0.8960 Ops/s 0.8838 Ops/s $\color{#35bf28}+1.38\%$
test_serial 2.4270s 2.3583s 0.4240 Ops/s 0.4170 Ops/s $\color{#35bf28}+1.69\%$
test_parallel 2.6154s 2.5447s 0.3930 Ops/s 0.3940 Ops/s $\color{#d91a1a}-0.27\%$
test_step_mdp_speed[True-True-True-True-True] 82.7220μs 34.6556μs 28.8554 KOps/s 28.5420 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-True-True-True-False] 48.3110μs 20.2606μs 49.3568 KOps/s 47.9564 KOps/s $\color{#35bf28}+2.92\%$
test_step_mdp_speed[True-True-True-False-True] 44.1710μs 20.2596μs 49.3593 KOps/s 47.9408 KOps/s $\color{#35bf28}+2.96\%$
test_step_mdp_speed[True-True-True-False-False] 27.2300μs 11.8080μs 84.6884 KOps/s 80.8389 KOps/s $\color{#35bf28}+4.76\%$
test_step_mdp_speed[True-True-False-True-True] 60.2810μs 36.0525μs 27.7373 KOps/s 27.0027 KOps/s $\color{#35bf28}+2.72\%$
test_step_mdp_speed[True-True-False-True-False] 57.7110μs 21.7668μs 45.9416 KOps/s 43.6993 KOps/s $\textbf{\color{#35bf28}+5.13\%}$
test_step_mdp_speed[True-True-False-False-True] 40.2200μs 22.0030μs 45.4484 KOps/s 44.0711 KOps/s $\color{#35bf28}+3.13\%$
test_step_mdp_speed[True-True-False-False-False] 53.2310μs 13.7420μs 72.7698 KOps/s 69.6982 KOps/s $\color{#35bf28}+4.41\%$
test_step_mdp_speed[True-False-True-True-True] 57.0210μs 38.3860μs 26.0511 KOps/s 25.8707 KOps/s $\color{#35bf28}+0.70\%$
test_step_mdp_speed[True-False-True-True-False] 40.6000μs 23.8213μs 41.9792 KOps/s 40.6818 KOps/s $\color{#35bf28}+3.19\%$
test_step_mdp_speed[True-False-True-False-True] 44.6200μs 22.0648μs 45.3211 KOps/s 43.9023 KOps/s $\color{#35bf28}+3.23\%$
test_step_mdp_speed[True-False-True-False-False] 30.3300μs 13.7782μs 72.5783 KOps/s 69.7350 KOps/s $\color{#35bf28}+4.08\%$
test_step_mdp_speed[True-False-False-True-True] 71.2610μs 39.8835μs 25.0730 KOps/s 24.0285 KOps/s $\color{#35bf28}+4.35\%$
test_step_mdp_speed[True-False-False-True-False] 49.7010μs 25.5767μs 39.0981 KOps/s 36.8199 KOps/s $\textbf{\color{#35bf28}+6.19\%}$
test_step_mdp_speed[True-False-False-False-True] 61.5910μs 24.3405μs 41.0837 KOps/s 40.0593 KOps/s $\color{#35bf28}+2.56\%$
test_step_mdp_speed[True-False-False-False-False] 39.5710μs 15.5729μs 64.2139 KOps/s 61.0428 KOps/s $\textbf{\color{#35bf28}+5.19\%}$
test_step_mdp_speed[False-True-True-True-True] 69.2010μs 38.1040μs 26.2440 KOps/s 25.9445 KOps/s $\color{#35bf28}+1.15\%$
test_step_mdp_speed[False-True-True-True-False] 56.2910μs 23.6337μs 42.3124 KOps/s 40.2320 KOps/s $\textbf{\color{#35bf28}+5.17\%}$
test_step_mdp_speed[False-True-True-False-True] 52.0510μs 26.1162μs 38.2904 KOps/s 37.0569 KOps/s $\color{#35bf28}+3.33\%$
test_step_mdp_speed[False-True-True-False-False] 33.1000μs 15.6392μs 63.9417 KOps/s 60.3237 KOps/s $\textbf{\color{#35bf28}+6.00\%}$
test_step_mdp_speed[False-True-False-True-True] 66.0410μs 40.5489μs 24.6616 KOps/s 24.3606 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[False-True-False-True-False] 49.8110μs 26.0765μs 38.3487 KOps/s 37.1465 KOps/s $\color{#35bf28}+3.24\%$
test_step_mdp_speed[False-True-False-False-True] 48.3510μs 28.4004μs 35.2108 KOps/s 35.3409 KOps/s $\color{#d91a1a}-0.37\%$
test_step_mdp_speed[False-True-False-False-False] 35.7800μs 17.6544μs 56.6429 KOps/s 54.9739 KOps/s $\color{#35bf28}+3.04\%$
test_step_mdp_speed[False-False-True-True-True] 71.2810μs 41.6591μs 24.0044 KOps/s 23.1951 KOps/s $\color{#35bf28}+3.49\%$
test_step_mdp_speed[False-False-True-True-False] 46.1000μs 27.9031μs 35.8384 KOps/s 34.7554 KOps/s $\color{#35bf28}+3.12\%$
test_step_mdp_speed[False-False-True-False-True] 70.0510μs 27.8822μs 35.8652 KOps/s 34.5212 KOps/s $\color{#35bf28}+3.89\%$
test_step_mdp_speed[False-False-True-False-False] 43.4810μs 17.4840μs 57.1952 KOps/s 54.7274 KOps/s $\color{#35bf28}+4.51\%$
test_step_mdp_speed[False-False-False-True-True] 70.3420μs 43.2816μs 23.1045 KOps/s 22.2719 KOps/s $\color{#35bf28}+3.74\%$
test_step_mdp_speed[False-False-False-True-False] 55.5010μs 29.5728μs 33.8148 KOps/s 32.4928 KOps/s $\color{#35bf28}+4.07\%$
test_step_mdp_speed[False-False-False-False-True] 53.0610μs 28.9933μs 34.4907 KOps/s 32.9302 KOps/s $\color{#35bf28}+4.74\%$
test_step_mdp_speed[False-False-False-False-False] 57.3510μs 19.0804μs 52.4099 KOps/s 49.8444 KOps/s $\textbf{\color{#35bf28}+5.15\%}$
test_values[generalized_advantage_estimate-True-True] 25.2568ms 24.6038ms 40.6442 Ops/s 39.7117 Ops/s $\color{#35bf28}+2.35\%$
test_values[vec_generalized_advantage_estimate-True-True] 92.0955ms 3.3894ms 295.0361 Ops/s 305.0187 Ops/s $\color{#d91a1a}-3.27\%$
test_values[td0_return_estimate-False-False] 94.0010μs 64.0460μs 15.6138 KOps/s 15.2308 KOps/s $\color{#35bf28}+2.51\%$
test_values[td1_return_estimate-False-False] 54.6072ms 53.2896ms 18.7654 Ops/s 18.3380 Ops/s $\color{#35bf28}+2.33\%$
test_values[vec_td1_return_estimate-False-False] 1.9758ms 1.7115ms 584.2738 Ops/s 579.2268 Ops/s $\color{#35bf28}+0.87\%$
test_values[td_lambda_return_estimate-True-False] 87.2959ms 85.2487ms 11.7304 Ops/s 11.4409 Ops/s $\color{#35bf28}+2.53\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0055ms 1.7089ms 585.1781 Ops/s 581.4324 Ops/s $\color{#35bf28}+0.64\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.3258ms 23.0849ms 43.3183 Ops/s 41.4819 Ops/s $\color{#35bf28}+4.43\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8657ms 0.7063ms 1.4159 KOps/s 1.3997 KOps/s $\color{#35bf28}+1.16\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7404ms 0.6644ms 1.5050 KOps/s 1.4283 KOps/s $\textbf{\color{#35bf28}+5.37\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5187ms 1.4573ms 686.2192 Ops/s 680.3922 Ops/s $\color{#35bf28}+0.86\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9680ms 0.6943ms 1.4403 KOps/s 1.4188 KOps/s $\color{#35bf28}+1.52\%$
test_dqn_speed 1.3838ms 1.3098ms 763.4700 Ops/s 753.3761 Ops/s $\color{#35bf28}+1.34\%$
test_ddpg_speed 2.9386ms 2.7537ms 363.1526 Ops/s 364.4250 Ops/s $\color{#d91a1a}-0.35\%$
test_sac_speed 8.7759ms 7.8468ms 127.4409 Ops/s 124.7169 Ops/s $\color{#35bf28}+2.18\%$
test_redq_speed 12.4527ms 12.2593ms 81.5708 Ops/s 80.9959 Ops/s $\color{#35bf28}+0.71\%$
test_redq_deprec_speed 11.6278ms 11.3322ms 88.2443 Ops/s 88.4776 Ops/s $\color{#d91a1a}-0.26\%$
test_td3_speed 8.0469ms 7.9552ms 125.7041 Ops/s 123.3810 Ops/s $\color{#35bf28}+1.88\%$
test_cql_speed 30.7447ms 30.1314ms 33.1879 Ops/s 34.0456 Ops/s $\color{#d91a1a}-2.52\%$
test_a2c_speed 7.0794ms 6.9241ms 144.4221 Ops/s 148.9793 Ops/s $\color{#d91a1a}-3.06\%$
test_ppo_speed 7.5103ms 7.2477ms 137.9744 Ops/s 139.3790 Ops/s $\color{#d91a1a}-1.01\%$
test_reinforce_speed 6.2220ms 6.0054ms 166.5158 Ops/s 168.9361 Ops/s $\color{#d91a1a}-1.43\%$
test_iql_speed 25.9298ms 25.7009ms 38.9091 Ops/s 38.9520 Ops/s $\color{#d91a1a}-0.11\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0057ms 2.4687ms 405.0745 Ops/s 400.0770 Ops/s $\color{#35bf28}+1.25\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 3.5798ms 2.6266ms 380.7156 Ops/s 368.5879 Ops/s $\color{#35bf28}+3.29\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.0472ms 2.6256ms 380.8721 Ops/s 326.1786 Ops/s $\textbf{\color{#35bf28}+16.77\%}$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0505ms 2.4752ms 404.0029 Ops/s 396.8491 Ops/s $\color{#35bf28}+1.80\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1321s 2.9989ms 333.4546 Ops/s 371.6464 Ops/s $\textbf{\color{#d91a1a}-10.28\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.6092ms 2.6392ms 378.9001 Ops/s 371.1309 Ops/s $\color{#35bf28}+2.09\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0698ms 2.4681ms 405.1703 Ops/s 395.5598 Ops/s $\color{#35bf28}+2.43\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 3.5074ms 2.6362ms 379.3390 Ops/s 371.4969 Ops/s $\color{#35bf28}+2.11\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.1146ms 2.6243ms 381.0568 Ops/s 371.7253 Ops/s $\color{#35bf28}+2.51\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.6835ms 2.4736ms 404.2738 Ops/s 396.8618 Ops/s $\color{#35bf28}+1.87\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 4.0675ms 2.6462ms 377.9030 Ops/s 370.1660 Ops/s $\color{#35bf28}+2.09\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.0675ms 2.6397ms 378.8240 Ops/s 370.0100 Ops/s $\color{#35bf28}+2.38\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.6317ms 2.4431ms 409.3178 Ops/s 395.3187 Ops/s $\color{#35bf28}+3.54\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 3.9294ms 2.6391ms 378.9143 Ops/s 368.5556 Ops/s $\color{#35bf28}+2.81\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.5762ms 2.6455ms 377.9992 Ops/s 368.8954 Ops/s $\color{#35bf28}+2.47\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.7531ms 2.4689ms 405.0406 Ops/s 393.0217 Ops/s $\color{#35bf28}+3.06\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 3.4366ms 2.6411ms 378.6255 Ops/s 367.4347 Ops/s $\color{#35bf28}+3.05\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.7550ms 2.6536ms 376.8431 Ops/s 367.8494 Ops/s $\color{#35bf28}+2.44\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.2680s 23.1368ms 43.2212 Ops/s 42.8552 Ops/s $\color{#35bf28}+0.85\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1286s 20.0746ms 49.8142 Ops/s 49.1117 Ops/s $\color{#35bf28}+1.43\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 0.1337s 17.8309ms 56.0823 Ops/s 43.9809 Ops/s $\textbf{\color{#35bf28}+27.52\%}$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1290s 22.4418ms 44.5597 Ops/s 48.9805 Ops/s $\textbf{\color{#d91a1a}-9.03\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1305s 20.1099ms 49.7268 Ops/s 49.1736 Ops/s $\color{#35bf28}+1.12\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.1328s 20.1609ms 49.6008 Ops/s 49.1075 Ops/s $\color{#35bf28}+1.00\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1290s 22.4595ms 44.5245 Ops/s 44.0607 Ops/s $\color{#35bf28}+1.05\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1314s 20.1553ms 49.6146 Ops/s 49.0516 Ops/s $\color{#35bf28}+1.15\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 0.1292s 20.1417ms 49.6482 Ops/s 49.1716 Ops/s $\color{#35bf28}+0.97\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot