Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Make tutos runnable without colab #1826

Merged
merged 4 commits into from
Jan 29, 2024
Merged

[Doc] Make tutos runnable without colab #1826

merged 4 commits into from
Jan 29, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jan 22, 2024 •
edited
Loading

Similar solution to pytorch/tutorials#2750

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jan 22, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1826

Note: Links to docs will display an error until the docs builds have been completed.

⏳ 1 Pending, 4 Unrelated Failures

As of commit 945319b with merge base 156a668 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 22, 2024
@vmoens vmoens added the documentation Improvements or additions to documentation label Jan 22, 2024
This was linked to issues Jan 22, 2024
[BUG] An attempt has been made to start a new process before the current process has finished its bootstrapping phase. #1805
Closed
[BUG] RuntimeError An attempt has been made to start a new process before the current process has finished its bootstrapping phase #1825
Closed
@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 22, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}21$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 65.4551ms 64.8257ms 15.4260 Ops/s 16.2683 Ops/s $\textbf{\color{#d91a1a}-5.18\%}$
test_sync 46.7265ms 34.8438ms 28.6995 Ops/s 28.8578 Ops/s $\color{#d91a1a}-0.55\%$
test_async 0.1341s 32.6417ms 30.6356 Ops/s 31.7719 Ops/s $\color{#d91a1a}-3.58\%$
test_simple 0.5242s 0.4574s 2.1861 Ops/s 2.3141 Ops/s $\textbf{\color{#d91a1a}-5.53\%}$
test_transformed 0.6686s 0.6151s 1.6257 Ops/s 1.6650 Ops/s $\color{#d91a1a}-2.36\%$
test_serial 1.5064s 1.4246s 0.7020 Ops/s 0.7351 Ops/s $\color{#d91a1a}-4.51\%$
test_parallel 1.2972s 1.2197s 0.8199 Ops/s 0.8301 Ops/s $\color{#d91a1a}-1.24\%$
test_step_mdp_speed[True-True-True-True-True] 0.1886ms 21.1793μs 47.2159 KOps/s 46.6336 KOps/s $\color{#35bf28}+1.25\%$
test_step_mdp_speed[True-True-True-True-False] 44.7440μs 13.0940μs 76.3706 KOps/s 75.8422 KOps/s $\color{#35bf28}+0.70\%$
test_step_mdp_speed[True-True-True-False-True] 43.1510μs 12.3596μs 80.9086 KOps/s 80.0316 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-True-True-False-False] 36.5980μs 7.5738μs 132.0338 KOps/s 131.0829 KOps/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-True-False-True-True] 0.1423ms 22.9849μs 43.5068 KOps/s 44.5884 KOps/s $\color{#d91a1a}-2.43\%$
test_step_mdp_speed[True-True-False-True-False] 80.8330μs 14.2734μs 70.0605 KOps/s 69.0820 KOps/s $\color{#35bf28}+1.42\%$
test_step_mdp_speed[True-True-False-False-True] 41.7990μs 13.6070μs 73.4918 KOps/s 73.7475 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[True-True-False-False-False] 47.2790μs 8.9394μs 111.8649 KOps/s 112.3579 KOps/s $\color{#d91a1a}-0.44\%$
test_step_mdp_speed[True-False-True-True-True] 85.5390μs 23.9575μs 41.7406 KOps/s 40.0434 KOps/s $\color{#35bf28}+4.24\%$
test_step_mdp_speed[True-False-True-True-False] 49.6830μs 15.6661μs 63.8321 KOps/s 63.9421 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[True-False-True-False-True] 54.5130μs 13.6451μs 73.2862 KOps/s 72.9664 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[True-False-True-False-False] 35.9170μs 8.9425μs 111.8257 KOps/s 112.9707 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-False-False-True-True] 77.4050μs 24.9245μs 40.1212 KOps/s 39.5957 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[True-False-False-True-False] 60.9440μs 16.9468μs 59.0081 KOps/s 58.9371 KOps/s $\color{#35bf28}+0.12\%$
test_step_mdp_speed[True-False-False-False-True] 0.1133ms 15.0417μs 66.4818 KOps/s 67.3206 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[True-False-False-False-False] 56.5760μs 10.1959μs 98.0790 KOps/s 99.2927 KOps/s $\color{#d91a1a}-1.22\%$
test_step_mdp_speed[False-True-True-True-True] 53.5300μs 23.9746μs 41.7109 KOps/s 41.4561 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-True-True-True-False] 63.1280μs 15.8373μs 63.1420 KOps/s 63.2701 KOps/s $\color{#d91a1a}-0.20\%$
test_step_mdp_speed[False-True-True-False-True] 52.7590μs 15.9869μs 62.5514 KOps/s 62.5400 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[False-True-True-False-False] 42.7200μs 10.2101μs 97.9422 KOps/s 98.8573 KOps/s $\color{#d91a1a}-0.93\%$
test_step_mdp_speed[False-True-False-True-True] 83.3560μs 25.3250μs 39.4867 KOps/s 39.5746 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-True-False-True-False] 42.7100μs 17.0563μs 58.6292 KOps/s 56.8238 KOps/s $\color{#35bf28}+3.18\%$
test_step_mdp_speed[False-True-False-False-True] 63.2490μs 17.0355μs 58.7011 KOps/s 58.4417 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-True-False-False-False] 43.4520μs 11.4376μs 87.4310 KOps/s 88.4357 KOps/s $\color{#d91a1a}-1.14\%$
test_step_mdp_speed[False-False-True-True-True] 77.7850μs 26.4498μs 37.8074 KOps/s 38.0487 KOps/s $\color{#d91a1a}-0.63\%$
test_step_mdp_speed[False-False-True-True-False] 57.6080μs 18.3789μs 54.4103 KOps/s 54.9108 KOps/s $\color{#d91a1a}-0.91\%$
test_step_mdp_speed[False-False-True-False-True] 68.4810μs 16.9801μs 58.8926 KOps/s 57.6388 KOps/s $\color{#35bf28}+2.18\%$
test_step_mdp_speed[False-False-True-False-False] 39.8850μs 11.3088μs 88.4266 KOps/s 89.3296 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[False-False-False-True-True] 55.1530μs 27.4499μs 36.4300 KOps/s 36.9943 KOps/s $\color{#d91a1a}-1.53\%$
test_step_mdp_speed[False-False-False-True-False] 65.7130μs 19.3316μs 51.7288 KOps/s 52.2361 KOps/s $\color{#d91a1a}-0.97\%$
test_step_mdp_speed[False-False-False-False-True] 44.6330μs 18.0587μs 55.3749 KOps/s 54.9666 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[False-False-False-False-False] 49.2120μs 12.4145μs 80.5507 KOps/s 80.8842 KOps/s $\color{#d91a1a}-0.41\%$
test_values[generalized_advantage_estimate-True-True] 13.6915ms 12.3117ms 81.2234 Ops/s 81.2788 Ops/s $\color{#d91a1a}-0.07\%$
test_values[vec_generalized_advantage_estimate-True-True] 35.6118ms 28.1043ms 35.5817 Ops/s 35.2513 Ops/s $\color{#35bf28}+0.94\%$
test_values[td0_return_estimate-False-False] 0.2318ms 0.1843ms 5.4271 KOps/s 5.5471 KOps/s $\color{#d91a1a}-2.16\%$
test_values[td1_return_estimate-False-False] 29.6891ms 26.5166ms 37.7123 Ops/s 37.7352 Ops/s $\color{#d91a1a}-0.06\%$
test_values[vec_td1_return_estimate-False-False] 33.6482ms 27.9909ms 35.7259 Ops/s 35.2506 Ops/s $\color{#35bf28}+1.35\%$
test_values[td_lambda_return_estimate-True-False] 40.0740ms 37.2865ms 26.8194 Ops/s 27.1680 Ops/s $\color{#d91a1a}-1.28\%$
test_values[vec_td_lambda_return_estimate-True-False] 36.1862ms 28.3893ms 35.2246 Ops/s 35.2827 Ops/s $\color{#d91a1a}-0.16\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.7778ms 8.3280ms 120.0770 Ops/s 122.6308 Ops/s $\color{#d91a1a}-2.08\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.2810ms 1.8748ms 533.3764 Ops/s 511.5160 Ops/s $\color{#35bf28}+4.27\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 8.8095ms 0.4407ms 2.2691 KOps/s 2.2464 KOps/s $\color{#35bf28}+1.01\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 48.7027ms 40.4683ms 24.7107 Ops/s 25.9061 Ops/s $\color{#d91a1a}-4.61\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 10.8216ms 2.6684ms 374.7570 Ops/s 375.3902 Ops/s $\color{#d91a1a}-0.17\%$
test_dqn_speed 80.8278ms 8.2411ms 121.3427 Ops/s 132.7370 Ops/s $\textbf{\color{#d91a1a}-8.58\%}$
test_ddpg_speed 23.0143ms 14.7880ms 67.6224 Ops/s 64.7812 Ops/s $\color{#35bf28}+4.39\%$
test_sac_speed 37.3463ms 31.1006ms 32.1537 Ops/s 34.9950 Ops/s $\textbf{\color{#d91a1a}-8.12\%}$
test_redq_speed 26.6529ms 16.8645ms 59.2960 Ops/s 64.7152 Ops/s $\textbf{\color{#d91a1a}-8.37\%}$
test_redq_deprec_speed 28.7363ms 26.5703ms 37.6361 Ops/s 36.3813 Ops/s $\color{#35bf28}+3.45\%$
test_td3_speed 33.2040ms 22.1028ms 45.2431 Ops/s 49.6046 Ops/s $\textbf{\color{#d91a1a}-8.79\%}$
test_cql_speed 0.1017s 92.9527ms 10.7582 Ops/s 11.7160 Ops/s $\textbf{\color{#d91a1a}-8.18\%}$
test_a2c_speed 38.6771ms 28.5337ms 35.0463 Ops/s 36.7448 Ops/s $\color{#d91a1a}-4.62\%$
test_ppo_speed 37.7430ms 28.8438ms 34.6695 Ops/s 37.1421 Ops/s $\textbf{\color{#d91a1a}-6.66\%}$
test_reinforce_speed 36.0891ms 27.4817ms 36.3878 Ops/s 36.9897 Ops/s $\color{#d91a1a}-1.63\%$
test_iql_speed 74.1803ms 66.2802ms 15.0875 Ops/s 15.5711 Ops/s $\color{#d91a1a}-3.11\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.3681ms 3.1125ms 321.2869 Ops/s 345.3089 Ops/s $\textbf{\color{#d91a1a}-6.96\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 9.1142ms 0.5412ms 1.8477 KOps/s 1.8659 KOps/s $\color{#d91a1a}-0.97\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 10.8778ms 0.5258ms 1.9019 KOps/s 2.0150 KOps/s $\textbf{\color{#d91a1a}-5.61\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.1386ms 3.2544ms 307.2765 Ops/s 339.2017 Ops/s $\textbf{\color{#d91a1a}-9.41\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 9.3782ms 0.5507ms 1.8157 KOps/s 1.9507 KOps/s $\textbf{\color{#d91a1a}-6.92\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 1.7322ms 0.5146ms 1.9433 KOps/s 2.0321 KOps/s $\color{#d91a1a}-4.37\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.1037ms 2.9771ms 335.9021 Ops/s 406.2364 Ops/s $\textbf{\color{#d91a1a}-17.31\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 11.2240ms 0.6889ms 1.4517 KOps/s 1.5107 KOps/s $\color{#d91a1a}-3.91\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 9.0861ms 0.6572ms 1.5217 KOps/s 1.5935 KOps/s $\color{#d91a1a}-4.51\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.3818ms 3.0705ms 325.6753 Ops/s 359.5778 Ops/s $\textbf{\color{#d91a1a}-9.43\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 3.6561ms 0.5471ms 1.8280 KOps/s 1.9330 KOps/s $\textbf{\color{#d91a1a}-5.44\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6682ms 0.5157ms 1.9391 KOps/s 1.9685 KOps/s $\color{#d91a1a}-1.49\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.4642ms 3.1434ms 318.1301 Ops/s 351.4467 Ops/s $\textbf{\color{#d91a1a}-9.48\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6660ms 0.5338ms 1.8733 KOps/s 1.9429 KOps/s $\color{#d91a1a}-3.58\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 10.8241ms 0.5191ms 1.9265 KOps/s 2.0436 KOps/s $\textbf{\color{#d91a1a}-5.73\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.4862ms 2.9512ms 338.8484 Ops/s 363.6412 Ops/s $\textbf{\color{#d91a1a}-6.82\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8223ms 0.6752ms 1.4810 KOps/s 1.4914 KOps/s $\color{#d91a1a}-0.70\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0549ms 0.6475ms 1.5444 KOps/s 1.5446 KOps/s $\color{#d91a1a}-0.01\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1198s 11.0771ms 90.2767 Ops/s 94.1836 Ops/s $\color{#d91a1a}-4.15\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 20.1658ms 14.0680ms 71.0831 Ops/s 73.2532 Ops/s $\color{#d91a1a}-2.96\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 11.8526ms 3.5870ms 278.7881 Ops/s 301.9645 Ops/s $\textbf{\color{#d91a1a}-7.68\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1270s 13.4962ms 74.0950 Ops/s 79.3636 Ops/s $\textbf{\color{#d91a1a}-6.64\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.5381ms 13.8426ms 72.2409 Ops/s 73.3892 Ops/s $\color{#d91a1a}-1.56\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.7368ms 3.4248ms 291.9889 Ops/s 303.9988 Ops/s $\color{#d91a1a}-3.95\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1183s 11.3716ms 87.9381 Ops/s 90.5604 Ops/s $\color{#d91a1a}-2.90\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.8605ms 14.0925ms 70.9597 Ops/s 60.4601 Ops/s $\textbf{\color{#35bf28}+17.37\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 12.2778ms 3.8580ms 259.2015 Ops/s 275.9245 Ops/s $\textbf{\color{#d91a1a}-6.06\%}$

@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 22, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1169s 0.1165s 8.5844 Ops/s 8.7246 Ops/s $\color{#d91a1a}-1.61\%$
test_sync 96.6145ms 96.1035ms 10.4055 Ops/s 10.4111 Ops/s $\color{#d91a1a}-0.05\%$
test_async 0.1811s 91.9771ms 10.8723 Ops/s 10.8838 Ops/s $\color{#d91a1a}-0.11\%$
test_single_pixels 0.1411s 0.1405s 7.1174 Ops/s 7.9486 Ops/s $\textbf{\color{#d91a1a}-10.46\%}$
test_sync_pixels 76.4786ms 74.1676ms 13.4830 Ops/s 12.6604 Ops/s $\textbf{\color{#35bf28}+6.50\%}$
test_async_pixels 0.2043s 70.8809ms 14.1082 Ops/s 13.9838 Ops/s $\color{#35bf28}+0.89\%$
test_simple 0.9070s 0.8341s 1.1989 Ops/s 1.2359 Ops/s $\color{#d91a1a}-3.00\%$
test_transformed 1.1498s 1.0841s 0.9224 Ops/s 0.9253 Ops/s $\color{#d91a1a}-0.31\%$
test_serial 2.3937s 2.3252s 0.4301 Ops/s 0.4328 Ops/s $\color{#d91a1a}-0.62\%$
test_parallel 2.0214s 1.8816s 0.5315 Ops/s 0.5373 Ops/s $\color{#d91a1a}-1.09\%$
test_step_mdp_speed[True-True-True-True-True] 97.5410μs 33.2463μs 30.0786 KOps/s 30.0518 KOps/s $\color{#35bf28}+0.09\%$
test_step_mdp_speed[True-True-True-True-False] 0.2722ms 19.3846μs 51.5874 KOps/s 49.8612 KOps/s $\color{#35bf28}+3.46\%$
test_step_mdp_speed[True-True-True-False-True] 0.2170ms 18.6531μs 53.6105 KOps/s 52.9585 KOps/s $\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-True-True-False-False] 42.0000μs 11.0885μs 90.1834 KOps/s 87.6730 KOps/s $\color{#35bf28}+2.86\%$
test_step_mdp_speed[True-True-False-True-True] 0.2428ms 34.6294μs 28.8772 KOps/s 27.9624 KOps/s $\color{#35bf28}+3.27\%$
test_step_mdp_speed[True-True-False-True-False] 0.2174ms 21.3194μs 46.9057 KOps/s 45.6066 KOps/s $\color{#35bf28}+2.85\%$
test_step_mdp_speed[True-True-False-False-True] 0.2115ms 20.6482μs 48.4304 KOps/s 48.3019 KOps/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-True-False-False-False] 28.1710μs 13.0601μs 76.5691 KOps/s 74.3928 KOps/s $\color{#35bf28}+2.93\%$
test_step_mdp_speed[True-False-True-True-True] 0.2414ms 36.3075μs 27.5425 KOps/s 26.3892 KOps/s $\color{#35bf28}+4.37\%$
test_step_mdp_speed[True-False-True-True-False] 0.2391ms 23.4240μs 42.6913 KOps/s 41.5862 KOps/s $\color{#35bf28}+2.66\%$
test_step_mdp_speed[True-False-True-False-True] 50.2510μs 20.3337μs 49.1794 KOps/s 47.9646 KOps/s $\color{#35bf28}+2.53\%$
test_step_mdp_speed[True-False-True-False-False] 0.2133ms 12.8728μs 77.6833 KOps/s 74.5339 KOps/s $\color{#35bf28}+4.23\%$
test_step_mdp_speed[True-False-False-True-True] 0.2343ms 37.6945μs 26.5291 KOps/s 25.4959 KOps/s $\color{#35bf28}+4.05\%$
test_step_mdp_speed[True-False-False-True-False] 0.2348ms 25.2884μs 39.5438 KOps/s 38.8933 KOps/s $\color{#35bf28}+1.67\%$
test_step_mdp_speed[True-False-False-False-True] 43.4800μs 22.1407μs 45.1658 KOps/s 43.9904 KOps/s $\color{#35bf28}+2.67\%$
test_step_mdp_speed[True-False-False-False-False] 0.2096ms 14.7395μs 67.8451 KOps/s 65.8244 KOps/s $\color{#35bf28}+3.07\%$
test_step_mdp_speed[False-True-True-True-True] 0.2409ms 36.9649μs 27.0527 KOps/s 26.3281 KOps/s $\color{#35bf28}+2.75\%$
test_step_mdp_speed[False-True-True-True-False] 0.2276ms 23.5330μs 42.4935 KOps/s 42.1674 KOps/s $\color{#35bf28}+0.77\%$
test_step_mdp_speed[False-True-True-False-True] 43.9810μs 24.4618μs 40.8801 KOps/s 39.9693 KOps/s $\color{#35bf28}+2.28\%$
test_step_mdp_speed[False-True-True-False-False] 0.2311ms 14.7858μs 67.6326 KOps/s 65.8269 KOps/s $\color{#35bf28}+2.74\%$
test_step_mdp_speed[False-True-False-True-True] 82.3510μs 39.1037μs 25.5730 KOps/s 25.0210 KOps/s $\color{#35bf28}+2.21\%$
test_step_mdp_speed[False-True-False-True-False] 0.3323ms 25.4620μs 39.2741 KOps/s 38.6209 KOps/s $\color{#35bf28}+1.69\%$
test_step_mdp_speed[False-True-False-False-True] 0.2276ms 25.8075μs 38.7484 KOps/s 37.4328 KOps/s $\color{#35bf28}+3.51\%$
test_step_mdp_speed[False-True-False-False-False] 0.2028ms 16.6837μs 59.9387 KOps/s 58.4057 KOps/s $\color{#35bf28}+2.62\%$
test_step_mdp_speed[False-False-True-True-True] 56.3000μs 39.9893μs 25.0067 KOps/s 23.8850 KOps/s $\color{#35bf28}+4.70\%$
test_step_mdp_speed[False-False-True-True-False] 0.2396ms 26.8510μs 37.2425 KOps/s 36.0546 KOps/s $\color{#35bf28}+3.29\%$
test_step_mdp_speed[False-False-True-False-True] 0.2261ms 27.0442μs 36.9765 KOps/s 38.0119 KOps/s $\color{#d91a1a}-2.72\%$
test_step_mdp_speed[False-False-True-False-False] 47.9300μs 16.7325μs 59.7638 KOps/s 58.1313 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[False-False-False-True-True] 62.6800μs 41.4183μs 24.1439 KOps/s 23.4524 KOps/s $\color{#35bf28}+2.95\%$
test_step_mdp_speed[False-False-False-True-False] 0.2339ms 28.4584μs 35.1390 KOps/s 33.6127 KOps/s $\color{#35bf28}+4.54\%$
test_step_mdp_speed[False-False-False-False-True] 0.2292ms 27.5662μs 36.2763 KOps/s 35.4564 KOps/s $\color{#35bf28}+2.31\%$
test_step_mdp_speed[False-False-False-False-False] 0.2203ms 18.1941μs 54.9629 KOps/s 52.9359 KOps/s $\color{#35bf28}+3.83\%$
test_values[generalized_advantage_estimate-True-True] 25.9199ms 25.0518ms 39.9173 Ops/s 40.1710 Ops/s $\color{#d91a1a}-0.63\%$
test_values[vec_generalized_advantage_estimate-True-True] 83.8948ms 3.2424ms 308.4116 Ops/s 295.6190 Ops/s $\color{#35bf28}+4.33\%$
test_values[td0_return_estimate-False-False] 94.2610μs 61.2193μs 16.3347 KOps/s 16.9362 KOps/s $\color{#d91a1a}-3.55\%$
test_values[td1_return_estimate-False-False] 52.8575ms 52.0371ms 19.2171 Ops/s 18.0926 Ops/s $\textbf{\color{#35bf28}+6.22\%}$
test_values[vec_td1_return_estimate-False-False] 2.0664ms 1.7636ms 567.0280 Ops/s 569.1419 Ops/s $\color{#d91a1a}-0.37\%$
test_values[td_lambda_return_estimate-True-False] 85.0430ms 83.3514ms 11.9974 Ops/s 11.5053 Ops/s $\color{#35bf28}+4.28\%$
test_values[vec_td_lambda_return_estimate-True-False] 3.9907ms 1.7960ms 556.7903 Ops/s 557.3636 Ops/s $\color{#d91a1a}-0.10\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.8419ms 23.2704ms 42.9731 Ops/s 42.0815 Ops/s $\color{#35bf28}+2.12\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0366ms 0.7207ms 1.3876 KOps/s 1.4218 KOps/s $\color{#d91a1a}-2.41\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8716ms 0.6542ms 1.5285 KOps/s 1.5470 KOps/s $\color{#d91a1a}-1.20\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5085ms 1.4481ms 690.5691 Ops/s 690.7032 Ops/s $\color{#d91a1a}-0.02\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9184ms 0.6666ms 1.5002 KOps/s 1.4939 KOps/s $\color{#35bf28}+0.42\%$
test_dqn_speed 10.1775ms 7.3940ms 135.2454 Ops/s 136.8215 Ops/s $\color{#d91a1a}-1.15\%$
test_ddpg_speed 15.3881ms 14.4850ms 69.0369 Ops/s 69.9885 Ops/s $\color{#d91a1a}-1.36\%$
test_sac_speed 30.1894ms 29.3770ms 34.0402 Ops/s 32.0492 Ops/s $\textbf{\color{#35bf28}+6.21\%}$
test_redq_speed 14.4878ms 13.5123ms 74.0068 Ops/s 74.7799 Ops/s $\color{#d91a1a}-1.03\%$
test_redq_deprec_speed 25.2969ms 24.4457ms 40.9070 Ops/s 41.7161 Ops/s $\color{#d91a1a}-1.94\%$
test_td3_speed 29.5419ms 19.9852ms 50.0369 Ops/s 51.2790 Ops/s $\color{#d91a1a}-2.42\%$
test_cql_speed 84.8612ms 84.0354ms 11.8998 Ops/s 12.0962 Ops/s $\color{#d91a1a}-1.62\%$
test_a2c_speed 28.5664ms 27.4471ms 36.4337 Ops/s 37.4783 Ops/s $\color{#d91a1a}-2.79\%$
test_ppo_speed 28.0119ms 27.3488ms 36.5647 Ops/s 37.3277 Ops/s $\color{#d91a1a}-2.04\%$
test_reinforce_speed 27.3566ms 26.3681ms 37.9246 Ops/s 38.6738 Ops/s $\color{#d91a1a}-1.94\%$
test_iql_speed 58.6660ms 57.8093ms 17.2983 Ops/s 17.4985 Ops/s $\color{#d91a1a}-1.14\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.8824ms 3.6557ms 273.5462 Ops/s 274.7584 Ops/s $\color{#d91a1a}-0.44\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0908ms 0.8470ms 1.1806 KOps/s 1.1799 KOps/s $\color{#35bf28}+0.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.0429ms 0.8205ms 1.2187 KOps/s 1.2168 KOps/s $\color{#35bf28}+0.16\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.9223ms 3.6373ms 274.9297 Ops/s 274.4362 Ops/s $\color{#35bf28}+0.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9938ms 0.8332ms 1.2002 KOps/s 1.1988 KOps/s $\color{#35bf28}+0.12\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9387ms 0.8106ms 1.2337 KOps/s 1.2337 KOps/s $+0.00\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.6160ms 3.3478ms 298.7056 Ops/s 301.4367 Ops/s $\color{#d91a1a}-0.91\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.2142ms 0.9647ms 1.0366 KOps/s 1.0399 KOps/s $\color{#d91a1a}-0.32\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.1513ms 0.9395ms 1.0644 KOps/s 1.0648 KOps/s $\color{#d91a1a}-0.04\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.8414ms 3.6486ms 274.0760 Ops/s 277.8829 Ops/s $\color{#d91a1a}-1.37\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0588ms 0.8474ms 1.1801 KOps/s 1.1789 KOps/s $\color{#35bf28}+0.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.0172ms 0.8232ms 1.2148 KOps/s 1.2160 KOps/s $\color{#d91a1a}-0.10\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.0481ms 3.6576ms 273.4056 Ops/s 274.5711 Ops/s $\color{#d91a1a}-0.42\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0838ms 0.8361ms 1.1960 KOps/s 1.1977 KOps/s $\color{#d91a1a}-0.14\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9408ms 0.8121ms 1.2313 KOps/s 1.2330 KOps/s $\color{#d91a1a}-0.13\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.5912ms 3.3884ms 295.1243 Ops/s 300.8172 Ops/s $\color{#d91a1a}-1.89\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0792ms 0.9622ms 1.0393 KOps/s 1.0377 KOps/s $\color{#35bf28}+0.15\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.1937ms 0.9427ms 1.0608 KOps/s 1.0609 KOps/s $\color{#d91a1a}-0.01\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1243s 12.4494ms 80.3251 Ops/s 95.1095 Ops/s $\textbf{\color{#d91a1a}-15.54\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 16.5704ms 14.1304ms 70.7692 Ops/s 71.2834 Ops/s $\color{#d91a1a}-0.72\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.6357ms 3.3942ms 294.6219 Ops/s 297.6331 Ops/s $\color{#d91a1a}-1.01\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1185s 9.9605ms 100.3961 Ops/s 99.4576 Ops/s $\color{#35bf28}+0.94\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.6713ms 14.1205ms 70.8190 Ops/s 61.2298 Ops/s $\textbf{\color{#35bf28}+15.66\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.0630ms 3.3872ms 295.2303 Ops/s 296.4982 Ops/s $\color{#d91a1a}-0.43\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1202s 10.2787ms 97.2886 Ops/s 98.5213 Ops/s $\color{#d91a1a}-1.25\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.9396ms 14.3341ms 69.7636 Ops/s 70.1586 Ops/s $\color{#d91a1a}-0.56\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 6.9059ms 3.6127ms 276.8031 Ops/s 279.6994 Ops/s $\color{#d91a1a}-1.04\%$

@vmoens vmoens force-pushed the run-sphinx-scripts branch from 66724a2 to 32f369b Compare January 29, 2024 18:35
@vmoens vmoens changed the title [Doc] Attempt to run sphinx tutos under the if name == main block [Doc] Make tutos runnable without colab Jan 29, 2024
@vmoens vmoens merged commit 6277226 into main Jan 29, 2024
61 of 65 checks passed
@vmoens vmoens deleted the run-sphinx-scripts branch January 29, 2024 20:51
@vmoens vmoens mentioned this pull request Jan 30, 2024
Closed
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
2 participants
@vmoens @facebook-github-bot