Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] default_interaction_type doc #2177

Merged
merged 1 commit into from
May 29, 2024
Merged

[Doc] default_interaction_type doc #2177

merged 1 commit into from
May 29, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented May 29, 2024

Closes #2175

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented May 29, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2177

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 15 Unrelated Failures

As of commit 387cbf3 with merge base 2ba9b4d (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 29, 2024
@vmoens vmoens added documentation Improvements or additions to documentation and removed CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. labels May 29, 2024
@vmoens vmoens changed the title default_interaction_type doc [Doc] default_interaction_type doc May 29, 2024
@vmoens vmoens merged commit 0d48f51 into main May 29, 2024
24 of 39 checks passed
@vmoens vmoens deleted the vmoens-patch-2 branch May 29, 2024 08:55
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}1$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 55.0638ms 53.9638ms 18.5309 Ops/s 18.4399 Ops/s $\color{#35bf28}+0.49\%$
test_sync 36.5656ms 30.8754ms 32.3883 Ops/s 32.8287 Ops/s $\color{#d91a1a}-1.34\%$
test_async 69.8520ms 28.9526ms 34.5393 Ops/s 36.3533 Ops/s $\color{#d91a1a}-4.99\%$
test_simple 0.4129s 0.3512s 2.8476 Ops/s 2.9422 Ops/s $\color{#d91a1a}-3.21\%$
test_transformed 0.5486s 0.4923s 2.0313 Ops/s 1.9759 Ops/s $\color{#35bf28}+2.80\%$
test_serial 1.2478s 1.1969s 0.8355 Ops/s 0.8131 Ops/s $\color{#35bf28}+2.75\%$
test_parallel 1.0697s 1.0210s 0.9795 Ops/s 0.9843 Ops/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[True-True-True-True-True] 0.1472ms 21.7240μs 46.0320 KOps/s 45.8801 KOps/s $\color{#35bf28}+0.33\%$
test_step_mdp_speed[True-True-True-True-False] 0.3166ms 13.5598μs 73.7476 KOps/s 75.3501 KOps/s $\color{#d91a1a}-2.13\%$
test_step_mdp_speed[True-True-True-False-True] 46.8180μs 12.7733μs 78.2884 KOps/s 78.3908 KOps/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[True-True-True-False-False] 41.3470μs 7.8368μs 127.6038 KOps/s 129.0263 KOps/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-True-False-True-True] 60.8940μs 23.0398μs 43.4032 KOps/s 43.4833 KOps/s $\color{#d91a1a}-0.18\%$
test_step_mdp_speed[True-True-False-True-False] 38.4720μs 14.8142μs 67.5027 KOps/s 69.6982 KOps/s $\color{#d91a1a}-3.15\%$
test_step_mdp_speed[True-True-False-False-True] 40.8270μs 14.1067μs 70.8882 KOps/s 71.7089 KOps/s $\color{#d91a1a}-1.14\%$
test_step_mdp_speed[True-True-False-False-False] 36.4680μs 9.1527μs 109.2573 KOps/s 111.4237 KOps/s $\color{#d91a1a}-1.94\%$
test_step_mdp_speed[True-False-True-True-True] 54.1410μs 24.4584μs 40.8858 KOps/s 40.7150 KOps/s $\color{#35bf28}+0.42\%$
test_step_mdp_speed[True-False-True-True-False] 42.6000μs 16.2171μs 61.6634 KOps/s 63.2167 KOps/s $\color{#d91a1a}-2.46\%$
test_step_mdp_speed[True-False-True-False-True] 48.1400μs 14.2338μs 70.2553 KOps/s 71.0870 KOps/s $\color{#d91a1a}-1.17\%$
test_step_mdp_speed[True-False-True-False-False] 41.4280μs 9.0604μs 110.3707 KOps/s 111.2127 KOps/s $\color{#d91a1a}-0.76\%$
test_step_mdp_speed[True-False-False-True-True] 84.1280μs 25.4341μs 39.3172 KOps/s 39.1227 KOps/s $\color{#35bf28}+0.50\%$
test_step_mdp_speed[True-False-False-True-False] 43.6420μs 17.2356μs 58.0196 KOps/s 58.6111 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[True-False-False-False-True] 35.6570μs 15.0888μs 66.2745 KOps/s 65.8306 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[True-False-False-False-False] 44.6340μs 10.3373μs 96.7370 KOps/s 98.6793 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-True-True-True-True] 53.7710μs 24.4864μs 40.8390 KOps/s 40.7691 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[False-True-True-True-False] 50.4040μs 16.0652μs 62.2462 KOps/s 62.9478 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[False-True-True-False-True] 71.9250μs 16.3356μs 61.2158 KOps/s 61.7138 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[False-True-True-False-False] 55.8840μs 10.3027μs 97.0618 KOps/s 98.7340 KOps/s $\color{#d91a1a}-1.69\%$
test_step_mdp_speed[False-True-False-True-True] 50.5740μs 25.4456μs 39.2996 KOps/s 38.8924 KOps/s $\color{#35bf28}+1.05\%$
test_step_mdp_speed[False-True-False-True-False] 49.5530μs 17.1584μs 58.2805 KOps/s 58.8807 KOps/s $\color{#d91a1a}-1.02\%$
test_step_mdp_speed[False-True-False-False-True] 39.8950μs 17.5472μs 56.9890 KOps/s 57.2215 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[False-True-False-False-False] 53.9510μs 11.3628μs 88.0062 KOps/s 88.5729 KOps/s $\color{#d91a1a}-0.64\%$
test_step_mdp_speed[False-False-True-True-True] 59.4220μs 26.5857μs 37.6142 KOps/s 36.9776 KOps/s $\color{#35bf28}+1.72\%$
test_step_mdp_speed[False-False-True-True-False] 41.6480μs 18.5421μs 53.9312 KOps/s 54.4696 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-False-True-False-True] 42.7290μs 17.4144μs 57.4237 KOps/s 57.6621 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[False-False-True-False-False] 30.6480μs 11.5724μs 86.4128 KOps/s 87.6609 KOps/s $\color{#d91a1a}-1.42\%$
test_step_mdp_speed[False-False-False-True-True] 48.8820μs 28.1763μs 35.4908 KOps/s 35.3978 KOps/s $\color{#35bf28}+0.26\%$
test_step_mdp_speed[False-False-False-True-False] 54.7420μs 19.5207μs 51.2278 KOps/s 51.3356 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[False-False-False-False-True] 49.9740μs 18.3287μs 54.5592 KOps/s 54.3819 KOps/s $\color{#35bf28}+0.33\%$
test_step_mdp_speed[False-False-False-False-False] 34.0340μs 12.6277μs 79.1908 KOps/s 81.8410 KOps/s $\color{#d91a1a}-3.24\%$
test_values[generalized_advantage_estimate-True-True] 9.6256ms 9.3685ms 106.7411 Ops/s 104.9677 Ops/s $\color{#35bf28}+1.69\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.7570ms 34.9209ms 28.6362 Ops/s 28.4274 Ops/s $\color{#35bf28}+0.73\%$
test_values[td0_return_estimate-False-False] 0.2356ms 0.1724ms 5.7997 KOps/s 5.6534 KOps/s $\color{#35bf28}+2.59\%$
test_values[td1_return_estimate-False-False] 23.8613ms 23.4665ms 42.6140 Ops/s 42.3597 Ops/s $\color{#35bf28}+0.60\%$
test_values[vec_td1_return_estimate-False-False] 36.2475ms 34.8518ms 28.6929 Ops/s 28.4883 Ops/s $\color{#35bf28}+0.72\%$
test_values[td_lambda_return_estimate-True-False] 36.9844ms 34.0393ms 29.3778 Ops/s 29.2120 Ops/s $\color{#35bf28}+0.57\%$
test_values[vec_td_lambda_return_estimate-True-False] 38.5488ms 35.0484ms 28.5319 Ops/s 28.3708 Ops/s $\color{#35bf28}+0.57\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 10.2616ms 8.3365ms 119.9548 Ops/s 119.9759 Ops/s $\color{#d91a1a}-0.02\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.8937ms 1.7915ms 558.2069 Ops/s 539.4870 Ops/s $\color{#35bf28}+3.47\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4154ms 0.3531ms 2.8323 KOps/s 2.7711 KOps/s $\color{#35bf28}+2.21\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.5858ms 45.3197ms 22.0655 Ops/s 22.6367 Ops/s $\color{#d91a1a}-2.52\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.5144ms 3.0385ms 329.1094 Ops/s 331.2157 Ops/s $\color{#d91a1a}-0.64\%$
test_dqn_speed 6.6730ms 1.3514ms 739.9794 Ops/s 721.5743 Ops/s $\color{#35bf28}+2.55\%$
test_ddpg_speed 3.1206ms 2.8472ms 351.2211 Ops/s 346.3954 Ops/s $\color{#35bf28}+1.39\%$
test_sac_speed 10.0682ms 8.4556ms 118.2652 Ops/s 115.4638 Ops/s $\color{#35bf28}+2.43\%$
test_redq_speed 14.6289ms 13.5129ms 74.0034 Ops/s 68.7626 Ops/s $\textbf{\color{#35bf28}+7.62\%}$
test_redq_deprec_speed 14.6530ms 13.4707ms 74.2350 Ops/s 72.1835 Ops/s $\color{#35bf28}+2.84\%$
test_td3_speed 8.5703ms 8.3234ms 120.1435 Ops/s 117.4331 Ops/s $\color{#35bf28}+2.31\%$
test_cql_speed 38.2334ms 36.6776ms 27.2646 Ops/s 27.0700 Ops/s $\color{#35bf28}+0.72\%$
test_a2c_speed 8.2171ms 7.4644ms 133.9698 Ops/s 132.6284 Ops/s $\color{#35bf28}+1.01\%$
test_ppo_speed 9.0452ms 7.6674ms 130.4218 Ops/s 129.8028 Ops/s $\color{#35bf28}+0.48\%$
test_reinforce_speed 7.1854ms 6.6416ms 150.5661 Ops/s 147.0805 Ops/s $\color{#35bf28}+2.37\%$
test_iql_speed 34.7131ms 33.3667ms 29.9700 Ops/s 29.8493 Ops/s $\color{#35bf28}+0.40\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0636ms 2.0948ms 477.3746 Ops/s 458.0711 Ops/s $\color{#35bf28}+4.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6179ms 0.4896ms 2.0423 KOps/s 2.0112 KOps/s $\color{#35bf28}+1.55\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.6037ms 0.4767ms 2.0976 KOps/s 2.1066 KOps/s $\color{#d91a1a}-0.43\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.3437ms 2.2373ms 446.9754 Ops/s 459.9499 Ops/s $\color{#d91a1a}-2.82\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8640ms 0.4875ms 2.0512 KOps/s 2.0319 KOps/s $\color{#35bf28}+0.95\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6137ms 0.4678ms 2.1376 KOps/s 2.1309 KOps/s $\color{#35bf28}+0.32\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.9076ms 1.2311ms 812.2491 Ops/s 804.9949 Ops/s $\color{#35bf28}+0.90\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 3.0268ms 1.1889ms 841.1237 Ops/s 850.3180 Ops/s $\color{#d91a1a}-1.08\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.5454ms 2.3059ms 433.6664 Ops/s 434.3032 Ops/s $\color{#d91a1a}-0.15\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0200ms 0.6375ms 1.5686 KOps/s 1.6272 KOps/s $\color{#d91a1a}-3.60\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.6006ms 0.5880ms 1.7005 KOps/s 1.7015 KOps/s $\color{#d91a1a}-0.06\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.2874ms 2.0979ms 476.6726 Ops/s 444.4563 Ops/s $\textbf{\color{#35bf28}+7.25\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9460ms 0.5002ms 1.9992 KOps/s 1.9819 KOps/s $\color{#35bf28}+0.87\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.5949ms 0.4784ms 2.0904 KOps/s 2.0979 KOps/s $\color{#d91a1a}-0.36\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0052ms 2.0904ms 478.3730 Ops/s 456.9789 Ops/s $\color{#35bf28}+4.68\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0838ms 0.4912ms 2.0359 KOps/s 2.0658 KOps/s $\color{#d91a1a}-1.45\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5708ms 0.4609ms 2.1695 KOps/s 2.1070 KOps/s $\color{#35bf28}+2.97\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0580ms 2.2828ms 438.0653 Ops/s 448.5305 Ops/s $\color{#d91a1a}-2.33\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8823ms 0.6119ms 1.6342 KOps/s 1.6429 KOps/s $\color{#d91a1a}-0.53\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.7915ms 0.5894ms 1.6965 KOps/s 1.6842 KOps/s $\color{#35bf28}+0.74\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1051s 5.6729ms 176.2771 Ops/s 130.2527 Ops/s $\textbf{\color{#35bf28}+35.33\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.5921ms 12.2841ms 81.4058 Ops/s 80.7973 Ops/s $\color{#35bf28}+0.75\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.5725ms 1.0685ms 935.8686 Ops/s 945.0929 Ops/s $\color{#d91a1a}-0.98\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1127s 7.8951ms 126.6612 Ops/s 181.6431 Ops/s $\textbf{\color{#d91a1a}-30.27\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.6027ms 12.3321ms 81.0892 Ops/s 81.8322 Ops/s $\color{#d91a1a}-0.91\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.5803ms 1.0503ms 952.1375 Ops/s 962.3537 Ops/s $\color{#d91a1a}-1.06\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1012s 5.9768ms 167.3123 Ops/s 126.0483 Ops/s $\textbf{\color{#35bf28}+32.74\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.1367ms 12.6286ms 79.1851 Ops/s 79.1334 Ops/s $\color{#35bf28}+0.07\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.0605ms 1.4156ms 706.4008 Ops/s 691.0284 Ops/s $\color{#35bf28}+2.22\%$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}1$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1143s 0.1139s 8.7807 Ops/s 8.4362 Ops/s $\color{#35bf28}+4.08\%$
test_sync 0.1020s 0.1006s 9.9366 Ops/s 9.9985 Ops/s $\color{#d91a1a}-0.62\%$
test_async 0.1938s 98.1073ms 10.1929 Ops/s 10.4195 Ops/s $\color{#d91a1a}-2.17\%$
test_single_pixels 0.1255s 0.1250s 7.9996 Ops/s 7.8096 Ops/s $\color{#35bf28}+2.43\%$
test_sync_pixels 83.5176ms 81.7049ms 12.2392 Ops/s 12.5428 Ops/s $\color{#d91a1a}-2.42\%$
test_async_pixels 0.1592s 68.8378ms 14.5269 Ops/s 14.3760 Ops/s $\color{#35bf28}+1.05\%$
test_simple 0.7550s 0.7467s 1.3392 Ops/s 1.3173 Ops/s $\color{#35bf28}+1.66\%$
test_transformed 1.0029s 0.9999s 1.0001 Ops/s 0.9825 Ops/s $\color{#35bf28}+1.79\%$
test_serial 2.4883s 2.4098s 0.4150 Ops/s 0.4089 Ops/s $\color{#35bf28}+1.49\%$
test_parallel 2.3444s 2.2946s 0.4358 Ops/s 0.4317 Ops/s $\color{#35bf28}+0.95\%$
test_step_mdp_speed[True-True-True-True-True] 67.3500μs 32.9330μs 30.3647 KOps/s 29.5533 KOps/s $\color{#35bf28}+2.75\%$
test_step_mdp_speed[True-True-True-True-False] 42.6300μs 19.6065μs 51.0034 KOps/s 49.9922 KOps/s $\color{#35bf28}+2.02\%$
test_step_mdp_speed[True-True-True-False-True] 43.1600μs 18.7444μs 53.3494 KOps/s 51.4741 KOps/s $\color{#35bf28}+3.64\%$
test_step_mdp_speed[True-True-True-False-False] 80.8410μs 11.1807μs 89.4395 KOps/s 87.6734 KOps/s $\color{#35bf28}+2.01\%$
test_step_mdp_speed[True-True-False-True-True] 66.7620μs 33.4196μs 29.9226 KOps/s 28.3004 KOps/s $\textbf{\color{#35bf28}+5.73\%}$
test_step_mdp_speed[True-True-False-True-False] 37.2510μs 21.0193μs 47.5753 KOps/s 46.1471 KOps/s $\color{#35bf28}+3.09\%$
test_step_mdp_speed[True-True-False-False-True] 56.0900μs 20.3615μs 49.1122 KOps/s 49.3187 KOps/s $\color{#d91a1a}-0.42\%$
test_step_mdp_speed[True-True-False-False-False] 34.9210μs 13.0258μs 76.7708 KOps/s 76.8522 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-False-True-True-True] 61.6510μs 35.7611μs 27.9633 KOps/s 26.8778 KOps/s $\color{#35bf28}+4.04\%$
test_step_mdp_speed[True-False-True-True-False] 56.1600μs 23.1531μs 43.1908 KOps/s 42.2009 KOps/s $\color{#35bf28}+2.35\%$
test_step_mdp_speed[True-False-True-False-True] 39.0000μs 20.1236μs 49.6929 KOps/s 48.1210 KOps/s $\color{#35bf28}+3.27\%$
test_step_mdp_speed[True-False-True-False-False] 29.6200μs 12.9395μs 77.2828 KOps/s 73.9543 KOps/s $\color{#35bf28}+4.50\%$
test_step_mdp_speed[True-False-False-True-True] 67.5410μs 37.6433μs 26.5652 KOps/s 25.5098 KOps/s $\color{#35bf28}+4.14\%$
test_step_mdp_speed[True-False-False-True-False] 50.3910μs 25.1501μs 39.7613 KOps/s 38.8991 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[True-False-False-False-True] 37.3900μs 21.9184μs 45.6238 KOps/s 43.5737 KOps/s $\color{#35bf28}+4.70\%$
test_step_mdp_speed[True-False-False-False-False] 29.8200μs 14.7584μs 67.7580 KOps/s 65.3641 KOps/s $\color{#35bf28}+3.66\%$
test_step_mdp_speed[False-True-True-True-True] 52.6000μs 35.6055μs 28.0856 KOps/s 26.4026 KOps/s $\textbf{\color{#35bf28}+6.37\%}$
test_step_mdp_speed[False-True-True-True-False] 44.0710μs 23.2051μs 43.0940 KOps/s 42.3046 KOps/s $\color{#35bf28}+1.87\%$
test_step_mdp_speed[False-True-True-False-True] 49.7800μs 24.1810μs 41.3548 KOps/s 39.8156 KOps/s $\color{#35bf28}+3.87\%$
test_step_mdp_speed[False-True-True-False-False] 47.5500μs 14.6417μs 68.2979 KOps/s 65.6525 KOps/s $\color{#35bf28}+4.03\%$
test_step_mdp_speed[False-True-False-True-True] 59.6800μs 38.1411μs 26.2184 KOps/s 25.6763 KOps/s $\color{#35bf28}+2.11\%$
test_step_mdp_speed[False-True-False-True-False] 42.0500μs 25.2049μs 39.6748 KOps/s 38.7194 KOps/s $\color{#35bf28}+2.47\%$
test_step_mdp_speed[False-True-False-False-True] 47.8220μs 26.4474μs 37.8109 KOps/s 37.0087 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-True-False-False-False] 36.0010μs 16.7826μs 59.5857 KOps/s 58.3174 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-False-True-True-True] 71.2200μs 40.3704μs 24.7706 KOps/s 24.7344 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[False-False-True-True-False] 43.7500μs 27.2817μs 36.6546 KOps/s 36.4189 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[False-False-True-False-True] 44.8400μs 25.7977μs 38.7632 KOps/s 37.7924 KOps/s $\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-False-True-False-False] 56.9200μs 16.8941μs 59.1921 KOps/s 58.9945 KOps/s $\color{#35bf28}+0.33\%$
test_step_mdp_speed[False-False-False-True-True] 67.8100μs 42.4080μs 23.5804 KOps/s 22.2496 KOps/s $\textbf{\color{#35bf28}+5.98\%}$
test_step_mdp_speed[False-False-False-True-False] 55.7110μs 29.2174μs 34.2262 KOps/s 33.9225 KOps/s $\color{#35bf28}+0.90\%$
test_step_mdp_speed[False-False-False-False-True] 58.1020μs 28.1419μs 35.5342 KOps/s 35.2518 KOps/s $\color{#35bf28}+0.80\%$
test_step_mdp_speed[False-False-False-False-False] 36.5310μs 18.5859μs 53.8042 KOps/s 53.9502 KOps/s $\color{#d91a1a}-0.27\%$
test_values[generalized_advantage_estimate-True-True] 25.3654ms 24.5117ms 40.7968 Ops/s 41.4163 Ops/s $\color{#d91a1a}-1.50\%$
test_values[vec_generalized_advantage_estimate-True-True] 81.1545ms 3.1887ms 313.6112 Ops/s 312.9074 Ops/s $\color{#35bf28}+0.22\%$
test_values[td0_return_estimate-False-False] 94.4910μs 63.0992μs 15.8481 KOps/s 15.4519 KOps/s $\color{#35bf28}+2.56\%$
test_values[td1_return_estimate-False-False] 53.9798ms 52.0135ms 19.2258 Ops/s 18.9422 Ops/s $\color{#35bf28}+1.50\%$
test_values[vec_td1_return_estimate-False-False] 2.1056ms 1.7562ms 569.4023 Ops/s 568.5536 Ops/s $\color{#35bf28}+0.15\%$
test_values[td_lambda_return_estimate-True-False] 84.1985ms 82.1714ms 12.1697 Ops/s 11.6501 Ops/s $\color{#35bf28}+4.46\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0734ms 1.7525ms 570.5976 Ops/s 568.9709 Ops/s $\color{#35bf28}+0.29\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.3469ms 23.0290ms 43.4235 Ops/s 43.2394 Ops/s $\color{#35bf28}+0.43\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8663ms 0.6854ms 1.4590 KOps/s 1.4463 KOps/s $\color{#35bf28}+0.88\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7138ms 0.6422ms 1.5572 KOps/s 1.5508 KOps/s $\color{#35bf28}+0.41\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4665ms 1.4420ms 693.4899 Ops/s 690.9761 Ops/s $\color{#35bf28}+0.36\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9195ms 0.6622ms 1.5101 KOps/s 1.5122 KOps/s $\color{#d91a1a}-0.14\%$
test_dqn_speed 77.2385ms 1.5865ms 630.3074 Ops/s 685.9357 Ops/s $\textbf{\color{#d91a1a}-8.11\%}$
test_ddpg_speed 3.2039ms 2.9332ms 340.9219 Ops/s 333.2776 Ops/s $\color{#35bf28}+2.29\%$
test_sac_speed 10.4226ms 8.5668ms 116.7297 Ops/s 117.0429 Ops/s $\color{#d91a1a}-0.27\%$
test_redq_speed 11.3901ms 10.4795ms 95.4241 Ops/s 94.2383 Ops/s $\color{#35bf28}+1.26\%$
test_redq_deprec_speed 12.1079ms 11.5803ms 86.3539 Ops/s 86.7207 Ops/s $\color{#d91a1a}-0.42\%$
test_td3_speed 17.2426ms 8.4709ms 118.0510 Ops/s 117.2812 Ops/s $\color{#35bf28}+0.66\%$
test_cql_speed 26.5731ms 25.7568ms 38.8248 Ops/s 38.8388 Ops/s $\color{#d91a1a}-0.04\%$
test_a2c_speed 6.4006ms 5.7533ms 173.8127 Ops/s 180.8133 Ops/s $\color{#d91a1a}-3.87\%$
test_ppo_speed 6.1755ms 6.0100ms 166.3881 Ops/s 172.1342 Ops/s $\color{#d91a1a}-3.34\%$
test_reinforce_speed 4.9317ms 4.6605ms 214.5697 Ops/s 220.6165 Ops/s $\color{#d91a1a}-2.74\%$
test_iql_speed 20.1930ms 19.8610ms 50.3499 Ops/s 51.8325 Ops/s $\color{#d91a1a}-2.86\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0278ms 2.8098ms 355.9018 Ops/s 353.8594 Ops/s $\color{#35bf28}+0.58\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6984ms 0.5949ms 1.6808 KOps/s 1.6776 KOps/s $\color{#35bf28}+0.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.5990ms 0.5680ms 1.7605 KOps/s 1.7546 KOps/s $\color{#35bf28}+0.33\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0279ms 2.8344ms 352.8120 Ops/s 349.9785 Ops/s $\color{#35bf28}+0.81\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8576ms 0.5824ms 1.7169 KOps/s 1.7031 KOps/s $\color{#35bf28}+0.81\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.4338ms 0.5640ms 1.7732 KOps/s 1.7688 KOps/s $\color{#35bf28}+0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6298ms 1.5060ms 664.0058 Ops/s 653.6445 Ops/s $\color{#35bf28}+1.59\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5614ms 1.4425ms 693.2364 Ops/s 691.8324 Ops/s $\color{#35bf28}+0.20\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0191ms 2.9046ms 344.2805 Ops/s 342.4508 Ops/s $\color{#35bf28}+0.53\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.5239ms 0.7149ms 1.3988 KOps/s 1.3863 KOps/s $\color{#35bf28}+0.90\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8913ms 0.6880ms 1.4536 KOps/s 1.4185 KOps/s $\color{#35bf28}+2.47\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9120ms 2.8164ms 355.0617 Ops/s 351.5895 Ops/s $\color{#35bf28}+0.99\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6983ms 0.5889ms 1.6981 KOps/s 1.6804 KOps/s $\color{#35bf28}+1.06\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.6106ms 0.5703ms 1.7534 KOps/s 1.7553 KOps/s $\color{#d91a1a}-0.11\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9923ms 2.8233ms 354.1993 Ops/s 351.5529 Ops/s $\color{#35bf28}+0.75\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6954ms 0.5810ms 1.7213 KOps/s 1.7084 KOps/s $\color{#35bf28}+0.75\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7145ms 0.5583ms 1.7911 KOps/s 1.7544 KOps/s $\color{#35bf28}+2.09\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0091ms 2.9512ms 338.8424 Ops/s 338.7763 Ops/s $\color{#35bf28}+0.02\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9217ms 0.7151ms 1.3983 KOps/s 1.3879 KOps/s $\color{#35bf28}+0.76\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.8535ms 0.6959ms 1.4369 KOps/s 1.4392 KOps/s $\color{#d91a1a}-0.16\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1250s 7.2527ms 137.8805 Ops/s 134.8972 Ops/s $\color{#35bf28}+2.21\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.1661ms 14.9664ms 66.8165 Ops/s 64.0882 Ops/s $\color{#35bf28}+4.26\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1994ms 1.1841ms 844.5042 Ops/s 836.9905 Ops/s $\color{#35bf28}+0.90\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1183s 9.3672ms 106.7560 Ops/s 104.9720 Ops/s $\color{#35bf28}+1.70\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.3380ms 15.0063ms 66.6386 Ops/s 64.1932 Ops/s $\color{#35bf28}+3.81\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.2418ms 1.1946ms 837.1211 Ops/s 837.3090 Ops/s $\color{#d91a1a}-0.02\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1195s 7.4893ms 133.5239 Ops/s 132.5527 Ops/s $\color{#35bf28}+0.73\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.7437ms 15.3317ms 65.2242 Ops/s 62.7441 Ops/s $\color{#35bf28}+3.95\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.7148ms 1.5721ms 636.0879 Ops/s 597.2220 Ops/s $\textbf{\color{#35bf28}+6.51\%}$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[BUG] Default Value Mismatch Between Documentation and Implementation of the ProbabilisticActor class
2 participants
@vmoens @facebook-github-bot