Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Run docs on all PRs #2413

Merged
merged 1 commit into from
Sep 2, 2024
Merged

[CI] Run docs on all PRs #2413

merged 1 commit into from
Sep 2, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Sep 2, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Sep 2, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2413

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (23 Unrelated Failures)

As of commit 57ec983 with merge base 94ef901 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 2, 2024
@vmoens vmoens merged commit e3384e2 into main Sep 2, 2024
17 of 27 checks passed
@vmoens vmoens deleted the vmoens-patch-1 branch September 2, 2024 16:35
@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 2, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 60.8519ms 59.5587ms 16.7902 Ops/s 16.9653 Ops/s $\color{#d91a1a}-1.03\%$
test_sync 38.8483ms 32.3928ms 30.8710 Ops/s 30.9661 Ops/s $\color{#d91a1a}-0.31\%$
test_async 67.3164ms 30.8160ms 32.4506 Ops/s 31.8863 Ops/s $\color{#35bf28}+1.77\%$
test_simple 0.4956s 0.4235s 2.3612 Ops/s 2.3620 Ops/s $\color{#d91a1a}-0.03\%$
test_transformed 0.6420s 0.5834s 1.7140 Ops/s 1.7266 Ops/s $\color{#d91a1a}-0.73\%$
test_serial 1.3499s 1.2871s 0.7769 Ops/s 0.7752 Ops/s $\color{#35bf28}+0.22\%$
test_parallel 1.1853s 1.1279s 0.8866 Ops/s 0.8927 Ops/s $\color{#d91a1a}-0.69\%$
test_step_mdp_speed[True-True-True-True-True] 0.3006ms 26.3959μs 37.8846 KOps/s 37.7614 KOps/s $\color{#35bf28}+0.33\%$
test_step_mdp_speed[True-True-True-True-False] 48.3910μs 15.5732μs 64.2129 KOps/s 63.8983 KOps/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[True-True-True-False-True] 43.4420μs 15.2836μs 65.4298 KOps/s 67.3172 KOps/s $\color{#d91a1a}-2.80\%$
test_step_mdp_speed[True-True-True-False-False] 31.6790μs 8.8537μs 112.9467 KOps/s 113.3286 KOps/s $\color{#d91a1a}-0.34\%$
test_step_mdp_speed[True-True-False-True-True] 63.7790μs 28.4513μs 35.1477 KOps/s 35.5219 KOps/s $\color{#d91a1a}-1.05\%$
test_step_mdp_speed[True-True-False-True-False] 47.2590μs 17.2601μs 57.9370 KOps/s 57.7512 KOps/s $\color{#35bf28}+0.32\%$
test_step_mdp_speed[True-True-False-False-True] 43.0700μs 16.7064μs 59.8572 KOps/s 59.7066 KOps/s $\color{#35bf28}+0.25\%$
test_step_mdp_speed[True-True-False-False-False] 56.0650μs 10.3536μs 96.5843 KOps/s 95.6508 KOps/s $\color{#35bf28}+0.98\%$
test_step_mdp_speed[True-False-True-True-True] 70.5420μs 30.0949μs 33.2283 KOps/s 33.0974 KOps/s $\color{#35bf28}+0.40\%$
test_step_mdp_speed[True-False-True-True-False] 63.8800μs 18.9085μs 52.8864 KOps/s 52.7470 KOps/s $\color{#35bf28}+0.26\%$
test_step_mdp_speed[True-False-True-False-True] 63.1490μs 16.7307μs 59.7705 KOps/s 61.5006 KOps/s $\color{#d91a1a}-2.81\%$
test_step_mdp_speed[True-False-True-False-False] 36.3480μs 10.4109μs 96.0533 KOps/s 97.0157 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[True-False-False-True-True] 72.3660μs 32.1877μs 31.0677 KOps/s 32.1372 KOps/s $\color{#d91a1a}-3.33\%$
test_step_mdp_speed[True-False-False-True-False] 49.5630μs 20.2188μs 49.4590 KOps/s 49.3909 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-False-False-False-True] 51.4360μs 18.2270μs 54.8636 KOps/s 55.7901 KOps/s $\color{#d91a1a}-1.66\%$
test_step_mdp_speed[True-False-False-False-False] 45.7260μs 11.9758μs 83.5018 KOps/s 85.1203 KOps/s $\color{#d91a1a}-1.90\%$
test_step_mdp_speed[False-True-True-True-True] 76.8540μs 30.0868μs 33.2372 KOps/s 33.5123 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[False-True-True-True-False] 58.8310μs 18.8400μs 53.0785 KOps/s 53.1913 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[False-True-True-False-True] 70.9030μs 19.7115μs 50.7319 KOps/s 51.7981 KOps/s $\color{#d91a1a}-2.06\%$
test_step_mdp_speed[False-True-True-False-False] 40.0560μs 11.7272μs 85.2719 KOps/s 86.0331 KOps/s $\color{#d91a1a}-0.88\%$
test_step_mdp_speed[False-True-False-True-True] 65.5530μs 31.8275μs 31.4194 KOps/s 31.9709 KOps/s $\color{#d91a1a}-1.73\%$
test_step_mdp_speed[False-True-False-True-False] 47.0780μs 20.6223μs 48.4913 KOps/s 49.1381 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[False-True-False-False-True] 74.1190μs 21.1628μs 47.2528 KOps/s 48.4016 KOps/s $\color{#d91a1a}-2.37\%$
test_step_mdp_speed[False-True-False-False-False] 40.4460μs 13.0501μs 76.6278 KOps/s 76.2682 KOps/s $\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-False-True-True-True] 3.0752ms 33.4140μs 29.9275 KOps/s 30.4843 KOps/s $\color{#d91a1a}-1.83\%$
test_step_mdp_speed[False-False-True-True-False] 57.3370μs 21.9929μs 45.4692 KOps/s 46.3178 KOps/s $\color{#d91a1a}-1.83\%$
test_step_mdp_speed[False-False-True-False-True] 54.2320μs 21.2180μs 47.1299 KOps/s 48.7579 KOps/s $\color{#d91a1a}-3.34\%$
test_step_mdp_speed[False-False-True-False-False] 52.0170μs 13.1856μs 75.8405 KOps/s 76.0411 KOps/s $\color{#d91a1a}-0.26\%$
test_step_mdp_speed[False-False-False-True-True] 75.6920μs 34.6120μs 28.8917 KOps/s 29.6296 KOps/s $\color{#d91a1a}-2.49\%$
test_step_mdp_speed[False-False-False-True-False] 59.4620μs 23.3753μs 42.7802 KOps/s 43.5530 KOps/s $\color{#d91a1a}-1.77\%$
test_step_mdp_speed[False-False-False-False-True] 56.8570μs 22.5286μs 44.3880 KOps/s 45.8015 KOps/s $\color{#d91a1a}-3.09\%$
test_step_mdp_speed[False-False-False-False-False] 38.7520μs 14.6350μs 68.3292 KOps/s 69.6911 KOps/s $\color{#d91a1a}-1.95\%$
test_values[generalized_advantage_estimate-True-True] 11.0529ms 9.4386ms 105.9476 Ops/s 106.3849 Ops/s $\color{#d91a1a}-0.41\%$
test_values[vec_generalized_advantage_estimate-True-True] 38.0779ms 35.9764ms 27.7960 Ops/s 28.1157 Ops/s $\color{#d91a1a}-1.14\%$
test_values[td0_return_estimate-False-False] 0.2232ms 0.1669ms 5.9904 KOps/s 5.6238 KOps/s $\textbf{\color{#35bf28}+6.52\%}$
test_values[td1_return_estimate-False-False] 25.1469ms 23.7324ms 42.1366 Ops/s 42.8464 Ops/s $\color{#d91a1a}-1.66\%$
test_values[vec_td1_return_estimate-False-False] 41.2031ms 36.3320ms 27.5240 Ops/s 28.1508 Ops/s $\color{#d91a1a}-2.23\%$
test_values[td_lambda_return_estimate-True-False] 34.8620ms 34.4358ms 29.0395 Ops/s 29.3102 Ops/s $\color{#d91a1a}-0.92\%$
test_values[vec_td_lambda_return_estimate-True-False] 38.6552ms 36.1191ms 27.6862 Ops/s 27.9827 Ops/s $\color{#d91a1a}-1.06\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.6241ms 8.3253ms 120.1160 Ops/s 123.3752 Ops/s $\color{#d91a1a}-2.64\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3431ms 2.0271ms 493.3124 Ops/s 516.0421 Ops/s $\color{#d91a1a}-4.40\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4740ms 0.3558ms 2.8105 KOps/s 2.7578 KOps/s $\color{#35bf28}+1.91\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 48.5807ms 45.0875ms 22.1791 Ops/s 21.0494 Ops/s $\textbf{\color{#35bf28}+5.37\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.3279ms 3.0260ms 330.4679 Ops/s 329.2981 Ops/s $\color{#35bf28}+0.36\%$
test_dqn_speed 6.1498ms 1.3037ms 767.0378 Ops/s 777.4866 Ops/s $\color{#d91a1a}-1.34\%$
test_ddpg_speed 3.4474ms 2.6911ms 371.5907 Ops/s 373.1771 Ops/s $\color{#d91a1a}-0.43\%$
test_sac_speed 9.1034ms 8.0016ms 124.9747 Ops/s 126.3040 Ops/s $\color{#d91a1a}-1.05\%$
test_redq_speed 13.9091ms 12.6983ms 78.7505 Ops/s 79.9477 Ops/s $\color{#d91a1a}-1.50\%$
test_redq_deprec_speed 13.3889ms 12.6013ms 79.3572 Ops/s 79.4306 Ops/s $\color{#d91a1a}-0.09\%$
test_td3_speed 8.2158ms 8.0096ms 124.8505 Ops/s 125.9770 Ops/s $\color{#d91a1a}-0.89\%$
test_cql_speed 37.9411ms 35.9980ms 27.7793 Ops/s 28.3506 Ops/s $\color{#d91a1a}-2.02\%$
test_a2c_speed 8.6256ms 7.2813ms 137.3376 Ops/s 136.1238 Ops/s $\color{#35bf28}+0.89\%$
test_ppo_speed 9.0332ms 7.6496ms 130.7265 Ops/s 133.5784 Ops/s $\color{#d91a1a}-2.14\%$
test_reinforce_speed 7.9116ms 6.5204ms 153.3659 Ops/s 154.0950 Ops/s $\color{#d91a1a}-0.47\%$
test_iql_speed 32.2906ms 31.8090ms 31.4376 Ops/s 31.5061 Ops/s $\color{#d91a1a}-0.22\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.5287ms 4.7746ms 209.4397 Ops/s 208.0789 Ops/s $\color{#35bf28}+0.65\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.4806ms 0.4778ms 2.0931 KOps/s 2.0921 KOps/s $\color{#35bf28}+0.05\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7031ms 0.4508ms 2.2184 KOps/s 2.1980 KOps/s $\color{#35bf28}+0.93\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.8734ms 4.7643ms 209.8950 Ops/s 211.0995 Ops/s $\color{#d91a1a}-0.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.2371ms 0.4724ms 2.1166 KOps/s 1.7993 KOps/s $\textbf{\color{#35bf28}+17.64\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6067ms 0.4439ms 2.2526 KOps/s 2.2222 KOps/s $\color{#35bf28}+1.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8969ms 1.6787ms 595.7147 Ops/s 594.7288 Ops/s $\color{#35bf28}+0.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.7217ms 1.6097ms 621.2343 Ops/s 629.4467 Ops/s $\color{#d91a1a}-1.30\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.1271ms 4.9530ms 201.8977 Ops/s 203.2558 Ops/s $\color{#d91a1a}-0.67\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9065ms 0.6131ms 1.6310 KOps/s 1.6231 KOps/s $\color{#35bf28}+0.49\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8583ms 0.5847ms 1.7102 KOps/s 1.6935 KOps/s $\color{#35bf28}+0.98\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.1399ms 4.8458ms 206.3662 Ops/s 208.7772 Ops/s $\color{#d91a1a}-1.15\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1139s 0.6137ms 1.6294 KOps/s 2.1021 KOps/s $\textbf{\color{#d91a1a}-22.49\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6841ms 0.4537ms 2.2040 KOps/s 2.2016 KOps/s $\color{#35bf28}+0.11\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.0501ms 4.7596ms 210.0999 Ops/s 210.9015 Ops/s $\color{#d91a1a}-0.38\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.5841ms 0.4734ms 2.1126 KOps/s 2.1143 KOps/s $\color{#d91a1a}-0.08\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 7.3351ms 0.4634ms 2.1578 KOps/s 2.2355 KOps/s $\color{#d91a1a}-3.48\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.7671ms 4.9232ms 203.1199 Ops/s 205.4653 Ops/s $\color{#d91a1a}-1.14\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0185ms 0.6123ms 1.6331 KOps/s 1.6289 KOps/s $\color{#35bf28}+0.26\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8098ms 0.5931ms 1.6861 KOps/s 1.7092 KOps/s $\color{#d91a1a}-1.35\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1309s 6.5063ms 153.6977 Ops/s 156.0945 Ops/s $\color{#d91a1a}-1.54\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.6329ms 13.1753ms 75.8997 Ops/s 77.1338 Ops/s $\color{#d91a1a}-1.60\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.8408ms 1.2702ms 787.2766 Ops/s 793.0396 Ops/s $\color{#d91a1a}-0.73\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1038s 5.8751ms 170.2088 Ops/s 165.6902 Ops/s $\color{#35bf28}+2.73\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 24.2430ms 13.3520ms 74.8952 Ops/s 77.5449 Ops/s $\color{#d91a1a}-3.42\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.6573ms 1.3325ms 750.4794 Ops/s 845.8501 Ops/s $\textbf{\color{#d91a1a}-11.28\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1038s 8.0429ms 124.3334 Ops/s 121.0554 Ops/s $\color{#35bf28}+2.71\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.1510ms 13.1610ms 75.9820 Ops/s 75.6114 Ops/s $\color{#35bf28}+0.49\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.0916ms 1.3952ms 716.7535 Ops/s 683.0200 Ops/s $\color{#35bf28}+4.94\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 2, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}9$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1024s 0.1022s 9.7879 Ops/s 9.8091 Ops/s $\color{#d91a1a}-0.22\%$
test_sync 93.8018ms 90.9151ms 10.9993 Ops/s 11.1639 Ops/s $\color{#d91a1a}-1.47\%$
test_async 0.1616s 82.6084ms 12.1053 Ops/s 11.5624 Ops/s $\color{#35bf28}+4.70\%$
test_single_pixels 0.1085s 0.1081s 9.2514 Ops/s 9.2119 Ops/s $\color{#35bf28}+0.43\%$
test_sync_pixels 72.6188ms 71.9448ms 13.8995 Ops/s 13.8145 Ops/s $\color{#35bf28}+0.62\%$
test_async_pixels 0.1311s 66.8849ms 14.9511 Ops/s 14.6514 Ops/s $\color{#35bf28}+2.05\%$
test_simple 0.8265s 0.7592s 1.3172 Ops/s 1.3458 Ops/s $\color{#d91a1a}-2.13\%$
test_transformed 1.0445s 0.9736s 1.0271 Ops/s 1.0555 Ops/s $\color{#d91a1a}-2.69\%$
test_serial 2.1548s 2.0764s 0.4816 Ops/s 0.4910 Ops/s $\color{#d91a1a}-1.92\%$
test_parallel 1.9369s 1.8816s 0.5315 Ops/s 0.5341 Ops/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[True-True-True-True-True] 0.2480ms 36.6148μs 27.3114 KOps/s 27.4272 KOps/s $\color{#d91a1a}-0.42\%$
test_step_mdp_speed[True-True-True-True-False] 51.3710μs 21.1129μs 47.3644 KOps/s 47.9454 KOps/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-True-True-False-True] 56.6210μs 20.7838μs 48.1143 KOps/s 49.2997 KOps/s $\color{#d91a1a}-2.40\%$
test_step_mdp_speed[True-True-True-False-False] 38.0210μs 11.9291μs 83.8288 KOps/s 84.6606 KOps/s $\color{#d91a1a}-0.98\%$
test_step_mdp_speed[True-True-False-True-True] 69.3110μs 38.4732μs 25.9921 KOps/s 25.9323 KOps/s $\color{#35bf28}+0.23\%$
test_step_mdp_speed[True-True-False-True-False] 93.3020μs 23.0954μs 43.2987 KOps/s 43.5061 KOps/s $\color{#d91a1a}-0.48\%$
test_step_mdp_speed[True-True-False-False-True] 54.6700μs 23.0248μs 43.4314 KOps/s 44.0415 KOps/s $\color{#d91a1a}-1.39\%$
test_step_mdp_speed[True-True-False-False-False] 48.6910μs 13.8632μs 72.1333 KOps/s 71.5906 KOps/s $\color{#35bf28}+0.76\%$
test_step_mdp_speed[True-False-True-True-True] 0.1169ms 41.2394μs 24.2487 KOps/s 24.4089 KOps/s $\color{#d91a1a}-0.66\%$
test_step_mdp_speed[True-False-True-True-False] 61.0210μs 25.3340μs 39.4726 KOps/s 39.6095 KOps/s $\color{#d91a1a}-0.35\%$
test_step_mdp_speed[True-False-True-False-True] 96.4820μs 22.8635μs 43.7378 KOps/s 43.4899 KOps/s $\color{#35bf28}+0.57\%$
test_step_mdp_speed[True-False-True-False-False] 41.9610μs 13.8573μs 72.1639 KOps/s 71.3984 KOps/s $\color{#35bf28}+1.07\%$
test_step_mdp_speed[True-False-False-True-True] 73.2520μs 42.7679μs 23.3820 KOps/s 23.7421 KOps/s $\color{#d91a1a}-1.52\%$
test_step_mdp_speed[True-False-False-True-False] 55.7210μs 27.4719μs 36.4008 KOps/s 37.0496 KOps/s $\color{#d91a1a}-1.75\%$
test_step_mdp_speed[True-False-False-False-True] 56.1810μs 24.9666μs 40.0536 KOps/s 40.4998 KOps/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-False-False-False-False] 73.5010μs 15.3383μs 65.1962 KOps/s 62.7220 KOps/s $\color{#35bf28}+3.94\%$
test_step_mdp_speed[False-True-True-True-True] 65.0010μs 40.2486μs 24.8456 KOps/s 24.8029 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[False-True-True-True-False] 54.6510μs 25.2577μs 39.5919 KOps/s 39.5158 KOps/s $\color{#35bf28}+0.19\%$
test_step_mdp_speed[False-True-True-False-True] 55.3500μs 26.5552μs 37.6574 KOps/s 38.2176 KOps/s $\color{#d91a1a}-1.47\%$
test_step_mdp_speed[False-True-True-False-False] 37.7810μs 15.7735μs 63.3976 KOps/s 65.7869 KOps/s $\color{#d91a1a}-3.63\%$
test_step_mdp_speed[False-True-False-True-True] 75.7710μs 43.5762μs 22.9483 KOps/s 23.9479 KOps/s $\color{#d91a1a}-4.17\%$
test_step_mdp_speed[False-True-False-True-False] 60.0610μs 27.2611μs 36.6823 KOps/s 37.5334 KOps/s $\color{#d91a1a}-2.27\%$
test_step_mdp_speed[False-True-False-False-True] 94.3220μs 28.4783μs 35.1145 KOps/s 35.4781 KOps/s $\color{#d91a1a}-1.03\%$
test_step_mdp_speed[False-True-False-False-False] 44.0510μs 17.6330μs 56.7117 KOps/s 56.8003 KOps/s $\color{#d91a1a}-0.16\%$
test_step_mdp_speed[False-False-True-True-True] 4.1030ms 45.4080μs 22.0226 KOps/s 22.1726 KOps/s $\color{#d91a1a}-0.68\%$
test_step_mdp_speed[False-False-True-True-False] 66.5010μs 29.3220μs 34.1041 KOps/s 34.3109 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[False-False-True-False-True] 55.1810μs 28.6929μs 34.8518 KOps/s 35.4208 KOps/s $\color{#d91a1a}-1.61\%$
test_step_mdp_speed[False-False-True-False-False] 44.8710μs 17.6163μs 56.7655 KOps/s 56.9101 KOps/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[False-False-False-True-True] 76.6310μs 46.8329μs 21.3525 KOps/s 21.3987 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-False-False-True-False] 57.8510μs 31.3559μs 31.8919 KOps/s 31.8662 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-False-False-False-True] 57.7110μs 30.3358μs 32.9643 KOps/s 33.4148 KOps/s $\color{#d91a1a}-1.35\%$
test_step_mdp_speed[False-False-False-False-False] 46.0810μs 19.7269μs 50.6921 KOps/s 50.9302 KOps/s $\color{#d91a1a}-0.47\%$
test_values[generalized_advantage_estimate-True-True] 24.2581ms 23.6727ms 42.2427 Ops/s 42.3761 Ops/s $\color{#d91a1a}-0.31\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1142s 3.1725ms 315.2091 Ops/s 321.2585 Ops/s $\color{#d91a1a}-1.88\%$
test_values[td0_return_estimate-False-False] 91.4610μs 66.1596μs 15.1150 KOps/s 15.4408 KOps/s $\color{#d91a1a}-2.11\%$
test_values[td1_return_estimate-False-False] 55.8547ms 53.8882ms 18.5569 Ops/s 18.6820 Ops/s $\color{#d91a1a}-0.67\%$
test_values[vec_td1_return_estimate-False-False] 1.4527ms 1.0950ms 913.2380 Ops/s 938.1582 Ops/s $\color{#d91a1a}-2.66\%$
test_values[td_lambda_return_estimate-True-False] 88.2009ms 85.1175ms 11.7485 Ops/s 11.8059 Ops/s $\color{#d91a1a}-0.49\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3834ms 1.0658ms 938.2536 Ops/s 940.5143 Ops/s $\color{#d91a1a}-0.24\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.3172ms 24.3536ms 41.0618 Ops/s 42.4791 Ops/s $\color{#d91a1a}-3.34\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9605ms 0.7112ms 1.4061 KOps/s 1.4189 KOps/s $\color{#d91a1a}-0.90\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7584ms 0.6568ms 1.5226 KOps/s 1.5279 KOps/s $\color{#d91a1a}-0.35\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4973ms 1.4548ms 687.3604 Ops/s 689.9166 Ops/s $\color{#d91a1a}-0.37\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7083ms 0.6707ms 1.4909 KOps/s 1.4992 KOps/s $\color{#d91a1a}-0.55\%$
test_dqn_speed 1.7604ms 1.2700ms 787.4245 Ops/s 805.6323 Ops/s $\color{#d91a1a}-2.26\%$
test_ddpg_speed 2.9565ms 2.5825ms 387.2229 Ops/s 393.1898 Ops/s $\color{#d91a1a}-1.52\%$
test_sac_speed 7.8153ms 7.5163ms 133.0450 Ops/s 134.5442 Ops/s $\color{#d91a1a}-1.11\%$
test_redq_speed 13.8652ms 9.8443ms 101.5812 Ops/s 99.6460 Ops/s $\color{#35bf28}+1.94\%$
test_redq_deprec_speed 12.1094ms 10.2682ms 97.3885 Ops/s 96.5128 Ops/s $\color{#35bf28}+0.91\%$
test_td3_speed 7.6492ms 7.5725ms 132.0559 Ops/s 133.0111 Ops/s $\color{#d91a1a}-0.72\%$
test_cql_speed 26.7727ms 24.2100ms 41.3052 Ops/s 41.2219 Ops/s $\color{#35bf28}+0.20\%$
test_a2c_speed 6.0994ms 5.1692ms 193.4540 Ops/s 186.1724 Ops/s $\color{#35bf28}+3.91\%$
test_ppo_speed 5.7895ms 5.4926ms 182.0623 Ops/s 179.5844 Ops/s $\color{#35bf28}+1.38\%$
test_reinforce_speed 4.5597ms 4.2793ms 233.6841 Ops/s 229.1564 Ops/s $\color{#35bf28}+1.98\%$
test_iql_speed 18.8395ms 18.3039ms 54.6332 Ops/s 53.8455 Ops/s $\color{#35bf28}+1.46\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.4530ms 6.3084ms 158.5188 Ops/s 159.4000 Ops/s $\color{#d91a1a}-0.55\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1064s 0.2748ms 3.6396 KOps/s 3.0954 KOps/s $\textbf{\color{#35bf28}+17.58\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6035ms 0.2098ms 4.7671 KOps/s 3.2884 KOps/s $\textbf{\color{#35bf28}+44.97\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.4922ms 6.2515ms 159.9621 Ops/s 161.6222 Ops/s $\color{#d91a1a}-1.03\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.4570ms 0.2586ms 3.8675 KOps/s 3.1510 KOps/s $\textbf{\color{#35bf28}+22.74\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5898ms 0.2084ms 4.7987 KOps/s 3.3508 KOps/s $\textbf{\color{#35bf28}+43.21\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.4846ms 1.3238ms 755.4205 Ops/s 678.3544 Ops/s $\textbf{\color{#35bf28}+11.36\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6270ms 1.2290ms 813.6552 Ops/s 759.5299 Ops/s $\textbf{\color{#35bf28}+7.13\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.5364ms 6.4035ms 156.1635 Ops/s 157.0317 Ops/s $\color{#d91a1a}-0.55\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1399s 0.4816ms 2.0765 KOps/s 2.6879 KOps/s $\textbf{\color{#d91a1a}-22.75\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.5398ms 0.3580ms 2.7933 KOps/s 2.8343 KOps/s $\color{#d91a1a}-1.45\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.4178ms 6.3237ms 158.1347 Ops/s 158.7652 Ops/s $\color{#d91a1a}-0.40\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.3238ms 0.2345ms 4.2650 KOps/s 4.2852 KOps/s $\color{#d91a1a}-0.47\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.3742ms 0.2138ms 4.6768 KOps/s 4.7796 KOps/s $\color{#d91a1a}-2.15\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.4797ms 6.2048ms 161.1651 Ops/s 161.4132 Ops/s $\color{#d91a1a}-0.15\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.4931ms 0.3081ms 3.2452 KOps/s 4.3707 KOps/s $\textbf{\color{#d91a1a}-25.75\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4708ms 0.2901ms 3.4471 KOps/s 4.8310 KOps/s $\textbf{\color{#d91a1a}-28.65\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.5558ms 6.4272ms 155.5878 Ops/s 156.5060 Ops/s $\color{#d91a1a}-0.59\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.6850ms 0.4377ms 2.2848 KOps/s 2.6443 KOps/s $\textbf{\color{#d91a1a}-13.59\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6797ms 0.4200ms 2.3809 KOps/s 1.9414 KOps/s $\textbf{\color{#35bf28}+22.64\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1565s 8.0977ms 123.4915 Ops/s 123.3876 Ops/s $\color{#35bf28}+0.08\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 20.9805ms 15.9496ms 62.6976 Ops/s 62.8424 Ops/s $\color{#d91a1a}-0.23\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 11.4943ms 1.3557ms 737.6472 Ops/s 936.7908 Ops/s $\textbf{\color{#d91a1a}-21.26\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1242s 9.8723ms 101.2934 Ops/s 101.9798 Ops/s $\color{#d91a1a}-0.67\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 20.9590ms 15.9566ms 62.6698 Ops/s 63.9835 Ops/s $\color{#d91a1a}-2.05\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.2360ms 1.0732ms 931.8296 Ops/s 825.1432 Ops/s $\textbf{\color{#35bf28}+12.93\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1248s 7.6787ms 130.2295 Ops/s 130.8183 Ops/s $\color{#d91a1a}-0.45\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 21.0508ms 16.1212ms 62.0300 Ops/s 63.0763 Ops/s $\color{#d91a1a}-1.66\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.8975ms 1.0485ms 953.7144 Ops/s 777.1048 Ops/s $\textbf{\color{#35bf28}+22.73\%}$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot