Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BugFix] Fix info reading with async gym #2150

Merged
merged 6 commits into from
May 3, 2024
Merged

[BugFix] Fix info reading with async gym #2150

merged 6 commits into from
May 3, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented May 2, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented May 2, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2150

Note: Links to docs will display an error until the docs builds have been completed.

❌ 9 New Failures, 1 Unrelated Failure

As of commit d0f6ad3 with merge base 5b9cb44 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 2, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented May 2, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}5$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 54.7594ms 54.4493ms 18.3657 Ops/s 18.5678 Ops/s $\color{#d91a1a}-1.09\%$
test_sync 45.6622ms 29.9789ms 33.3568 Ops/s 32.6815 Ops/s $\color{#35bf28}+2.07\%$
test_async 53.2532ms 26.4005ms 37.8781 Ops/s 36.6795 Ops/s $\color{#35bf28}+3.27\%$
test_simple 0.4025s 0.3473s 2.8791 Ops/s 2.9452 Ops/s $\color{#d91a1a}-2.24\%$
test_transformed 0.4957s 0.4889s 2.0455 Ops/s 1.9825 Ops/s $\color{#35bf28}+3.18\%$
test_serial 1.2854s 1.2296s 0.8133 Ops/s 0.7993 Ops/s $\color{#35bf28}+1.76\%$
test_parallel 1.0639s 1.0133s 0.9869 Ops/s 0.9841 Ops/s $\color{#35bf28}+0.28\%$
test_step_mdp_speed[True-True-True-True-True] 0.1155ms 21.3618μs 46.8126 KOps/s 45.6170 KOps/s $\color{#35bf28}+2.62\%$
test_step_mdp_speed[True-True-True-True-False] 48.7300μs 12.7942μs 78.1606 KOps/s 75.3045 KOps/s $\color{#35bf28}+3.79\%$
test_step_mdp_speed[True-True-True-False-True] 36.8080μs 12.4309μs 80.4448 KOps/s 78.7130 KOps/s $\color{#35bf28}+2.20\%$
test_step_mdp_speed[True-True-True-False-False] 42.1680μs 7.4465μs 134.2910 KOps/s 130.3105 KOps/s $\color{#35bf28}+3.05\%$
test_step_mdp_speed[True-True-False-True-True] 54.1100μs 22.8377μs 43.7873 KOps/s 43.2008 KOps/s $\color{#35bf28}+1.36\%$
test_step_mdp_speed[True-True-False-True-False] 48.0990μs 13.9855μs 71.5029 KOps/s 68.8231 KOps/s $\color{#35bf28}+3.89\%$
test_step_mdp_speed[True-True-False-False-True] 48.1000μs 13.6311μs 73.3615 KOps/s 71.2969 KOps/s $\color{#35bf28}+2.90\%$
test_step_mdp_speed[True-True-False-False-False] 53.8500μs 8.5906μs 116.4058 KOps/s 111.2754 KOps/s $\color{#35bf28}+4.61\%$
test_step_mdp_speed[True-False-True-True-True] 60.4120μs 24.0051μs 41.6578 KOps/s 40.5527 KOps/s $\color{#35bf28}+2.73\%$
test_step_mdp_speed[True-False-True-True-False] 44.0720μs 15.6438μs 63.9230 KOps/s 62.5979 KOps/s $\color{#35bf28}+2.12\%$
test_step_mdp_speed[True-False-True-False-True] 45.4140μs 13.7948μs 72.4913 KOps/s 71.1535 KOps/s $\color{#35bf28}+1.88\%$
test_step_mdp_speed[True-False-True-False-False] 25.3970μs 8.7444μs 114.3588 KOps/s 110.7386 KOps/s $\color{#35bf28}+3.27\%$
test_step_mdp_speed[True-False-False-True-True] 68.6470μs 25.1475μs 39.7653 KOps/s 38.5990 KOps/s $\color{#35bf28}+3.02\%$
test_step_mdp_speed[True-False-False-True-False] 60.3020μs 16.9052μs 59.1535 KOps/s 57.8855 KOps/s $\color{#35bf28}+2.19\%$
test_step_mdp_speed[True-False-False-False-True] 45.6750μs 14.9288μs 66.9844 KOps/s 65.5169 KOps/s $\color{#35bf28}+2.24\%$
test_step_mdp_speed[True-False-False-False-False] 46.4160μs 9.7535μs 102.5269 KOps/s 97.5098 KOps/s $\textbf{\color{#35bf28}+5.15\%}$
test_step_mdp_speed[False-True-True-True-True] 54.1000μs 23.7846μs 42.0440 KOps/s 40.6041 KOps/s $\color{#35bf28}+3.55\%$
test_step_mdp_speed[False-True-True-True-False] 50.4030μs 15.4694μs 64.6438 KOps/s 63.0530 KOps/s $\color{#35bf28}+2.52\%$
test_step_mdp_speed[False-True-True-False-True] 47.5990μs 15.6177μs 64.0301 KOps/s 61.3555 KOps/s $\color{#35bf28}+4.36\%$
test_step_mdp_speed[False-True-True-False-False] 67.6570μs 9.8425μs 101.6004 KOps/s 97.2465 KOps/s $\color{#35bf28}+4.48\%$
test_step_mdp_speed[False-True-False-True-True] 53.6900μs 24.9712μs 40.0462 KOps/s 38.7597 KOps/s $\color{#35bf28}+3.32\%$
test_step_mdp_speed[False-True-False-True-False] 64.5800μs 16.7093μs 59.8469 KOps/s 58.5682 KOps/s $\color{#35bf28}+2.18\%$
test_step_mdp_speed[False-True-False-False-True] 35.4360μs 16.9637μs 58.9493 KOps/s 56.2773 KOps/s $\color{#35bf28}+4.75\%$
test_step_mdp_speed[False-True-False-False-False] 51.3950μs 11.0709μs 90.3265 KOps/s 87.7959 KOps/s $\color{#35bf28}+2.88\%$
test_step_mdp_speed[False-False-True-True-True] 58.4190μs 26.2807μs 38.0507 KOps/s 36.6679 KOps/s $\color{#35bf28}+3.77\%$
test_step_mdp_speed[False-False-True-True-False] 54.8110μs 18.0665μs 55.3511 KOps/s 53.6027 KOps/s $\color{#35bf28}+3.26\%$
test_step_mdp_speed[False-False-True-False-True] 42.6790μs 16.9681μs 58.9339 KOps/s 56.3685 KOps/s $\color{#35bf28}+4.55\%$
test_step_mdp_speed[False-False-True-False-False] 30.4670μs 11.1333μs 89.8206 KOps/s 85.9933 KOps/s $\color{#35bf28}+4.45\%$
test_step_mdp_speed[False-False-False-True-True] 44.4920μs 27.9034μs 35.8379 KOps/s 34.5421 KOps/s $\color{#35bf28}+3.75\%$
test_step_mdp_speed[False-False-False-True-False] 50.1630μs 19.1342μs 52.2624 KOps/s 50.7510 KOps/s $\color{#35bf28}+2.98\%$
test_step_mdp_speed[False-False-False-False-True] 48.6610μs 18.0698μs 55.3410 KOps/s 53.4243 KOps/s $\color{#35bf28}+3.59\%$
test_step_mdp_speed[False-False-False-False-False] 36.5880μs 12.2360μs 81.7262 KOps/s 79.1266 KOps/s $\color{#35bf28}+3.29\%$
test_values[generalized_advantage_estimate-True-True] 10.6748ms 9.5714ms 104.4775 Ops/s 105.6796 Ops/s $\color{#d91a1a}-1.14\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.9122ms 35.7546ms 27.9684 Ops/s 27.8086 Ops/s $\color{#35bf28}+0.57\%$
test_values[td0_return_estimate-False-False] 0.2393ms 0.1764ms 5.6675 KOps/s 5.8076 KOps/s $\color{#d91a1a}-2.41\%$
test_values[td1_return_estimate-False-False] 26.4068ms 23.4809ms 42.5878 Ops/s 42.9506 Ops/s $\color{#d91a1a}-0.84\%$
test_values[vec_td1_return_estimate-False-False] 38.1047ms 35.5098ms 28.1612 Ops/s 28.0443 Ops/s $\color{#35bf28}+0.42\%$
test_values[td_lambda_return_estimate-True-False] 35.0166ms 33.7153ms 29.6601 Ops/s 29.7422 Ops/s $\color{#d91a1a}-0.28\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.7403ms 35.5479ms 28.1311 Ops/s 28.1757 Ops/s $\color{#d91a1a}-0.16\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.5333ms 8.3801ms 119.3297 Ops/s 119.2666 Ops/s $\color{#35bf28}+0.05\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.4712ms 2.0009ms 499.7832 Ops/s 495.2967 Ops/s $\color{#35bf28}+0.91\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4298ms 0.3550ms 2.8165 KOps/s 2.8679 KOps/s $\color{#d91a1a}-1.79\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.7741ms 45.1395ms 22.1535 Ops/s 20.9816 Ops/s $\textbf{\color{#35bf28}+5.59\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.8123ms 3.0582ms 326.9942 Ops/s 330.2954 Ops/s $\color{#d91a1a}-1.00\%$
test_dqn_speed 6.3529ms 1.3634ms 733.4527 Ops/s 722.6172 Ops/s $\color{#35bf28}+1.50\%$
test_ddpg_speed 3.6479ms 2.8627ms 349.3165 Ops/s 346.1747 Ops/s $\color{#35bf28}+0.91\%$
test_sac_speed 13.7833ms 8.6143ms 116.0855 Ops/s 117.0817 Ops/s $\color{#d91a1a}-0.85\%$
test_redq_speed 14.1658ms 13.1140ms 76.2542 Ops/s 69.5609 Ops/s $\textbf{\color{#35bf28}+9.62\%}$
test_redq_deprec_speed 92.0021ms 14.2279ms 70.2844 Ops/s 74.5397 Ops/s $\textbf{\color{#d91a1a}-5.71\%}$
test_td3_speed 10.6833ms 8.5393ms 117.1057 Ops/s 117.8719 Ops/s $\color{#d91a1a}-0.65\%$
test_cql_speed 41.3336ms 37.3211ms 26.7945 Ops/s 26.9346 Ops/s $\color{#d91a1a}-0.52\%$
test_a2c_speed 8.2100ms 7.5518ms 132.4185 Ops/s 133.8286 Ops/s $\color{#d91a1a}-1.05\%$
test_ppo_speed 9.5280ms 8.0693ms 123.9272 Ops/s 129.7564 Ops/s $\color{#d91a1a}-4.49\%$
test_reinforce_speed 7.7251ms 6.7354ms 148.4686 Ops/s 150.2891 Ops/s $\color{#d91a1a}-1.21\%$
test_iql_speed 34.5646ms 33.4805ms 29.8682 Ops/s 30.1716 Ops/s $\color{#d91a1a}-1.01\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.3333ms 2.2304ms 448.3572 Ops/s 492.4124 Ops/s $\textbf{\color{#d91a1a}-8.95\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0830ms 0.5138ms 1.9463 KOps/s 1.9583 KOps/s $\color{#d91a1a}-0.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7361ms 0.5001ms 1.9998 KOps/s 2.0433 KOps/s $\color{#d91a1a}-2.13\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0008ms 2.4447ms 409.0490 Ops/s 457.2730 Ops/s $\textbf{\color{#d91a1a}-10.55\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0119ms 0.5088ms 1.9654 KOps/s 2.0382 KOps/s $\color{#d91a1a}-3.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7218ms 0.4881ms 2.0487 KOps/s 2.1402 KOps/s $\color{#d91a1a}-4.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.0255ms 1.2448ms 803.3318 Ops/s 816.3545 Ops/s $\color{#d91a1a}-1.60\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.3674ms 1.1737ms 852.0354 Ops/s 859.2624 Ops/s $\color{#d91a1a}-0.84\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.4733ms 2.3194ms 431.1458 Ops/s 459.7278 Ops/s $\textbf{\color{#d91a1a}-6.22\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9692ms 0.6266ms 1.5960 KOps/s 1.6119 KOps/s $\color{#d91a1a}-0.99\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.8307ms 0.5974ms 1.6738 KOps/s 1.6963 KOps/s $\color{#d91a1a}-1.33\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.2464ms 2.2336ms 447.7095 Ops/s 488.2594 Ops/s $\textbf{\color{#d91a1a}-8.30\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6024ms 0.5057ms 1.9775 KOps/s 1.9803 KOps/s $\color{#d91a1a}-0.14\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.7384ms 0.4905ms 2.0387 KOps/s 2.0850 KOps/s $\color{#d91a1a}-2.22\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.2080ms 2.1930ms 455.9967 Ops/s 476.2056 Ops/s $\color{#d91a1a}-4.24\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1569ms 0.4922ms 2.0317 KOps/s 2.0111 KOps/s $\color{#35bf28}+1.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6224ms 0.4659ms 2.1463 KOps/s 2.1247 KOps/s $\color{#35bf28}+1.02\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.2740ms 2.1551ms 464.0203 Ops/s 434.7327 Ops/s $\textbf{\color{#35bf28}+6.74\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9906ms 0.6220ms 1.6077 KOps/s 1.5964 KOps/s $\color{#35bf28}+0.71\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.7620ms 0.5935ms 1.6849 KOps/s 1.5968 KOps/s $\textbf{\color{#35bf28}+5.52\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1157s 7.8533ms 127.3342 Ops/s 121.3313 Ops/s $\color{#35bf28}+4.95\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.0098ms 12.0042ms 83.3043 Ops/s 83.2937 Ops/s $\color{#35bf28}+0.01\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.5615ms 1.0513ms 951.1743 Ops/s 936.9822 Ops/s $\color{#35bf28}+1.51\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1078s 5.7677ms 173.3787 Ops/s 174.0063 Ops/s $\color{#d91a1a}-0.36\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.5673ms 12.0360ms 83.0838 Ops/s 83.7759 Ops/s $\color{#d91a1a}-0.83\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.8027ms 1.0687ms 935.7236 Ops/s 928.3613 Ops/s $\color{#35bf28}+0.79\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1096s 8.2892ms 120.6384 Ops/s 126.5470 Ops/s $\color{#d91a1a}-4.67\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 14.9559ms 12.3801ms 80.7747 Ops/s 81.4181 Ops/s $\color{#d91a1a}-0.79\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.0429ms 1.3659ms 732.1131 Ops/s 728.2693 Ops/s $\color{#35bf28}+0.53\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented May 2, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}6$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1161s 0.1131s 8.8401 Ops/s 8.8862 Ops/s $\color{#d91a1a}-0.52\%$
test_sync 0.1011s 0.1001s 9.9948 Ops/s 9.9720 Ops/s $\color{#35bf28}+0.23\%$
test_async 0.1873s 94.6683ms 10.5632 Ops/s 10.5918 Ops/s $\color{#d91a1a}-0.27\%$
test_single_pixels 0.1242s 0.1240s 8.0667 Ops/s 8.0330 Ops/s $\color{#35bf28}+0.42\%$
test_sync_pixels 0.1402s 85.7657ms 11.6597 Ops/s 11.9221 Ops/s $\color{#d91a1a}-2.20\%$
test_async_pixels 0.1584s 78.5915ms 12.7240 Ops/s 14.6197 Ops/s $\textbf{\color{#d91a1a}-12.97\%}$
test_simple 0.8069s 0.7473s 1.3382 Ops/s 1.3652 Ops/s $\color{#d91a1a}-1.98\%$
test_transformed 1.0419s 0.9881s 1.0120 Ops/s 1.0099 Ops/s $\color{#35bf28}+0.21\%$
test_serial 2.4445s 2.3762s 0.4208 Ops/s 0.4228 Ops/s $\color{#d91a1a}-0.45\%$
test_parallel 2.3435s 2.2792s 0.4388 Ops/s 0.4351 Ops/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[True-True-True-True-True] 77.7910μs 33.0039μs 30.2995 KOps/s 30.8293 KOps/s $\color{#d91a1a}-1.72\%$
test_step_mdp_speed[True-True-True-True-False] 41.9210μs 19.4277μs 51.4729 KOps/s 52.2659 KOps/s $\color{#d91a1a}-1.52\%$
test_step_mdp_speed[True-True-True-False-True] 47.9420μs 18.8508μs 53.0483 KOps/s 54.7235 KOps/s $\color{#d91a1a}-3.06\%$
test_step_mdp_speed[True-True-True-False-False] 29.6500μs 11.0929μs 90.1478 KOps/s 91.1755 KOps/s $\color{#d91a1a}-1.13\%$
test_step_mdp_speed[True-True-False-True-True] 79.1320μs 34.2063μs 29.2344 KOps/s 28.8789 KOps/s $\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-True-False-True-False] 48.8310μs 21.2712μs 47.0119 KOps/s 47.6316 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[True-True-False-False-True] 40.0710μs 20.8518μs 47.9576 KOps/s 50.2280 KOps/s $\color{#d91a1a}-4.52\%$
test_step_mdp_speed[True-True-False-False-False] 35.0100μs 13.0897μs 76.3962 KOps/s 79.0017 KOps/s $\color{#d91a1a}-3.30\%$
test_step_mdp_speed[True-False-True-True-True] 63.2510μs 36.3911μs 27.4792 KOps/s 27.5787 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[True-False-True-True-False] 51.9510μs 23.4300μs 42.6804 KOps/s 43.5237 KOps/s $\color{#d91a1a}-1.94\%$
test_step_mdp_speed[True-False-True-False-True] 37.0610μs 20.4699μs 48.8521 KOps/s 49.8151 KOps/s $\color{#d91a1a}-1.93\%$
test_step_mdp_speed[True-False-True-False-False] 30.9410μs 13.0004μs 76.9209 KOps/s 78.3235 KOps/s $\color{#d91a1a}-1.79\%$
test_step_mdp_speed[True-False-False-True-True] 57.4710μs 38.0655μs 26.2705 KOps/s 26.2680 KOps/s $+0.01\%$
test_step_mdp_speed[True-False-False-True-False] 46.9010μs 25.0277μs 39.9557 KOps/s 40.5134 KOps/s $\color{#d91a1a}-1.38\%$
test_step_mdp_speed[True-False-False-False-True] 45.1810μs 22.5833μs 44.2804 KOps/s 45.7177 KOps/s $\color{#d91a1a}-3.14\%$
test_step_mdp_speed[True-False-False-False-False] 43.7310μs 14.8128μs 67.5091 KOps/s 68.3911 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[False-True-True-True-True] 70.9910μs 36.6751μs 27.2665 KOps/s 27.6163 KOps/s $\color{#d91a1a}-1.27\%$
test_step_mdp_speed[False-True-True-True-False] 40.3400μs 23.2564μs 42.9989 KOps/s 43.2236 KOps/s $\color{#d91a1a}-0.52\%$
test_step_mdp_speed[False-True-True-False-True] 48.0410μs 24.5596μs 40.7173 KOps/s 41.6973 KOps/s $\color{#d91a1a}-2.35\%$
test_step_mdp_speed[False-True-True-False-False] 0.1450ms 14.7606μs 67.7478 KOps/s 68.1532 KOps/s $\color{#d91a1a}-0.59\%$
test_step_mdp_speed[False-True-False-True-True] 62.5710μs 37.9619μs 26.3422 KOps/s 26.1858 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-True-False-True-False] 47.8010μs 25.2401μs 39.6194 KOps/s 39.8747 KOps/s $\color{#d91a1a}-0.64\%$
test_step_mdp_speed[False-True-False-False-True] 45.5510μs 26.3389μs 37.9666 KOps/s 38.3115 KOps/s $\color{#d91a1a}-0.90\%$
test_step_mdp_speed[False-True-False-False-False] 40.9110μs 16.4531μs 60.7789 KOps/s 60.4430 KOps/s $\color{#35bf28}+0.56\%$
test_step_mdp_speed[False-False-True-True-True] 65.9410μs 40.3780μs 24.7660 KOps/s 24.7985 KOps/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[False-False-True-True-False] 53.0410μs 26.9725μs 37.0749 KOps/s 36.8646 KOps/s $\color{#35bf28}+0.57\%$
test_step_mdp_speed[False-False-True-False-True] 51.9110μs 26.3353μs 37.9719 KOps/s 38.4102 KOps/s $\color{#d91a1a}-1.14\%$
test_step_mdp_speed[False-False-True-False-False] 43.6920μs 16.6318μs 60.1257 KOps/s 60.7414 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[False-False-False-True-True] 71.2120μs 42.1614μs 23.7184 KOps/s 23.8403 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[False-False-False-True-False] 48.4000μs 29.1547μs 34.2998 KOps/s 34.5596 KOps/s $\color{#d91a1a}-0.75\%$
test_step_mdp_speed[False-False-False-False-True] 46.9410μs 27.8548μs 35.9005 KOps/s 36.4456 KOps/s $\color{#d91a1a}-1.50\%$
test_step_mdp_speed[False-False-False-False-False] 43.3410μs 18.3887μs 54.3813 KOps/s 54.2489 KOps/s $\color{#35bf28}+0.24\%$
test_values[generalized_advantage_estimate-True-True] 24.3002ms 23.5231ms 42.5114 Ops/s 42.7961 Ops/s $\color{#d91a1a}-0.67\%$
test_values[vec_generalized_advantage_estimate-True-True] 81.1207ms 3.1736ms 315.0962 Ops/s 315.5220 Ops/s $\color{#d91a1a}-0.13\%$
test_values[td0_return_estimate-False-False] 88.2410μs 61.3613μs 16.2969 KOps/s 16.3668 KOps/s $\color{#d91a1a}-0.43\%$
test_values[td1_return_estimate-False-False] 51.1089ms 50.3880ms 19.8460 Ops/s 19.7958 Ops/s $\color{#35bf28}+0.25\%$
test_values[vec_td1_return_estimate-False-False] 2.0574ms 1.7416ms 574.2000 Ops/s 575.5451 Ops/s $\color{#d91a1a}-0.23\%$
test_values[td_lambda_return_estimate-True-False] 81.1362ms 80.8733ms 12.3650 Ops/s 12.3657 Ops/s $-0.01\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0888ms 1.7415ms 574.2098 Ops/s 576.1049 Ops/s $\color{#d91a1a}-0.33\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.2829ms 22.4413ms 44.5606 Ops/s 45.1562 Ops/s $\color{#d91a1a}-1.32\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8972ms 0.6732ms 1.4854 KOps/s 1.4880 KOps/s $\color{#d91a1a}-0.17\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7197ms 0.6294ms 1.5888 KOps/s 1.5968 KOps/s $\color{#d91a1a}-0.50\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5037ms 1.4281ms 700.2109 Ops/s 699.2718 Ops/s $\color{#35bf28}+0.13\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9383ms 0.6448ms 1.5510 KOps/s 1.5536 KOps/s $\color{#d91a1a}-0.17\%$
test_dqn_speed 7.4839ms 1.4092ms 709.6238 Ops/s 711.8564 Ops/s $\color{#d91a1a}-0.31\%$
test_ddpg_speed 3.1448ms 2.8598ms 349.6715 Ops/s 344.8983 Ops/s $\color{#35bf28}+1.38\%$
test_sac_speed 8.6055ms 8.2162ms 121.7114 Ops/s 121.5014 Ops/s $\color{#35bf28}+0.17\%$
test_redq_speed 10.6758ms 9.9521ms 100.4810 Ops/s 99.6394 Ops/s $\color{#35bf28}+0.84\%$
test_redq_deprec_speed 11.6835ms 11.0726ms 90.3130 Ops/s 81.3560 Ops/s $\textbf{\color{#35bf28}+11.01\%}$
test_td3_speed 8.2758ms 8.1260ms 123.0622 Ops/s 122.5457 Ops/s $\color{#35bf28}+0.42\%$
test_cql_speed 26.4041ms 25.2740ms 39.5664 Ops/s 40.0403 Ops/s $\color{#d91a1a}-1.18\%$
test_a2c_speed 5.7847ms 5.4947ms 181.9941 Ops/s 186.3131 Ops/s $\color{#d91a1a}-2.32\%$
test_ppo_speed 6.2095ms 5.7774ms 173.0890 Ops/s 177.5268 Ops/s $\color{#d91a1a}-2.50\%$
test_reinforce_speed 4.6489ms 4.5017ms 222.1362 Ops/s 223.2810 Ops/s $\color{#d91a1a}-0.51\%$
test_iql_speed 19.7205ms 19.2512ms 51.9448 Ops/s 51.9124 Ops/s $\color{#35bf28}+0.06\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.8273ms 2.7622ms 362.0289 Ops/s 359.2413 Ops/s $\color{#35bf28}+0.78\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7760ms 0.5865ms 1.7051 KOps/s 1.4975 KOps/s $\textbf{\color{#35bf28}+13.86\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.5835ms 0.5647ms 1.7709 KOps/s 1.7741 KOps/s $\color{#d91a1a}-0.18\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0091ms 2.7740ms 360.4883 Ops/s 359.6230 Ops/s $\color{#35bf28}+0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7108ms 0.5775ms 1.7315 KOps/s 1.7324 KOps/s $\color{#d91a1a}-0.05\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.5773ms 0.5571ms 1.7949 KOps/s 1.7993 KOps/s $\color{#d91a1a}-0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6043ms 1.4647ms 682.7121 Ops/s 678.5932 Ops/s $\color{#35bf28}+0.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5802ms 1.3948ms 716.9461 Ops/s 690.0340 Ops/s $\color{#35bf28}+3.90\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.9653ms 2.8618ms 349.4308 Ops/s 345.6997 Ops/s $\color{#35bf28}+1.08\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8576ms 0.7121ms 1.4042 KOps/s 1.4061 KOps/s $\color{#d91a1a}-0.13\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8249ms 0.6872ms 1.4551 KOps/s 1.4453 KOps/s $\color{#35bf28}+0.68\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.8269ms 2.7458ms 364.1955 Ops/s 361.0188 Ops/s $\color{#35bf28}+0.88\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8293ms 0.5894ms 1.6966 KOps/s 1.7126 KOps/s $\color{#d91a1a}-0.93\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.7606ms 0.5685ms 1.7592 KOps/s 1.7743 KOps/s $\color{#d91a1a}-0.86\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0171ms 2.7792ms 359.8219 Ops/s 360.6856 Ops/s $\color{#d91a1a}-0.24\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.5047ms 0.5866ms 1.7047 KOps/s 1.7304 KOps/s $\color{#d91a1a}-1.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7350ms 0.5603ms 1.7848 KOps/s 1.7711 KOps/s $\color{#35bf28}+0.77\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.2513ms 2.8806ms 347.1448 Ops/s 343.3324 Ops/s $\color{#35bf28}+1.11\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8170ms 0.7179ms 1.3930 KOps/s 1.4051 KOps/s $\color{#d91a1a}-0.86\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.9742ms 0.6939ms 1.4412 KOps/s 1.4491 KOps/s $\color{#d91a1a}-0.54\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1282s 9.5582ms 104.6222 Ops/s 134.1896 Ops/s $\textbf{\color{#d91a1a}-22.03\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.0197ms 14.6567ms 68.2281 Ops/s 59.1375 Ops/s $\textbf{\color{#35bf28}+15.37\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1995ms 1.1557ms 865.2507 Ops/s 792.0776 Ops/s $\textbf{\color{#35bf28}+9.24\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1165s 7.1539ms 139.7843 Ops/s 142.0393 Ops/s $\color{#d91a1a}-1.59\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.9712ms 14.7128ms 67.9680 Ops/s 68.4668 Ops/s $\color{#d91a1a}-0.73\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.1497ms 1.1621ms 860.5182 Ops/s 798.3459 Ops/s $\textbf{\color{#35bf28}+7.79\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1160s 7.4827ms 133.6415 Ops/s 134.6474 Ops/s $\color{#d91a1a}-0.75\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1292s 17.3389ms 57.6737 Ops/s 67.3628 Ops/s $\textbf{\color{#d91a1a}-14.38\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.7874ms 1.5991ms 625.3385 Ops/s 583.3475 Ops/s $\textbf{\color{#35bf28}+7.20\%}$

@vmoens vmoens added the Environments Adds or modifies an environment wrapper label May 2, 2024
@vmoens vmoens merged commit 7346c74 into main May 3, 2024
41 of 51 checks passed
@vmoens vmoens deleted the fix-gym-info branch May 3, 2024 08:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot