Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Jumanji from_pixels=True #2129

Merged
merged 9 commits into from
Apr 30, 2024
Merged

[Feature] Jumanji from_pixels=True #2129

merged 9 commits into from
Apr 30, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 29, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Apr 29, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2129

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 3 Unrelated Failures

As of commit 9210872 with merge base 68101b0 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 29, 2024
@vmoens vmoens added enhancement New feature or request Environments Adds or modifies an environment wrapper labels Apr 29, 2024
@vmoens vmoens mentioned this pull request Apr 29, 2024
Closed
@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 29, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1161s 0.1155s 8.6567 Ops/s 8.5536 Ops/s $\color{#35bf28}+1.20\%$
test_sync 0.1017s 0.1008s 9.9211 Ops/s 9.8291 Ops/s $\color{#35bf28}+0.94\%$
test_async 0.1938s 97.4774ms 10.2588 Ops/s 10.6759 Ops/s $\color{#d91a1a}-3.91\%$
test_single_pixels 0.1979s 0.1358s 7.3650 Ops/s 7.8138 Ops/s $\textbf{\color{#d91a1a}-5.74\%}$
test_sync_pixels 0.1355s 84.7145ms 11.8044 Ops/s 11.5881 Ops/s $\color{#35bf28}+1.87\%$
test_async_pixels 0.1507s 74.9135ms 13.3487 Ops/s 14.8696 Ops/s $\textbf{\color{#d91a1a}-10.23\%}$
test_simple 0.7577s 0.7554s 1.3238 Ops/s 1.2839 Ops/s $\color{#35bf28}+3.11\%$
test_transformed 1.0301s 1.0118s 0.9883 Ops/s 0.9649 Ops/s $\color{#35bf28}+2.42\%$
test_serial 2.6149s 2.5272s 0.3957 Ops/s 0.4056 Ops/s $\color{#d91a1a}-2.45\%$
test_parallel 2.3652s 2.3031s 0.4342 Ops/s 0.4331 Ops/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-True-True-True-True] 93.3020μs 33.7158μs 29.6597 KOps/s 29.3648 KOps/s $\color{#35bf28}+1.00\%$
test_step_mdp_speed[True-True-True-True-False] 40.3600μs 19.8251μs 50.4410 KOps/s 49.0548 KOps/s $\color{#35bf28}+2.83\%$
test_step_mdp_speed[True-True-True-False-True] 46.3310μs 19.0634μs 52.4566 KOps/s 51.9060 KOps/s $\color{#35bf28}+1.06\%$
test_step_mdp_speed[True-True-True-False-False] 27.0910μs 11.3317μs 88.2480 KOps/s 88.1948 KOps/s $\color{#35bf28}+0.06\%$
test_step_mdp_speed[True-True-False-True-True] 54.0610μs 35.0497μs 28.5309 KOps/s 28.5310 KOps/s $-0.00\%$
test_step_mdp_speed[True-True-False-True-False] 42.3200μs 21.7083μs 46.0653 KOps/s 45.2530 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[True-True-False-False-True] 36.1510μs 20.6824μs 48.3502 KOps/s 48.5450 KOps/s $\color{#d91a1a}-0.40\%$
test_step_mdp_speed[True-True-False-False-False] 29.8910μs 13.2160μs 75.6658 KOps/s 75.4903 KOps/s $\color{#35bf28}+0.23\%$
test_step_mdp_speed[True-False-True-True-True] 63.2520μs 37.0562μs 26.9860 KOps/s 26.7276 KOps/s $\color{#35bf28}+0.97\%$
test_step_mdp_speed[True-False-True-True-False] 41.4510μs 23.8238μs 41.9749 KOps/s 41.7849 KOps/s $\color{#35bf28}+0.45\%$
test_step_mdp_speed[True-False-True-False-True] 37.3110μs 20.5861μs 48.5765 KOps/s 47.7358 KOps/s $\color{#35bf28}+1.76\%$
test_step_mdp_speed[True-False-True-False-False] 32.4210μs 13.2021μs 75.7457 KOps/s 75.5530 KOps/s $\color{#35bf28}+0.26\%$
test_step_mdp_speed[True-False-False-True-True] 60.8810μs 38.7396μs 25.8134 KOps/s 25.6731 KOps/s $\color{#35bf28}+0.55\%$
test_step_mdp_speed[True-False-False-True-False] 62.5120μs 25.8110μs 38.7431 KOps/s 38.8916 KOps/s $\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-False-False-False-True] 45.8010μs 22.4241μs 44.5949 KOps/s 44.6510 KOps/s $\color{#d91a1a}-0.13\%$
test_step_mdp_speed[True-False-False-False-False] 30.4500μs 15.0754μs 66.3331 KOps/s 66.0408 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-True-True-True-True] 63.9020μs 37.1310μs 26.9317 KOps/s 26.3193 KOps/s $\color{#35bf28}+2.33\%$
test_step_mdp_speed[False-True-True-True-False] 57.2510μs 23.9267μs 41.7944 KOps/s 41.7005 KOps/s $\color{#35bf28}+0.23\%$
test_step_mdp_speed[False-True-True-False-True] 55.4510μs 24.8700μs 40.2091 KOps/s 40.0810 KOps/s $\color{#35bf28}+0.32\%$
test_step_mdp_speed[False-True-True-False-False] 32.5710μs 15.0877μs 66.2790 KOps/s 65.8734 KOps/s $\color{#35bf28}+0.62\%$
test_step_mdp_speed[False-True-False-True-True] 58.0810μs 38.9359μs 25.6832 KOps/s 25.8164 KOps/s $\color{#d91a1a}-0.52\%$
test_step_mdp_speed[False-True-False-True-False] 42.9810μs 25.4870μs 39.2357 KOps/s 38.9462 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[False-True-False-False-True] 45.4410μs 26.5849μs 37.6153 KOps/s 37.7070 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-True-False-False-False] 32.8100μs 16.8188μs 59.4573 KOps/s 58.5597 KOps/s $\color{#35bf28}+1.53\%$
test_step_mdp_speed[False-False-True-True-True] 70.0720μs 41.1422μs 24.3060 KOps/s 24.3762 KOps/s $\color{#d91a1a}-0.29\%$
test_step_mdp_speed[False-False-True-True-False] 42.7310μs 27.8799μs 35.8681 KOps/s 35.8102 KOps/s $\color{#35bf28}+0.16\%$
test_step_mdp_speed[False-False-True-False-True] 44.9710μs 26.5949μs 37.6012 KOps/s 37.3970 KOps/s $\color{#35bf28}+0.55\%$
test_step_mdp_speed[False-False-True-False-False] 38.1200μs 16.9188μs 59.1059 KOps/s 58.2533 KOps/s $\color{#35bf28}+1.46\%$
test_step_mdp_speed[False-False-False-True-True] 62.4920μs 43.5084μs 22.9841 KOps/s 22.8439 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-False-False-True-False] 53.7210μs 29.6681μs 33.7062 KOps/s 33.6346 KOps/s $\color{#35bf28}+0.21\%$
test_step_mdp_speed[False-False-False-False-True] 54.9810μs 28.2721μs 35.3705 KOps/s 34.8830 KOps/s $\color{#35bf28}+1.40\%$
test_step_mdp_speed[False-False-False-False-False] 44.5110μs 18.6921μs 53.4984 KOps/s 53.0231 KOps/s $\color{#35bf28}+0.90\%$
test_values[generalized_advantage_estimate-True-True] 26.0125ms 24.6677ms 40.5388 Ops/s 40.4730 Ops/s $\color{#35bf28}+0.16\%$
test_values[vec_generalized_advantage_estimate-True-True] 84.0594ms 3.2500ms 307.6955 Ops/s 311.2726 Ops/s $\color{#d91a1a}-1.15\%$
test_values[td0_return_estimate-False-False] 89.7020μs 63.8707μs 15.6566 KOps/s 15.4338 KOps/s $\color{#35bf28}+1.44\%$
test_values[td1_return_estimate-False-False] 52.4843ms 51.9293ms 19.2569 Ops/s 18.9385 Ops/s $\color{#35bf28}+1.68\%$
test_values[vec_td1_return_estimate-False-False] 2.0733ms 1.7671ms 565.8874 Ops/s 565.9382 Ops/s $-0.01\%$
test_values[td_lambda_return_estimate-True-False] 88.4536ms 85.4445ms 11.7035 Ops/s 11.8404 Ops/s $\color{#d91a1a}-1.16\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0010ms 1.7611ms 567.8179 Ops/s 566.0915 Ops/s $\color{#35bf28}+0.30\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 26.1738ms 25.4485ms 39.2951 Ops/s 42.2379 Ops/s $\textbf{\color{#d91a1a}-6.97\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8952ms 0.6997ms 1.4292 KOps/s 1.4174 KOps/s $\color{#35bf28}+0.84\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7039ms 0.6762ms 1.4789 KOps/s 1.5308 KOps/s $\color{#d91a1a}-3.39\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5113ms 1.4551ms 687.2403 Ops/s 683.7182 Ops/s $\color{#35bf28}+0.52\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9375ms 0.6740ms 1.4836 KOps/s 1.4767 KOps/s $\color{#35bf28}+0.47\%$
test_dqn_speed 75.7757ms 1.5779ms 633.7585 Ops/s 677.4584 Ops/s $\textbf{\color{#d91a1a}-6.45\%}$
test_ddpg_speed 3.2743ms 2.9870ms 334.7809 Ops/s 332.1559 Ops/s $\color{#35bf28}+0.79\%$
test_sac_speed 8.6906ms 8.5450ms 117.0281 Ops/s 116.5901 Ops/s $\color{#35bf28}+0.38\%$
test_redq_speed 12.4414ms 10.4053ms 96.1046 Ops/s 96.2085 Ops/s $\color{#d91a1a}-0.11\%$
test_redq_deprec_speed 12.0682ms 11.5478ms 86.5964 Ops/s 85.9932 Ops/s $\color{#35bf28}+0.70\%$
test_td3_speed 17.5419ms 8.6171ms 116.0487 Ops/s 117.4123 Ops/s $\color{#d91a1a}-1.16\%$
test_cql_speed 27.2485ms 26.4428ms 37.8175 Ops/s 38.0392 Ops/s $\color{#d91a1a}-0.58\%$
test_a2c_speed 5.9348ms 5.6219ms 177.8764 Ops/s 171.6005 Ops/s $\color{#35bf28}+3.66\%$
test_ppo_speed 6.1273ms 5.9708ms 167.4821 Ops/s 165.6732 Ops/s $\color{#35bf28}+1.09\%$
test_reinforce_speed 4.8489ms 4.6148ms 216.6922 Ops/s 211.6846 Ops/s $\color{#35bf28}+2.37\%$
test_iql_speed 20.6808ms 19.9676ms 50.0812 Ops/s 48.7280 Ops/s $\color{#35bf28}+2.78\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0018ms 2.8416ms 351.9084 Ops/s 356.7465 Ops/s $\color{#d91a1a}-1.36\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.6087ms 0.6058ms 1.6508 KOps/s 1.6313 KOps/s $\color{#35bf28}+1.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.1378ms 0.5844ms 1.7112 KOps/s 1.7045 KOps/s $\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0091ms 2.8363ms 352.5750 Ops/s 355.4267 Ops/s $\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.5114ms 0.6041ms 1.6555 KOps/s 1.6716 KOps/s $\color{#d91a1a}-0.97\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7524ms 0.5779ms 1.7305 KOps/s 1.7239 KOps/s $\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6881ms 1.5455ms 647.0352 Ops/s 620.5690 Ops/s $\color{#35bf28}+4.26\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5875ms 1.4735ms 678.6528 Ops/s 668.4783 Ops/s $\color{#35bf28}+1.52\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0127ms 2.9240ms 341.9950 Ops/s 340.7546 Ops/s $\color{#35bf28}+0.36\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8666ms 0.7393ms 1.3526 KOps/s 1.3526 KOps/s $-0.00\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.1197s 0.8241ms 1.2134 KOps/s 1.3928 KOps/s $\textbf{\color{#d91a1a}-12.88\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.9183ms 2.8253ms 353.9493 Ops/s 359.2209 Ops/s $\color{#d91a1a}-1.47\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.7659ms 0.6124ms 1.6329 KOps/s 1.6292 KOps/s $\color{#35bf28}+0.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7401ms 0.5855ms 1.7078 KOps/s 1.7008 KOps/s $\color{#35bf28}+0.41\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.9852ms 2.8321ms 353.0961 Ops/s 358.2577 Ops/s $\color{#d91a1a}-1.44\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6988ms 0.6032ms 1.6577 KOps/s 1.6503 KOps/s $\color{#35bf28}+0.45\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.1197s 0.7574ms 1.3203 KOps/s 1.7032 KOps/s $\textbf{\color{#d91a1a}-22.49\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1175ms 2.9528ms 338.6588 Ops/s 342.6343 Ops/s $\color{#d91a1a}-1.16\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.8917ms 0.7457ms 1.3410 KOps/s 1.3536 KOps/s $\color{#d91a1a}-0.93\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8567ms 0.7182ms 1.3924 KOps/s 1.3866 KOps/s $\color{#35bf28}+0.42\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1232s 7.2822ms 137.3212 Ops/s 103.4975 Ops/s $\textbf{\color{#35bf28}+32.68\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.3986ms 15.1961ms 65.8063 Ops/s 65.9151 Ops/s $\color{#d91a1a}-0.16\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.4873ms 1.3317ms 750.9108 Ops/s 699.0548 Ops/s $\textbf{\color{#35bf28}+7.42\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1177s 9.4177ms 106.1835 Ops/s 139.8201 Ops/s $\textbf{\color{#d91a1a}-24.06\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.4392ms 15.0173ms 66.5900 Ops/s 65.7457 Ops/s $\color{#35bf28}+1.28\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.4933ms 1.2785ms 782.1580 Ops/s 777.2150 Ops/s $\color{#35bf28}+0.64\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1177s 7.4890ms 133.5300 Ops/s 101.9446 Ops/s $\textbf{\color{#35bf28}+30.98\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.6886ms 15.4133ms 64.8790 Ops/s 64.3563 Ops/s $\color{#35bf28}+0.81\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.7807ms 1.7571ms 569.1183 Ops/s 618.6694 Ops/s $\textbf{\color{#d91a1a}-8.01\%}$

@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 29, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}11$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 53.6257ms 52.6625ms 18.9888 Ops/s 18.5586 Ops/s $\color{#35bf28}+2.32\%$
test_sync 34.4706ms 29.3638ms 34.0555 Ops/s 33.5086 Ops/s $\color{#35bf28}+1.63\%$
test_async 52.7736ms 26.8293ms 37.2727 Ops/s 33.9445 Ops/s $\textbf{\color{#35bf28}+9.81\%}$
test_simple 0.4026s 0.3485s 2.8691 Ops/s 2.9145 Ops/s $\color{#d91a1a}-1.56\%$
test_transformed 0.5401s 0.4893s 2.0436 Ops/s 1.9756 Ops/s $\color{#35bf28}+3.44\%$
test_serial 1.2526s 1.1991s 0.8340 Ops/s 0.8221 Ops/s $\color{#35bf28}+1.45\%$
test_parallel 1.0730s 1.0164s 0.9838 Ops/s 0.9914 Ops/s $\color{#d91a1a}-0.76\%$
test_step_mdp_speed[True-True-True-True-True] 0.1209ms 20.9289μs 47.7809 KOps/s 47.0572 KOps/s $\color{#35bf28}+1.54\%$
test_step_mdp_speed[True-True-True-True-False] 51.5060μs 12.5436μs 79.7222 KOps/s 75.0376 KOps/s $\textbf{\color{#35bf28}+6.24\%}$
test_step_mdp_speed[True-True-True-False-True] 35.1350μs 12.2149μs 81.8672 KOps/s 80.0606 KOps/s $\color{#35bf28}+2.26\%$
test_step_mdp_speed[True-True-True-False-False] 0.1224ms 7.4294μs 134.5999 KOps/s 129.2477 KOps/s $\color{#35bf28}+4.14\%$
test_step_mdp_speed[True-True-False-True-True] 58.2690μs 22.1534μs 45.1398 KOps/s 44.0835 KOps/s $\color{#35bf28}+2.40\%$
test_step_mdp_speed[True-True-False-True-False] 63.8090μs 13.6493μs 73.2637 KOps/s 69.2265 KOps/s $\textbf{\color{#35bf28}+5.83\%}$
test_step_mdp_speed[True-True-False-False-True] 53.3190μs 13.5916μs 73.5750 KOps/s 72.5509 KOps/s $\color{#35bf28}+1.41\%$
test_step_mdp_speed[True-True-False-False-False] 29.4550μs 8.5368μs 117.1395 KOps/s 111.5644 KOps/s $\color{#35bf28}+5.00\%$
test_step_mdp_speed[True-False-True-True-True] 54.9030μs 23.4307μs 42.6790 KOps/s 41.9080 KOps/s $\color{#35bf28}+1.84\%$
test_step_mdp_speed[True-False-True-True-False] 36.5890μs 15.1643μs 65.9446 KOps/s 63.9149 KOps/s $\color{#35bf28}+3.18\%$
test_step_mdp_speed[True-False-True-False-True] 47.4580μs 13.4352μs 74.4315 KOps/s 72.3309 KOps/s $\color{#35bf28}+2.90\%$
test_step_mdp_speed[True-False-True-False-False] 27.5020μs 8.5877μs 116.4458 KOps/s 111.5552 KOps/s $\color{#35bf28}+4.38\%$
test_step_mdp_speed[True-False-False-True-True] 65.3620μs 24.6114μs 40.6316 KOps/s 39.6456 KOps/s $\color{#35bf28}+2.49\%$
test_step_mdp_speed[True-False-False-True-False] 54.2210μs 16.1372μs 61.9687 KOps/s 58.8016 KOps/s $\textbf{\color{#35bf28}+5.39\%}$
test_step_mdp_speed[True-False-False-False-True] 52.7380μs 14.5281μs 68.8323 KOps/s 67.0730 KOps/s $\color{#35bf28}+2.62\%$
test_step_mdp_speed[True-False-False-False-False] 42.4890μs 9.5663μs 104.5334 KOps/s 100.0313 KOps/s $\color{#35bf28}+4.50\%$
test_step_mdp_speed[False-True-True-True-True] 85.1320μs 23.4579μs 42.6296 KOps/s 41.6208 KOps/s $\color{#35bf28}+2.42\%$
test_step_mdp_speed[False-True-True-True-False] 52.0970μs 15.0929μs 66.2562 KOps/s 63.4857 KOps/s $\color{#35bf28}+4.36\%$
test_step_mdp_speed[False-True-True-False-True] 44.6530μs 15.6058μs 64.0786 KOps/s 61.9539 KOps/s $\color{#35bf28}+3.43\%$
test_step_mdp_speed[False-True-True-False-False] 36.1680μs 9.8087μs 101.9503 KOps/s 99.3582 KOps/s $\color{#35bf28}+2.61\%$
test_step_mdp_speed[False-True-False-True-True] 63.8890μs 24.5826μs 40.6792 KOps/s 39.9313 KOps/s $\color{#35bf28}+1.87\%$
test_step_mdp_speed[False-True-False-True-False] 42.5900μs 16.2331μs 61.6025 KOps/s 59.0578 KOps/s $\color{#35bf28}+4.31\%$
test_step_mdp_speed[False-True-False-False-True] 51.6170μs 16.7585μs 59.6711 KOps/s 58.3036 KOps/s $\color{#35bf28}+2.35\%$
test_step_mdp_speed[False-True-False-False-False] 37.9610μs 10.8496μs 92.1694 KOps/s 87.9677 KOps/s $\color{#35bf28}+4.78\%$
test_step_mdp_speed[False-False-True-True-True] 65.9330μs 25.6973μs 38.9146 KOps/s 37.6847 KOps/s $\color{#35bf28}+3.26\%$
test_step_mdp_speed[False-False-True-True-False] 49.6720μs 17.4586μs 57.2783 KOps/s 54.9922 KOps/s $\color{#35bf28}+4.16\%$
test_step_mdp_speed[False-False-True-False-True] 46.9780μs 16.7225μs 59.7995 KOps/s 58.3004 KOps/s $\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-False-True-False-False] 32.6410μs 10.9322μs 91.4728 KOps/s 87.4852 KOps/s $\color{#35bf28}+4.56\%$
test_step_mdp_speed[False-False-False-True-True] 41.1970μs 27.3215μs 36.6013 KOps/s 35.7223 KOps/s $\color{#35bf28}+2.46\%$
test_step_mdp_speed[False-False-False-True-False] 52.2070μs 18.6248μs 53.6919 KOps/s 51.0485 KOps/s $\textbf{\color{#35bf28}+5.18\%}$
test_step_mdp_speed[False-False-False-False-True] 41.2170μs 17.7370μs 56.3792 KOps/s 54.5693 KOps/s $\color{#35bf28}+3.32\%$
test_step_mdp_speed[False-False-False-False-False] 47.1480μs 12.0017μs 83.3212 KOps/s 80.5545 KOps/s $\color{#35bf28}+3.43\%$
test_values[generalized_advantage_estimate-True-True] 10.1994ms 9.4581ms 105.7291 Ops/s 107.0636 Ops/s $\color{#d91a1a}-1.25\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.2572ms 35.3681ms 28.2741 Ops/s 27.8849 Ops/s $\color{#35bf28}+1.40\%$
test_values[td0_return_estimate-False-False] 0.2160ms 0.1748ms 5.7203 KOps/s 6.0325 KOps/s $\textbf{\color{#d91a1a}-5.17\%}$
test_values[td1_return_estimate-False-False] 26.2129ms 23.8509ms 41.9272 Ops/s 43.3977 Ops/s $\color{#d91a1a}-3.39\%$
test_values[vec_td1_return_estimate-False-False] 38.0990ms 35.6730ms 28.0324 Ops/s 28.1153 Ops/s $\color{#d91a1a}-0.29\%$
test_values[td_lambda_return_estimate-True-False] 37.9036ms 34.8891ms 28.6623 Ops/s 30.0543 Ops/s $\color{#d91a1a}-4.63\%$
test_values[vec_td_lambda_return_estimate-True-False] 38.2728ms 35.6453ms 28.0542 Ops/s 28.1718 Ops/s $\color{#d91a1a}-0.42\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 10.7462ms 8.2728ms 120.8783 Ops/s 123.2578 Ops/s $\color{#d91a1a}-1.93\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.4041ms 2.0337ms 491.7219 Ops/s 532.1806 Ops/s $\textbf{\color{#d91a1a}-7.60\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4289ms 0.3489ms 2.8664 KOps/s 2.8654 KOps/s $\color{#35bf28}+0.03\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 49.1797ms 47.8484ms 20.8994 Ops/s 21.2143 Ops/s $\color{#d91a1a}-1.48\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.1429ms 3.0088ms 332.3590 Ops/s 331.9176 Ops/s $\color{#35bf28}+0.13\%$
test_dqn_speed 1.8598ms 1.3572ms 736.7885 Ops/s 744.5541 Ops/s $\color{#d91a1a}-1.04\%$
test_ddpg_speed 3.5672ms 2.8755ms 347.7626 Ops/s 351.6446 Ops/s $\color{#d91a1a}-1.10\%$
test_sac_speed 9.1043ms 8.4949ms 117.7174 Ops/s 109.5479 Ops/s $\textbf{\color{#35bf28}+7.46\%}$
test_redq_speed 14.1454ms 13.2068ms 75.7184 Ops/s 75.6466 Ops/s $\color{#35bf28}+0.09\%$
test_redq_deprec_speed 14.2040ms 13.2156ms 75.6684 Ops/s 75.2183 Ops/s $\color{#35bf28}+0.60\%$
test_td3_speed 8.7237ms 8.4612ms 118.1870 Ops/s 119.8876 Ops/s $\color{#d91a1a}-1.42\%$
test_cql_speed 53.1866ms 37.9975ms 26.3175 Ops/s 27.2771 Ops/s $\color{#d91a1a}-3.52\%$
test_a2c_speed 8.0334ms 7.4691ms 133.8846 Ops/s 135.2129 Ops/s $\color{#d91a1a}-0.98\%$
test_ppo_speed 9.0419ms 7.7326ms 129.3223 Ops/s 130.9144 Ops/s $\color{#d91a1a}-1.22\%$
test_reinforce_speed 7.6094ms 6.6365ms 150.6816 Ops/s 150.9164 Ops/s $\color{#d91a1a}-0.16\%$
test_iql_speed 34.0671ms 32.7300ms 30.5531 Ops/s 30.6105 Ops/s $\color{#d91a1a}-0.19\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.5467ms 2.1255ms 470.4839 Ops/s 476.8141 Ops/s $\color{#d91a1a}-1.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9468ms 0.4918ms 2.0335 KOps/s 2.0191 KOps/s $\color{#35bf28}+0.72\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.1585ms 0.4732ms 2.1131 KOps/s 2.1328 KOps/s $\color{#d91a1a}-0.92\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.6530ms 2.0851ms 479.5890 Ops/s 450.4982 Ops/s $\textbf{\color{#35bf28}+6.46\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0301ms 0.4874ms 2.0519 KOps/s 2.0485 KOps/s $\color{#35bf28}+0.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6623ms 0.4641ms 2.1548 KOps/s 2.1457 KOps/s $\color{#35bf28}+0.42\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7854ms 1.2377ms 807.9608 Ops/s 815.3520 Ops/s $\color{#d91a1a}-0.91\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4705ms 1.1725ms 852.9105 Ops/s 856.6705 Ops/s $\color{#d91a1a}-0.44\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.4764ms 2.2553ms 443.3903 Ops/s 440.8182 Ops/s $\color{#35bf28}+0.58\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0104ms 0.6109ms 1.6368 KOps/s 1.6445 KOps/s $\color{#d91a1a}-0.47\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9010ms 0.5859ms 1.7067 KOps/s 1.7146 KOps/s $\color{#d91a1a}-0.46\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.3481ms 2.1096ms 474.0231 Ops/s 472.9559 Ops/s $\color{#35bf28}+0.23\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7853ms 0.4959ms 2.0164 KOps/s 1.7941 KOps/s $\textbf{\color{#35bf28}+12.39\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.5760ms 0.4722ms 2.1178 KOps/s 2.1433 KOps/s $\color{#d91a1a}-1.19\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.2377ms 2.1414ms 466.9872 Ops/s 478.2496 Ops/s $\color{#d91a1a}-2.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6413ms 0.4852ms 2.0608 KOps/s 2.0473 KOps/s $\color{#35bf28}+0.66\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7501ms 0.4686ms 2.1340 KOps/s 2.1508 KOps/s $\color{#d91a1a}-0.78\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.4017ms 2.2864ms 437.3631 Ops/s 462.2888 Ops/s $\textbf{\color{#d91a1a}-5.39\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0879ms 0.6139ms 1.6290 KOps/s 1.6528 KOps/s $\color{#d91a1a}-1.44\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8254ms 0.5964ms 1.6768 KOps/s 1.7106 KOps/s $\color{#d91a1a}-1.98\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1201s 8.0165ms 124.7421 Ops/s 125.2970 Ops/s $\color{#d91a1a}-0.44\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 16.5597ms 12.2912ms 81.3589 Ops/s 83.4484 Ops/s $\color{#d91a1a}-2.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.5408ms 1.0524ms 950.2067 Ops/s 917.0336 Ops/s $\color{#35bf28}+3.62\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1038s 5.6258ms 177.7524 Ops/s 177.0284 Ops/s $\color{#35bf28}+0.41\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.6160ms 12.0284ms 83.1366 Ops/s 72.2218 Ops/s $\textbf{\color{#35bf28}+15.11\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.6599ms 1.0607ms 942.7506 Ops/s 870.8508 Ops/s $\textbf{\color{#35bf28}+8.26\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1049s 7.9801ms 125.3115 Ops/s 166.7654 Ops/s $\textbf{\color{#d91a1a}-24.86\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 14.5113ms 12.2655ms 81.5297 Ops/s 81.3987 Ops/s $\color{#35bf28}+0.16\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.8979ms 1.3625ms 733.9718 Ops/s 677.8517 Ops/s $\textbf{\color{#35bf28}+8.28\%}$

@vmoens vmoens merged commit 7b9305d into main Apr 30, 2024
53 of 58 checks passed
@vmoens vmoens deleted the fix-jumanji branch April 30, 2024 11:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. enhancement New feature or request Environments Adds or modifies an environment wrapper
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot