Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update README.md to fix CI banner #1794

Merged
merged 1 commit into from
Jan 13, 2024
Merged

Update README.md to fix CI banner #1794

merged 1 commit into from
Jan 13, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jan 13, 2024

Description

Describe your changes in detail.

Motivation and Context

Why is this change required? What problem does it solve?
If it fixes an open issue, please link to the issue here.
You can use the syntax close #15213 if this solves the issue #15213

  • I have raised an issue to propose this change (required for new features and bug fixes)

Types of changes

What types of changes does your code introduce? Remove all that do not apply:

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds core functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation (update in the documentation)
  • Example (update in the folder of examples)

Checklist

Go over all the following points, and put an x in all the boxes that apply.
If you are unsure about any of these, don't hesitate to ask. We are here to help!

  • I have read the CONTRIBUTION guide (required)
  • My change requires a change to the documentation.
  • I have updated the tests accordingly (required for a bug fix or a new feature).
  • I have updated the documentation accordingly.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jan 13, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1794

Note: Links to docs will display an error until the docs builds have been completed.

⏳ 1 Pending, 25 Unrelated Failures

As of commit b9c1fb4 with merge base 1e508b5 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 13, 2024
@vmoens vmoens merged commit cbcff69 into main Jan 13, 2024
20 of 34 checks passed
@vmoens vmoens deleted the vmoens-patch-2 branch January 13, 2024 09:07
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}7$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 64.4521ms 63.8966ms 15.6503 Ops/s 15.8046 Ops/s $\color{#d91a1a}-0.98\%$
test_sync 41.0371ms 35.4959ms 28.1723 Ops/s 27.8801 Ops/s $\color{#35bf28}+1.05\%$
test_async 0.1345s 34.1202ms 29.3081 Ops/s 29.5013 Ops/s $\color{#d91a1a}-0.65\%$
test_simple 0.4999s 0.4420s 2.2624 Ops/s 2.2321 Ops/s $\color{#35bf28}+1.35\%$
test_transformed 0.6660s 0.6092s 1.6415 Ops/s 1.6173 Ops/s $\color{#35bf28}+1.50\%$
test_serial 1.4119s 1.3629s 0.7337 Ops/s 0.7140 Ops/s $\color{#35bf28}+2.77\%$
test_parallel 1.3968s 1.3525s 0.7394 Ops/s 0.7362 Ops/s $\color{#35bf28}+0.43\%$
test_step_mdp_speed[True-True-True-True-True] 0.1032ms 22.2901μs 44.8630 KOps/s 46.5075 KOps/s $\color{#d91a1a}-3.54\%$
test_step_mdp_speed[True-True-True-True-False] 36.3280μs 13.5881μs 73.5940 KOps/s 76.2601 KOps/s $\color{#d91a1a}-3.50\%$
test_step_mdp_speed[True-True-True-False-True] 49.7430μs 13.1930μs 75.7980 KOps/s 79.0335 KOps/s $\color{#d91a1a}-4.09\%$
test_step_mdp_speed[True-True-True-False-False] 39.9340μs 7.9557μs 125.6962 KOps/s 129.8745 KOps/s $\color{#d91a1a}-3.22\%$
test_step_mdp_speed[True-True-False-True-True] 62.4960μs 24.0166μs 41.6378 KOps/s 43.5045 KOps/s $\color{#d91a1a}-4.29\%$
test_step_mdp_speed[True-True-False-True-False] 67.7960μs 14.9343μs 66.9599 KOps/s 69.2535 KOps/s $\color{#d91a1a}-3.31\%$
test_step_mdp_speed[True-True-False-False-True] 0.1470ms 15.7701μs 63.4109 KOps/s 71.5973 KOps/s $\textbf{\color{#d91a1a}-11.43\%}$
test_step_mdp_speed[True-True-False-False-False] 43.7710μs 9.2077μs 108.6050 KOps/s 111.0615 KOps/s $\color{#d91a1a}-2.21\%$
test_step_mdp_speed[True-False-True-True-True] 50.5740μs 25.3918μs 39.3828 KOps/s 41.3035 KOps/s $\color{#d91a1a}-4.65\%$
test_step_mdp_speed[True-False-True-True-False] 56.2640μs 15.9837μs 62.5635 KOps/s 63.9259 KOps/s $\color{#d91a1a}-2.13\%$
test_step_mdp_speed[True-False-True-False-True] 38.0310μs 14.5755μs 68.6082 KOps/s 71.8140 KOps/s $\color{#d91a1a}-4.46\%$
test_step_mdp_speed[True-False-True-False-False] 59.9620μs 9.1947μs 108.7579 KOps/s 109.9080 KOps/s $\color{#d91a1a}-1.05\%$
test_step_mdp_speed[True-False-False-True-True] 63.9090μs 26.7118μs 37.4367 KOps/s 39.1663 KOps/s $\color{#d91a1a}-4.42\%$
test_step_mdp_speed[True-False-False-True-False] 66.3430μs 17.4013μs 57.4671 KOps/s 58.6827 KOps/s $\color{#d91a1a}-2.07\%$
test_step_mdp_speed[True-False-False-False-True] 65.9430μs 15.7446μs 63.5139 KOps/s 66.0919 KOps/s $\color{#d91a1a}-3.90\%$
test_step_mdp_speed[True-False-False-False-False] 34.5840μs 10.5144μs 95.1072 KOps/s 97.7952 KOps/s $\color{#d91a1a}-2.75\%$
test_step_mdp_speed[False-True-True-True-True] 71.8130μs 25.1630μs 39.7409 KOps/s 41.2166 KOps/s $\color{#d91a1a}-3.58\%$
test_step_mdp_speed[False-True-True-True-False] 61.0540μs 16.2620μs 61.4929 KOps/s 64.2219 KOps/s $\color{#d91a1a}-4.25\%$
test_step_mdp_speed[False-True-True-False-True] 62.4530μs 16.7739μs 59.6164 KOps/s 62.4242 KOps/s $\color{#d91a1a}-4.50\%$
test_step_mdp_speed[False-True-True-False-False] 50.7980μs 10.3306μs 96.7996 KOps/s 98.7495 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-True-False-True-True] 57.9880μs 26.3648μs 37.9294 KOps/s 39.2827 KOps/s $\color{#d91a1a}-3.44\%$
test_step_mdp_speed[False-True-False-True-False] 66.2330μs 17.4325μs 57.3641 KOps/s 59.0922 KOps/s $\color{#d91a1a}-2.92\%$
test_step_mdp_speed[False-True-False-False-True] 37.4090μs 17.9010μs 55.8628 KOps/s 58.3102 KOps/s $\color{#d91a1a}-4.20\%$
test_step_mdp_speed[False-True-False-False-False] 52.2170μs 11.7185μs 85.3351 KOps/s 87.9628 KOps/s $\color{#d91a1a}-2.99\%$
test_step_mdp_speed[False-False-True-True-True] 58.7490μs 27.9465μs 35.7827 KOps/s 37.6230 KOps/s $\color{#d91a1a}-4.89\%$
test_step_mdp_speed[False-False-True-True-False] 66.0930μs 18.7755μs 53.2610 KOps/s 54.2362 KOps/s $\color{#d91a1a}-1.80\%$
test_step_mdp_speed[False-False-True-False-True] 66.2630μs 18.0000μs 55.5555 KOps/s 57.7370 KOps/s $\color{#d91a1a}-3.78\%$
test_step_mdp_speed[False-False-True-False-False] 32.3700μs 11.6410μs 85.9033 KOps/s 88.0475 KOps/s $\color{#d91a1a}-2.44\%$
test_step_mdp_speed[False-False-False-True-True] 76.9830μs 29.0245μs 34.4537 KOps/s 35.8852 KOps/s $\color{#d91a1a}-3.99\%$
test_step_mdp_speed[False-False-False-True-False] 62.8770μs 19.7377μs 50.6644 KOps/s 51.8143 KOps/s $\color{#d91a1a}-2.22\%$
test_step_mdp_speed[False-False-False-False-True] 49.3720μs 18.9289μs 52.8292 KOps/s 54.4125 KOps/s $\color{#d91a1a}-2.91\%$
test_step_mdp_speed[False-False-False-False-False] 57.4160μs 12.8519μs 77.8094 KOps/s 79.6466 KOps/s $\color{#d91a1a}-2.31\%$
test_values[generalized_advantage_estimate-True-True] 12.7936ms 12.1271ms 82.4600 Ops/s 82.8967 Ops/s $\color{#d91a1a}-0.53\%$
test_values[vec_generalized_advantage_estimate-True-True] 34.6871ms 27.6844ms 36.1214 Ops/s 37.5915 Ops/s $\color{#d91a1a}-3.91\%$
test_values[td0_return_estimate-False-False] 0.2521ms 0.1812ms 5.5184 KOps/s 5.3359 KOps/s $\color{#35bf28}+3.42\%$
test_values[td1_return_estimate-False-False] 25.9647ms 25.6857ms 38.9321 Ops/s 39.4586 Ops/s $\color{#d91a1a}-1.33\%$
test_values[vec_td1_return_estimate-False-False] 35.7068ms 28.1964ms 35.4655 Ops/s 37.4512 Ops/s $\textbf{\color{#d91a1a}-5.30\%}$
test_values[td_lambda_return_estimate-True-False] 38.0629ms 35.8882ms 27.8643 Ops/s 28.1224 Ops/s $\color{#d91a1a}-0.92\%$
test_values[vec_td_lambda_return_estimate-True-False] 34.8487ms 27.6387ms 36.1812 Ops/s 37.6580 Ops/s $\color{#d91a1a}-3.92\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.2398ms 8.0960ms 123.5183 Ops/s 126.3579 Ops/s $\color{#d91a1a}-2.25\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 9.7522ms 1.9182ms 521.3176 Ops/s 523.7334 Ops/s $\color{#d91a1a}-0.46\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 1.1746ms 0.4290ms 2.3308 KOps/s 2.3681 KOps/s $\color{#d91a1a}-1.58\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.2153ms 39.1422ms 25.5479 Ops/s 27.4008 Ops/s $\textbf{\color{#d91a1a}-6.76\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 11.1069ms 2.6483ms 377.5988 Ops/s 378.8406 Ops/s $\color{#d91a1a}-0.33\%$
test_dqn_speed 85.4506ms 8.2139ms 121.7450 Ops/s 119.1369 Ops/s $\color{#35bf28}+2.19\%$
test_ddpg_speed 18.9583ms 14.5961ms 68.5114 Ops/s 67.0689 Ops/s $\color{#35bf28}+2.15\%$
test_sac_speed 37.5333ms 29.6207ms 33.7602 Ops/s 33.0521 Ops/s $\color{#35bf28}+2.14\%$
test_redq_speed 37.6942ms 35.6996ms 28.0115 Ops/s 27.2690 Ops/s $\color{#35bf28}+2.72\%$
test_redq_deprec_speed 34.9308ms 25.9263ms 38.5709 Ops/s 37.1300 Ops/s $\color{#35bf28}+3.88\%$
test_td3_speed 29.6256ms 20.1491ms 49.6300 Ops/s 47.8777 Ops/s $\color{#35bf28}+3.66\%$
test_cql_speed 0.1789s 94.8879ms 10.5387 Ops/s 11.2881 Ops/s $\textbf{\color{#d91a1a}-6.64\%}$
test_a2c_speed 32.2642ms 26.8595ms 37.2308 Ops/s 36.7683 Ops/s $\color{#35bf28}+1.26\%$
test_ppo_speed 35.8586ms 27.2807ms 36.6559 Ops/s 36.1684 Ops/s $\color{#35bf28}+1.35\%$
test_reinforce_speed 32.4283ms 26.1365ms 38.2606 Ops/s 38.2485 Ops/s $\color{#35bf28}+0.03\%$
test_iql_speed 65.0161ms 63.2117ms 15.8199 Ops/s 15.4300 Ops/s $\color{#35bf28}+2.53\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.0268ms 1.4395ms 694.7090 Ops/s 642.1516 Ops/s $\textbf{\color{#35bf28}+8.18\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6367ms 0.5073ms 1.9713 KOps/s 1.9349 KOps/s $\color{#35bf28}+1.88\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 8.8995ms 0.4985ms 2.0061 KOps/s 1.9720 KOps/s $\color{#35bf28}+1.73\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.2238ms 1.4206ms 703.9261 Ops/s 658.7100 Ops/s $\textbf{\color{#35bf28}+6.86\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 10.8731ms 0.5212ms 1.9187 KOps/s 1.8450 KOps/s $\color{#35bf28}+4.00\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.1056s 0.5819ms 1.7184 KOps/s 1.6750 KOps/s $\color{#35bf28}+2.59\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.9856ms 1.7393ms 574.9296 Ops/s 553.6560 Ops/s $\color{#35bf28}+3.84\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 8.9884ms 0.6486ms 1.5418 KOps/s 1.5160 KOps/s $\color{#35bf28}+1.70\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 8.9308ms 0.6369ms 1.5702 KOps/s 1.5493 KOps/s $\color{#35bf28}+1.35\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 1.8229ms 1.5068ms 663.6648 Ops/s 661.3822 Ops/s $\color{#35bf28}+0.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6499ms 0.5084ms 1.9669 KOps/s 1.8930 KOps/s $\color{#35bf28}+3.90\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 8.8732ms 0.5053ms 1.9792 KOps/s 1.9624 KOps/s $\color{#35bf28}+0.85\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.0235ms 1.4178ms 705.3107 Ops/s 637.2276 Ops/s $\textbf{\color{#35bf28}+10.68\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6581ms 0.5053ms 1.9791 KOps/s 1.4816 KOps/s $\textbf{\color{#35bf28}+33.58\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6429ms 0.4928ms 2.0291 KOps/s 2.0006 KOps/s $\color{#35bf28}+1.43\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.5368ms 1.6343ms 611.8791 Ops/s 558.3923 Ops/s $\textbf{\color{#35bf28}+9.58\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7558ms 0.6364ms 1.5712 KOps/s 1.5231 KOps/s $\color{#35bf28}+3.16\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 8.9377ms 0.6428ms 1.5556 KOps/s 1.5628 KOps/s $\color{#d91a1a}-0.46\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1062s 17.0095ms 58.7907 Ops/s 56.3039 Ops/s $\color{#35bf28}+4.42\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 15.5858ms 13.4989ms 74.0804 Ops/s 73.9981 Ops/s $\color{#35bf28}+0.11\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 5.6245ms 3.2110ms 311.4318 Ops/s 305.6762 Ops/s $\color{#35bf28}+1.88\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1083s 17.0385ms 58.6906 Ops/s 57.5315 Ops/s $\color{#35bf28}+2.01\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 21.4595ms 13.6204ms 73.4192 Ops/s 74.5769 Ops/s $\color{#d91a1a}-1.55\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.6130ms 3.2100ms 311.5236 Ops/s 294.4899 Ops/s $\textbf{\color{#35bf28}+5.78\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1115s 17.3831ms 57.5273 Ops/s 56.6908 Ops/s $\color{#35bf28}+1.48\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1084s 15.6966ms 63.7081 Ops/s 73.1794 Ops/s $\textbf{\color{#d91a1a}-12.94\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 5.7233ms 3.4461ms 290.1827 Ops/s 183.6206 Ops/s $\textbf{\color{#35bf28}+58.03\%}$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1224s 0.1196s 8.3593 Ops/s 8.1375 Ops/s $\color{#35bf28}+2.73\%$
test_sync 0.1819s 0.1099s 9.0977 Ops/s 9.0936 Ops/s $\color{#35bf28}+0.04\%$
test_async 0.2730s 0.1002s 9.9822 Ops/s 9.9699 Ops/s $\color{#35bf28}+0.12\%$
test_single_pixels 0.1375s 0.1366s 7.3211 Ops/s 7.1520 Ops/s $\color{#35bf28}+2.36\%$
test_sync_pixels 95.9177ms 95.0328ms 10.5227 Ops/s 10.4987 Ops/s $\color{#35bf28}+0.23\%$
test_async_pixels 0.2505s 92.6043ms 10.7986 Ops/s 11.0620 Ops/s $\color{#d91a1a}-2.38\%$
test_simple 0.9419s 0.8753s 1.1424 Ops/s 1.1131 Ops/s $\color{#35bf28}+2.63\%$
test_transformed 1.1824s 1.1135s 0.8981 Ops/s 0.8710 Ops/s $\color{#35bf28}+3.11\%$
test_serial 2.5240s 2.4473s 0.4086 Ops/s 0.3945 Ops/s $\color{#35bf28}+3.57\%$
test_parallel 2.5500s 2.4783s 0.4035 Ops/s 0.4022 Ops/s $\color{#35bf28}+0.33\%$
test_step_mdp_speed[True-True-True-True-True] 98.3310μs 32.8501μs 30.4413 KOps/s 30.1114 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-True-True-True-False] 35.3800μs 19.2794μs 51.8688 KOps/s 50.8139 KOps/s $\color{#35bf28}+2.08\%$
test_step_mdp_speed[True-True-True-False-True] 37.0310μs 18.5769μs 53.8304 KOps/s 52.9670 KOps/s $\color{#35bf28}+1.63\%$
test_step_mdp_speed[True-True-True-False-False] 35.6200μs 11.1748μs 89.4871 KOps/s 89.5852 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-True-False-True-True] 56.0800μs 33.9226μs 29.4789 KOps/s 28.1508 KOps/s $\color{#35bf28}+4.72\%$
test_step_mdp_speed[True-True-False-True-False] 54.2410μs 21.3409μs 46.8583 KOps/s 46.5227 KOps/s $\color{#35bf28}+0.72\%$
test_step_mdp_speed[True-True-False-False-True] 36.5600μs 20.5909μs 48.5651 KOps/s 47.5710 KOps/s $\color{#35bf28}+2.09\%$
test_step_mdp_speed[True-True-False-False-False] 71.3610μs 13.2366μs 75.5482 KOps/s 75.9285 KOps/s $\color{#d91a1a}-0.50\%$
test_step_mdp_speed[True-False-True-True-True] 68.2510μs 36.2833μs 27.5609 KOps/s 26.8757 KOps/s $\color{#35bf28}+2.55\%$
test_step_mdp_speed[True-False-True-True-False] 46.9500μs 23.1559μs 43.1856 KOps/s 42.9164 KOps/s $\color{#35bf28}+0.63\%$
test_step_mdp_speed[True-False-True-False-True] 39.1410μs 20.6856μs 48.3427 KOps/s 48.1498 KOps/s $\color{#35bf28}+0.40\%$
test_step_mdp_speed[True-False-True-False-False] 31.8200μs 13.0750μs 76.4820 KOps/s 75.7382 KOps/s $\color{#35bf28}+0.98\%$
test_step_mdp_speed[True-False-False-True-True] 83.7410μs 37.9162μs 26.3739 KOps/s 25.7604 KOps/s $\color{#35bf28}+2.38\%$
test_step_mdp_speed[True-False-False-True-False] 43.3010μs 24.7074μs 40.4737 KOps/s 39.8422 KOps/s $\color{#35bf28}+1.59\%$
test_step_mdp_speed[True-False-False-False-True] 40.9500μs 22.0615μs 45.3278 KOps/s 44.5298 KOps/s $\color{#35bf28}+1.79\%$
test_step_mdp_speed[True-False-False-False-False] 36.7700μs 14.8065μs 67.5377 KOps/s 66.3213 KOps/s $\color{#35bf28}+1.83\%$
test_step_mdp_speed[False-True-True-True-True] 55.5400μs 36.1354μs 27.6737 KOps/s 27.1065 KOps/s $\color{#35bf28}+2.09\%$
test_step_mdp_speed[False-True-True-True-False] 43.9310μs 22.9100μs 43.6490 KOps/s 42.7824 KOps/s $\color{#35bf28}+2.03\%$
test_step_mdp_speed[False-True-True-False-True] 0.1210ms 25.2418μs 39.6169 KOps/s 40.5145 KOps/s $\color{#d91a1a}-2.22\%$
test_step_mdp_speed[False-True-True-False-False] 40.6000μs 14.9826μs 66.7440 KOps/s 65.4890 KOps/s $\color{#35bf28}+1.92\%$
test_step_mdp_speed[False-True-False-True-True] 79.5410μs 38.8616μs 25.7324 KOps/s 26.0963 KOps/s $\color{#d91a1a}-1.39\%$
test_step_mdp_speed[False-True-False-True-False] 51.0610μs 25.0116μs 39.9814 KOps/s 39.6882 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[False-True-False-False-True] 51.2900μs 26.8952μs 37.1813 KOps/s 37.8061 KOps/s $\color{#d91a1a}-1.65\%$
test_step_mdp_speed[False-True-False-False-False] 36.7610μs 16.5853μs 60.2942 KOps/s 59.5574 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[False-False-True-True-True] 59.7810μs 39.9792μs 25.0130 KOps/s 24.6106 KOps/s $\color{#35bf28}+1.64\%$
test_step_mdp_speed[False-False-True-True-False] 42.8200μs 26.8306μs 37.2709 KOps/s 37.2060 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[False-False-True-False-True] 52.2300μs 26.7150μs 37.4322 KOps/s 37.9891 KOps/s $\color{#d91a1a}-1.47\%$
test_step_mdp_speed[False-False-True-False-False] 33.1500μs 16.6864μs 59.9290 KOps/s 59.2476 KOps/s $\color{#35bf28}+1.15\%$
test_step_mdp_speed[False-False-False-True-True] 58.4810μs 41.7099μs 23.9751 KOps/s 23.8583 KOps/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[False-False-False-True-False] 43.0110μs 28.7284μs 34.8088 KOps/s 35.0309 KOps/s $\color{#d91a1a}-0.63\%$
test_step_mdp_speed[False-False-False-False-True] 49.9810μs 28.0871μs 35.6035 KOps/s 36.5397 KOps/s $\color{#d91a1a}-2.56\%$
test_step_mdp_speed[False-False-False-False-False] 54.8700μs 18.4538μs 54.1895 KOps/s 53.8757 KOps/s $\color{#35bf28}+0.58\%$
test_values[generalized_advantage_estimate-True-True] 25.0383ms 24.4262ms 40.9397 Ops/s 39.7272 Ops/s $\color{#35bf28}+3.05\%$
test_values[vec_generalized_advantage_estimate-True-True] 85.0793ms 3.2561ms 307.1122 Ops/s 310.1737 Ops/s $\color{#d91a1a}-0.99\%$
test_values[td0_return_estimate-False-False] 90.7910μs 60.5060μs 16.5273 KOps/s 15.9770 KOps/s $\color{#35bf28}+3.44\%$
test_values[td1_return_estimate-False-False] 52.6323ms 52.2387ms 19.1429 Ops/s 18.4324 Ops/s $\color{#35bf28}+3.85\%$
test_values[vec_td1_return_estimate-False-False] 2.0133ms 1.7453ms 572.9570 Ops/s 567.1999 Ops/s $\color{#35bf28}+1.02\%$
test_values[td_lambda_return_estimate-True-False] 85.3535ms 83.0901ms 12.0351 Ops/s 11.6293 Ops/s $\color{#35bf28}+3.49\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0460ms 1.7432ms 573.6722 Ops/s 567.8403 Ops/s $\color{#35bf28}+1.03\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.1392ms 22.8725ms 43.7207 Ops/s 41.0244 Ops/s $\textbf{\color{#35bf28}+6.57\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8411ms 0.6807ms 1.4690 KOps/s 1.4225 KOps/s $\color{#35bf28}+3.27\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.6913ms 0.6392ms 1.5644 KOps/s 1.5314 KOps/s $\color{#35bf28}+2.15\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4659ms 1.4384ms 695.2207 Ops/s 686.9526 Ops/s $\color{#35bf28}+1.20\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9335ms 0.6600ms 1.5151 KOps/s 1.4890 KOps/s $\color{#35bf28}+1.75\%$
test_dqn_speed 7.4562ms 7.1019ms 140.8082 Ops/s 132.9358 Ops/s $\textbf{\color{#35bf28}+5.92\%}$
test_ddpg_speed 14.8898ms 14.2595ms 70.1285 Ops/s 68.3415 Ops/s $\color{#35bf28}+2.61\%$
test_sac_speed 29.7597ms 28.8837ms 34.6216 Ops/s 30.7077 Ops/s $\textbf{\color{#35bf28}+12.75\%}$
test_redq_speed 34.9217ms 34.2366ms 29.2085 Ops/s 28.2799 Ops/s $\color{#35bf28}+3.28\%$
test_redq_deprec_speed 24.9878ms 24.0149ms 41.6408 Ops/s 41.1007 Ops/s $\color{#35bf28}+1.31\%$
test_td3_speed 28.4736ms 19.6548ms 50.8782 Ops/s 49.6157 Ops/s $\color{#35bf28}+2.54\%$
test_cql_speed 84.9695ms 83.5548ms 11.9682 Ops/s 11.8581 Ops/s $\color{#35bf28}+0.93\%$
test_a2c_speed 27.4925ms 26.7566ms 37.3740 Ops/s 36.7582 Ops/s $\color{#35bf28}+1.68\%$
test_ppo_speed 27.7324ms 26.8354ms 37.2642 Ops/s 36.4268 Ops/s $\color{#35bf28}+2.30\%$
test_reinforce_speed 26.3068ms 25.8939ms 38.6192 Ops/s 37.9487 Ops/s $\color{#35bf28}+1.77\%$
test_iql_speed 58.3817ms 57.3071ms 17.4498 Ops/s 17.1458 Ops/s $\color{#35bf28}+1.77\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.7098ms 1.9126ms 522.8500 Ops/s 521.7291 Ops/s $\color{#35bf28}+0.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9508ms 0.8317ms 1.2023 KOps/s 1.1925 KOps/s $\color{#35bf28}+0.82\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.9357ms 0.8220ms 1.2166 KOps/s 1.2094 KOps/s $\color{#35bf28}+0.60\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.6735ms 1.8873ms 529.8524 Ops/s 528.7925 Ops/s $\color{#35bf28}+0.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9429ms 0.8207ms 1.2185 KOps/s 1.2077 KOps/s $\color{#35bf28}+0.90\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9502ms 0.8129ms 1.2302 KOps/s 1.2217 KOps/s $\color{#35bf28}+0.69\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.0790ms 2.1519ms 464.7082 Ops/s 459.6109 Ops/s $\color{#35bf28}+1.11\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0750ms 0.9460ms 1.0571 KOps/s 1.0450 KOps/s $\color{#35bf28}+1.16\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0597ms 0.9390ms 1.0650 KOps/s 1.0553 KOps/s $\color{#35bf28}+0.91\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.3163ms 1.9182ms 521.3163 Ops/s 524.1814 Ops/s $\color{#d91a1a}-0.55\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9929ms 0.8329ms 1.2006 KOps/s 1.1928 KOps/s $\color{#35bf28}+0.66\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.9477ms 0.8227ms 1.2156 KOps/s 1.2066 KOps/s $\color{#35bf28}+0.74\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 0.1299s 2.1797ms 458.7683 Ops/s 525.2161 Ops/s $\textbf{\color{#d91a1a}-12.65\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9560ms 0.8225ms 1.2158 KOps/s 1.2071 KOps/s $\color{#35bf28}+0.72\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.9418ms 0.8138ms 1.2288 KOps/s 1.2185 KOps/s $\color{#35bf28}+0.84\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 0.1364s 2.4927ms 401.1634 Ops/s 460.3857 Ops/s $\textbf{\color{#d91a1a}-12.86\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0427ms 0.9480ms 1.0549 KOps/s 1.0439 KOps/s $\color{#35bf28}+1.05\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0655ms 0.9396ms 1.0643 KOps/s 1.0542 KOps/s $\color{#35bf28}+0.96\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1580s 18.7762ms 53.2590 Ops/s 53.0054 Ops/s $\color{#35bf28}+0.48\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 15.7291ms 13.6523ms 73.2476 Ops/s 72.5603 Ops/s $\color{#35bf28}+0.95\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.4288ms 3.2670ms 306.0897 Ops/s 301.7239 Ops/s $\color{#35bf28}+1.45\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1233s 18.0545ms 55.3880 Ops/s 55.2224 Ops/s $\color{#35bf28}+0.30\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.1185ms 13.6807ms 73.0955 Ops/s 72.5127 Ops/s $\color{#35bf28}+0.80\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.2279ms 3.2656ms 306.2232 Ops/s 301.7209 Ops/s $\color{#35bf28}+1.49\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1246s 18.3514ms 54.4917 Ops/s 54.4110 Ops/s $\color{#35bf28}+0.15\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.3853ms 13.8418ms 72.2449 Ops/s 71.5040 Ops/s $\color{#35bf28}+1.04\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 6.7991ms 3.4838ms 287.0397 Ops/s 285.6267 Ops/s $\color{#35bf28}+0.49\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot