Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python 3.11 in README #1434

Merged
merged 2 commits into from
Aug 1, 2023
Merged

python 3.11 in README #1434

merged 2 commits into from
Aug 1, 2023

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Aug 1, 2023

No description provided.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 1, 2023
@vmoens vmoens added the documentation Improvements or additions to documentation label Aug 1, 2023
@vmoens vmoens changed the title python 3.11 0 Update README.md python 3.11 in README Aug 1, 2023
@vmoens vmoens merged commit bbf5545 into main Aug 1, 2023
@vmoens vmoens deleted the vmoens-patch-1 branch August 1, 2023 09:28
@github-actions
Copy link

github-actions bot commented Aug 1, 2023

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1693s 0.1683s 5.9422 Ops/s 5.7713 Ops/s $\color{#35bf28}+2.96\%$
test_sync 96.8334ms 91.4161ms 10.9390 Ops/s 11.0457 Ops/s $\color{#d91a1a}-0.97\%$
test_async 0.1766s 0.1086s 9.2061 Ops/s 10.1887 Ops/s $\textbf{\color{#d91a1a}-9.64\%}$
test_simple 0.8601s 0.7398s 1.3517 Ops/s 1.3483 Ops/s $\color{#35bf28}+0.25\%$
test_transformed 2.0747s 1.9767s 0.5059 Ops/s 0.4962 Ops/s $\color{#35bf28}+1.95\%$
test_serial 2.3685s 2.2673s 0.4411 Ops/s 0.4239 Ops/s $\color{#35bf28}+4.04\%$
test_parallel 2.0444s 1.9458s 0.5139 Ops/s 0.5102 Ops/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-True-True-True-True] 5.1284ms 55.9944μs 17.8589 KOps/s 18.9854 KOps/s $\textbf{\color{#d91a1a}-5.93\%}$
test_step_mdp_speed[True-True-True-True-False] 0.1554ms 28.8675μs 34.6411 KOps/s 33.4911 KOps/s $\color{#35bf28}+3.43\%$
test_step_mdp_speed[True-True-True-False-True] 0.1247ms 36.3214μs 27.5320 KOps/s 26.8933 KOps/s $\color{#35bf28}+2.37\%$
test_step_mdp_speed[True-True-True-False-False] 66.1040μs 19.8881μs 50.2814 KOps/s 49.8721 KOps/s $\color{#35bf28}+0.82\%$
test_step_mdp_speed[True-True-False-True-True] 0.1016ms 54.1400μs 18.4706 KOps/s 18.4933 KOps/s $\color{#d91a1a}-0.12\%$
test_step_mdp_speed[True-True-False-True-False] 0.1498ms 31.4188μs 31.8281 KOps/s 31.3189 KOps/s $\color{#35bf28}+1.63\%$
test_step_mdp_speed[True-True-False-False-True] 0.1784ms 38.8101μs 25.7665 KOps/s 25.5946 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[True-True-False-False-False] 0.1424ms 22.4839μs 44.4763 KOps/s 43.9633 KOps/s $\color{#35bf28}+1.17\%$
test_step_mdp_speed[True-False-True-True-True] 0.2842ms 55.5952μs 17.9872 KOps/s 17.8065 KOps/s $\color{#35bf28}+1.01\%$
test_step_mdp_speed[True-False-True-True-False] 0.1253ms 33.4515μs 29.8940 KOps/s 29.4011 KOps/s $\color{#35bf28}+1.68\%$
test_step_mdp_speed[True-False-True-False-True] 0.1712ms 39.1624μs 25.5347 KOps/s 25.9987 KOps/s $\color{#d91a1a}-1.78\%$
test_step_mdp_speed[True-False-True-False-False] 55.9040μs 22.2556μs 44.9326 KOps/s 44.1648 KOps/s $\color{#35bf28}+1.74\%$
test_step_mdp_speed[True-False-False-True-True] 0.1952ms 57.6545μs 17.3447 KOps/s 17.1669 KOps/s $\color{#35bf28}+1.04\%$
test_step_mdp_speed[True-False-False-True-False] 0.1232ms 35.5254μs 28.1489 KOps/s 27.7312 KOps/s $\color{#35bf28}+1.51\%$
test_step_mdp_speed[True-False-False-False-True] 0.1580ms 40.9669μs 24.4100 KOps/s 24.4716 KOps/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[True-False-False-False-False] 0.1221ms 24.6151μs 40.6255 KOps/s 40.3372 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[False-True-True-True-True] 0.1061ms 55.5223μs 18.0108 KOps/s 17.7981 KOps/s $\color{#35bf28}+1.20\%$
test_step_mdp_speed[False-True-True-True-False] 0.1279ms 33.4891μs 29.8604 KOps/s 29.6768 KOps/s $\color{#35bf28}+0.62\%$
test_step_mdp_speed[False-True-True-False-True] 80.9050μs 45.1733μs 22.1370 KOps/s 21.8961 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[False-True-True-False-False] 99.6070μs 25.4322μs 39.3202 KOps/s 38.7255 KOps/s $\color{#35bf28}+1.54\%$
test_step_mdp_speed[False-True-False-True-True] 0.1960ms 57.4988μs 17.3917 KOps/s 17.0605 KOps/s $\color{#35bf28}+1.94\%$
test_step_mdp_speed[False-True-False-True-False] 0.1520ms 35.3225μs 28.3106 KOps/s 27.7189 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[False-True-False-False-True] 0.1746ms 47.2333μs 21.1715 KOps/s 20.8927 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[False-True-False-False-False] 0.5820ms 27.8696μs 35.8814 KOps/s 36.0127 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[False-False-True-True-True] 0.6150ms 59.9519μs 16.6800 KOps/s 16.3349 KOps/s $\color{#35bf28}+2.11\%$
test_step_mdp_speed[False-False-True-True-False] 0.1529ms 37.4196μs 26.7240 KOps/s 26.2588 KOps/s $\color{#35bf28}+1.77\%$
test_step_mdp_speed[False-False-True-False-True] 91.6060μs 47.0854μs 21.2380 KOps/s 20.9870 KOps/s $\color{#35bf28}+1.20\%$
test_step_mdp_speed[False-False-True-False-False] 0.1457ms 27.1625μs 36.8155 KOps/s 36.8669 KOps/s $\color{#d91a1a}-0.14\%$
test_step_mdp_speed[False-False-False-True-True] 0.1350ms 61.6898μs 16.2101 KOps/s 15.9391 KOps/s $\color{#35bf28}+1.70\%$
test_step_mdp_speed[False-False-False-True-False] 0.1716ms 39.2140μs 25.5011 KOps/s 24.7772 KOps/s $\color{#35bf28}+2.92\%$
test_step_mdp_speed[False-False-False-False-True] 84.4060μs 48.5732μs 20.5875 KOps/s 20.3920 KOps/s $\color{#35bf28}+0.96\%$
test_step_mdp_speed[False-False-False-False-False] 0.1043ms 29.2075μs 34.2378 KOps/s 33.9433 KOps/s $\color{#35bf28}+0.87\%$
test_values[generalized_advantage_estimate-True-True] 17.7681ms 16.0417ms 62.3376 Ops/s 60.0795 Ops/s $\color{#35bf28}+3.76\%$
test_values[vec_generalized_advantage_estimate-True-True] 79.2132ms 62.9067ms 15.8966 Ops/s 15.9916 Ops/s $\color{#d91a1a}-0.59\%$
test_values[td0_return_estimate-False-False] 0.5886ms 0.3033ms 3.2966 KOps/s 3.6053 KOps/s $\textbf{\color{#d91a1a}-8.56\%}$
test_values[td1_return_estimate-False-False] 15.9772ms 15.7110ms 63.6498 Ops/s 62.4289 Ops/s $\color{#35bf28}+1.96\%$
test_values[vec_td1_return_estimate-False-False] 71.2147ms 61.8722ms 16.1623 Ops/s 15.9613 Ops/s $\color{#35bf28}+1.26\%$
test_values[td_lambda_return_estimate-True-False] 37.4505ms 37.0840ms 26.9658 Ops/s 26.0109 Ops/s $\color{#35bf28}+3.67\%$
test_values[vec_td_lambda_return_estimate-True-False] 69.5676ms 62.6576ms 15.9598 Ops/s 15.8971 Ops/s $\color{#35bf28}+0.39\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 13.8797ms 13.6418ms 73.3042 Ops/s 70.1118 Ops/s $\color{#35bf28}+4.55\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 5.0404ms 4.0963ms 244.1209 Ops/s 215.8400 Ops/s $\textbf{\color{#35bf28}+13.10\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8597ms 0.5505ms 1.8167 KOps/s 1.7552 KOps/s $\color{#35bf28}+3.50\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 85.2052ms 80.0450ms 12.4930 Ops/s 15.1432 Ops/s $\textbf{\color{#d91a1a}-17.50\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.4335ms 3.8161ms 262.0452 Ops/s 258.8302 Ops/s $\color{#35bf28}+1.24\%$
test_dqn_speed 9.8378ms 1.8727ms 533.9973 Ops/s 533.7719 Ops/s $\color{#35bf28}+0.04\%$
test_ddpg_speed 4.0702ms 3.4685ms 288.3094 Ops/s 283.3524 Ops/s $\color{#35bf28}+1.75\%$
test_sac_speed 11.2542ms 10.0802ms 99.2042 Ops/s 90.1454 Ops/s $\textbf{\color{#35bf28}+10.05\%}$
test_redq_speed 20.3582ms 18.1010ms 55.2454 Ops/s 53.2130 Ops/s $\color{#35bf28}+3.82\%$
test_redq_deprec_speed 17.6945ms 16.1198ms 62.0355 Ops/s 56.8900 Ops/s $\textbf{\color{#35bf28}+9.04\%}$
test_td3_speed 27.1121ms 12.7174ms 78.6325 Ops/s 76.6687 Ops/s $\color{#35bf28}+2.56\%$
test_cql_speed 47.1401ms 37.6420ms 26.5661 Ops/s 28.4126 Ops/s $\textbf{\color{#d91a1a}-6.50\%}$
test_a2c_speed 13.0140ms 7.2603ms 137.7350 Ops/s 142.3769 Ops/s $\color{#d91a1a}-3.26\%$
test_ppo_speed 16.7186ms 8.1516ms 122.6748 Ops/s 132.2323 Ops/s $\textbf{\color{#d91a1a}-7.23\%}$
test_reinforce_speed 9.2300ms 5.8193ms 171.8421 Ops/s 178.7485 Ops/s $\color{#d91a1a}-3.86\%$
test_iql_speed 30.6336ms 29.1351ms 34.3229 Ops/s 36.3945 Ops/s $\textbf{\color{#d91a1a}-5.69\%}$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.0739ms 3.8184ms 261.8902 Ops/s 276.1228 Ops/s $\textbf{\color{#d91a1a}-5.15\%}$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 9.8835ms 4.0032ms 249.7981 Ops/s 195.1905 Ops/s $\textbf{\color{#35bf28}+27.98\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.2697s 5.0214ms 199.1469 Ops/s 201.4202 Ops/s $\color{#d91a1a}-1.13\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.5946ms 3.7990ms 263.2254 Ops/s 272.4970 Ops/s $\color{#d91a1a}-3.40\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.2660s 5.0030ms 199.8813 Ops/s 200.1317 Ops/s $\color{#d91a1a}-0.13\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 10.9314ms 3.9644ms 252.2438 Ops/s 200.9137 Ops/s $\textbf{\color{#35bf28}+25.55\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.0988ms 3.6977ms 270.4372 Ops/s 274.7513 Ops/s $\color{#d91a1a}-1.57\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 11.0400ms 3.9848ms 250.9539 Ops/s 199.4249 Ops/s $\textbf{\color{#35bf28}+25.84\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 7.9061ms 3.8708ms 258.3474 Ops/s 257.9351 Ops/s $\color{#35bf28}+0.16\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.0556ms 3.6415ms 274.6142 Ops/s 274.1972 Ops/s $\color{#35bf28}+0.15\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 7.0935ms 3.8213ms 261.6940 Ops/s 258.5502 Ops/s $\color{#35bf28}+1.22\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 8.0625ms 3.8530ms 259.5397 Ops/s 256.2528 Ops/s $\color{#35bf28}+1.28\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.9455ms 3.5396ms 282.5153 Ops/s 267.8386 Ops/s $\textbf{\color{#35bf28}+5.48\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.2678s 5.2553ms 190.2826 Ops/s 252.3743 Ops/s $\textbf{\color{#d91a1a}-24.60\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 8.9580ms 3.8490ms 259.8077 Ops/s 254.4174 Ops/s $\color{#35bf28}+2.12\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.1400ms 3.5500ms 281.6898 Ops/s 275.4828 Ops/s $\color{#35bf28}+2.25\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 8.2460ms 3.9261ms 254.7047 Ops/s 256.2754 Ops/s $\color{#d91a1a}-0.61\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 8.7966ms 3.8676ms 258.5586 Ops/s 252.7618 Ops/s $\color{#35bf28}+2.29\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.5213s 44.0324ms 22.7106 Ops/s 22.6771 Ops/s $\color{#35bf28}+0.15\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.2538s 42.3181ms 23.6306 Ops/s 23.1652 Ops/s $\color{#35bf28}+2.01\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 0.2560s 38.2812ms 26.1225 Ops/s 29.5396 Ops/s $\textbf{\color{#d91a1a}-11.57\%}$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.2570s 42.8640ms 23.3296 Ops/s 22.7902 Ops/s $\color{#35bf28}+2.37\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.2523s 38.1090ms 26.2405 Ops/s 24.9463 Ops/s $\textbf{\color{#35bf28}+5.19\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.2546s 42.6097ms 23.4689 Ops/s 22.1067 Ops/s $\textbf{\color{#35bf28}+6.16\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.2491s 37.8003ms 26.4548 Ops/s 24.6096 Ops/s $\textbf{\color{#35bf28}+7.50\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.2672s 43.3004ms 23.0945 Ops/s 21.9778 Ops/s $\textbf{\color{#35bf28}+5.08\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 0.2543s 37.9687ms 26.3375 Ops/s 24.8342 Ops/s $\textbf{\color{#35bf28}+6.05\%}$

vmoens added a commit to hyerra/rl that referenced this pull request Oct 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants