Code

Release 0.1.3#486

Code

Merged

KaleabTessera merged 139 commits intomaininstadeepai/Mava:mainfrom developinstadeepai/Mava:developCopy head branch name to clipboardJun 15, 2022

+2,230-624

Commits

Commits on Sep 27, 2021

• Add rough recurrent code for MAPPO.

  DriesSmit

  committed
  a535e3d

• Save progress.

  DriesSmit

  committed
  0c6405b

• Save recurrent PPO progress.

  DriesSmit

  committed
  71f4dc6

Commits on Sep 28, 2021

• Recurrent PPO is running.

  DriesSmit

  committed
  cc42e98

• Small fixes.

  DriesSmit

  committed
  1ae02b5

Commits on Sep 29, 2021

• Recurrent MAPPO trains of the debugging environment!

  DriesSmit

  committed
  ac46176

• Small fix.

  DriesSmit

  committed
  1e4aaae

Commits on Sep 30, 2021

• Save changes.

  DriesSmit

  committed
  fa2b43c

Commits on Oct 3, 2021

• Add code to MAD4PG.

  DriesSmit

  committed
  a2bbc86

Commits on Oct 4, 2021

• Ready to run 2 vs 2 xray_attention.

  DriesSmit

  committed
  345fe1b

Commits on Oct 5, 2021

• Decrease queue size.

  DriesSmit

  committed
  a25e977

Commits on Oct 29, 2021

• Merge develop.

  DriesSmit

  committed
  3c8a32a

• PPO seems to be training and running.

  DriesSmit

  committed
  792ea3c

• Add multiple trainers PPO example.

  DriesSmit

  committed
  f1006c1

Commits on Nov 19, 2021

• Merge branch 'develop' into feature/recurrent-mappo

  DriesSmit

  authored
  cbf9cda

Commits on Dec 3, 2021

• Merge develop.

  DriesSmit

  committed
  5b44c5b

• Fix PPO example.

  DriesSmit

  committed
  c33e32c

• Fix embed_spec bug.

  DriesSmit

  committed
  ef77441

• Fix mypy issues.

  DriesSmit

  committed
  fb1c43c

• Fix mypy issue.

  DriesSmit

  committed
  58b68f9

Commits on Dec 13, 2021

• Merge branch 'develop' into feature/recurrent-mappo

  KaleabTessera

  authored
  153e0e5

Commits on Dec 14, 2021

• Address some of the PR comments.

  DriesSmit

  committed
  e4a343e

• Add termination condition to MA-PPO.

  DriesSmit

  committed
  d7f8ba5

• Merge branch 'develop' into feature/recurrent-mappo

  DriesSmit

  committed
  05c1650

Commits on Jan 6, 2022

• Merge branch 'develop' into feature/recurrent-mappo

  DriesSmit

  authored
  473d40d

• Merge branch 'develop' into feature/recurrent-mappo

  KaleabTessera

  authored
  f709231

Commits on Jan 12, 2022

• Address PR comments.

  DriesSmit

  committed
  aef20d2

Commits on Jan 13, 2022

• Add the capability for MAPPO to use continuous action spaces.

  DriesSmit

  committed
  92abb30

Commits on Jan 14, 2022

• Merge branch 'develop' into feature/recurrent-mappo

  arnupretorius

  authored
  7797e91

• Merge branch 'develop' into feature/recurrent-mappo

  arnupretorius

  authored
  eba009c

Commits on Mar 9, 2022

• fix: Small fixes.

  DriesSmit

  committed
  c89ce9f

• fix: mypy.

  DriesSmit

  committed
  276933c

Commits on Mar 10, 2022

• Merge branch 'develop' into feature/recurrent-mappo

  DriesSmit

  authored
  ad2f300

Commits on Mar 22, 2022

• temp obs gradient var

  AsadJeewa

  committed
  28c3217

• temp obs gradient var

  AsadJeewa

  committed
  d6595f7

• Merge branch 'develop' into feat/maddpg_obs_optim

  AsadJeewa

  authored
  f8810b1

Commits on Mar 23, 2022

• Merge branch 'develop' into feature/recurrent-mappo

  DriesSmit

  committed
  c5ffe70

• fix: Test small fix.

  DriesSmit

  committed
  1967146

• fix: Change writer back.

  DriesSmit

  committed
  1fcaf0c

• fix: Change back.

  DriesSmit

  committed
  75ba274

• temp obs gradient var

  AsadJeewa

  committed
  ee366e7

• fix: Distributional head inside networks.

  DriesSmit

  committed
  21b376b

• feat: configurable obs network ddpg d4pg

  AsadJeewa

  committed
  0c49d7a

Commits on Mar 24, 2022

• Merge branch 'develop' into feat/maddpg_obs_optim

  AsadJeewa

  authored
  78a4d7c

• fix: Merge dev.

  DriesSmit

  committed
  232a540

• fix: Change static unroll function to a manual unroll function.

  DriesSmit

  committed
  315a151

Commits on Mar 25, 2022

• fix: Change setting in PPO sequence adder. Remove custom adder code.

  DriesSmit

  committed
  c0e3127

• fix: Small comment updates.

  DriesSmit

  committed
  9217172

Commits on Mar 28, 2022

• bugfix: architecture type typo fix

  RuanJohn

  committed
  66757a2

• fix: Baseline cost defualt.

  DriesSmit

  committed
  b8ccfe0

• Merge branch 'feature/recurrent-mappo' of github.com:instadeepai/Mava into feature/recurrent-mappo

  DriesSmit

  committed
  acf592f

• fix: Update defualt sequence length.

  DriesSmit

  committed
  f0186b6

Commits on Mar 29, 2022

• Fix entropy term in trainer for continuous action space environments.

  DriesSmit

  committed
  091d73a

• fix: Small fix to entropy loss.

  DriesSmit

  committed
  7ce71c7

• fix: Small fix to variable spelling.

  DriesSmit

  committed
  64cb86a

Commits on Mar 31, 2022

• fix: Fix continuous action space PPO by creating custom clipped Gaussian head.

  DriesSmit

  committed
  d797241

• fix: Small fixes.

  DriesSmit

  committed
  b34c707

• fix: Replace clip to spec with tanh to spec.

  DriesSmit

  committed
  ec31d19

• fix: Remove comment.

  DriesSmit

  committed
  527d8df

• fix: Remove comment.

  DriesSmit

  committed
  40a430e

• debug: d4pg update_obs_once

  AsadJeewa

  committed
  c9a1902

• remove debug code

  AsadJeewa

  committed
  771fc5a

• remove debug code

  AsadJeewa

  committed
  50eaae7

Commits on Apr 1, 2022

• feature: Update Gaussian head's settings control the possible distributions better.

  DriesSmit

  committed
  86147a2

• feature: Small update.

  DriesSmit

  committed
  91fc6a0

• fix: Update black version.

  DriesSmit

  committed
  3ca5feb

• chore: Ignore files generated in testing when formatting code.

  KaleabTessera

  committed
  3852b0a

• fix: Update black version.

  DriesSmit

  committed
  9da3b55

• fix: Update black version.

  DriesSmit

  committed
  c3f08a6

• chore: Minor black changes.

  KaleabTessera

  committed
  a76921a

• Merge pull request #470 from instadeepai/bugfix/black-version-update

  Show description for c488e03
  DriesSmit

  authored
  c488e03

• Merge branch 'develop' into feat/maddpg_obs_optim

  AsadJeewa

  authored
  723e713

Commits on Apr 4, 2022

• Merge branch 'develop' into feature/recurrent-mappo

  DriesSmit

  authored
  0adc026

Commits on Apr 12, 2022

• feat: Add capability to fix the sampler for MADDPG.

  DriesSmit

  committed
  4184fa7

• fix: Small fix to MAD4PG.

  DriesSmit

  committed
  24dfe32

• fix: multiple agents and multiple trainers using separate tables and separate networks

  EdanToledo

  committed
  ae33e1c

• fix: Small fixes to the net_spec_keys setup code for MADDPG.

  DriesSmit

  committed
  bdcdfab

• feat: add multiple trainer, multiple agent, multiple agent architecture support for madqn

  EdanToledo

  committed
  5774a57

• fix: allow net_spec keys to be passed into create_default_networks

  EdanToledo

  committed
  1a84f2f

• fix: Remove redundant statement.

  DriesSmit

  committed
  df45468

• fix: Remove redundant statement.

  DriesSmit

  committed
  49f8534

• feat: Small improvement.

  DriesSmit

  committed
  34c538c

• fix: linting

  EdanToledo

  committed
  18d420f

Commits on Apr 13, 2022

• fix: PPO training for networks with Categorical heads.

  DriesSmit

  committed
  7d411dc

• fix: Small fix to dataset shuffler.

  DriesSmit

  committed
  25f3ea1

• fix: Remove print statement.

  DriesSmit

  committed
  dbb5797

• Small fixes to trainer variable client and Hyperparameter settings.

  DriesSmit

  committed
  a257819

• feat: added multiple network fix

  sash-a

  committed
  8e25670

• feat: Small updates to hyperparameters. Moving system closer to develop's setup.

  DriesSmit

  committed
  a88de00

• merge: Merge changes.

  DriesSmit

  committed
  072771b

• fix: add if statement to check if default net spec keys is given and refactor

  EdanToledo

  committed
  10185f6

• fix: linting issue

  EdanToledo

  committed
  80cf51d

Commits on Apr 14, 2022

• fix: Small training fixes.

  DriesSmit

  committed
  2851235

• fix: Big bugfix in MAPPO trainer code setup.

  DriesSmit

  committed
  1674154

Commits on Apr 19, 2022

• Remove variable update inside mappo trainer _step code.

  DriesSmit

  committed
  b8d2738

• feat: Added jax docker containers.

  KaleabTessera

  committed
  86858c2

• feat: Added jax containers to autopush.

  KaleabTessera

  committed
  8da8562

• fix: Correct base docker image.

  KaleabTessera

  committed
  2f9d568

• fix: Updated base image to work with jax.

  KaleabTessera

  committed
  2bfa19f

• chore: Updated readme with new jax containers.

  KaleabTessera

  committed
  f307597

• chore: Updated python virtual env readme.

  KaleabTessera

  committed
  3155748

• fix: removed jax from reverb requirements.

  KaleabTessera

  committed
  7b77152

• feat: Updated pettingzoo.

  KaleabTessera

  committed
  ecb90a6

Commits on Apr 20, 2022

• Merge pull request #480 from instadeepai/bugfix/update-pz-docker-for-jax

  Show description for fe5389d
  KaleabTessera

  authored
  fe5389d

• Merge branch 'develop' into feature/recurrent-mappo

  DriesSmit

  authored
  7aac022

• chore: remove debug code, add comment to ddpg

  AsadJeewa

  committed
  a7343c2

• Merge branch 'develop' into feat/maddpg_obs_optim

  AsadJeewa

  authored
  16c0fe1

• chore: remove debug variable

  AsadJeewa

  committed
  67a2d43

Commits on Apr 21, 2022

• fix: Address PR comments.

  DriesSmit

  committed
  60eb054

• Merge pull request #326 from instadeepai/feature/recurrent-mappo

  Show description for 5877138
  DriesSmit

  authored
  5877138

• Merge branch 'develop' into feat/maddpg_obs_optim

  DriesSmit

  authored
  34c85b3

• chore: remove redundant code

  AsadJeewa

  committed
  80dd1df

• fix: Merge branch 'feat/maddpg_obs_optim' of https://github.com/instadeepai/Mava into feat/maddpg_obs_optim

  AsadJeewa

  committed
  7c04224

• chore: remove redundant code

  AsadJeewa

  committed
  897a08b

Commits on Apr 22, 2022

• Merge pull request #459 from instadeepai/feat/maddpg_obs_optim

  Show description for dc7b93c
  AsadJeewa

  authored
  dc7b93c

• Merge branch 'develop' into feature/fix_sampler_maddpg

  DriesSmit

  authored
  67d1a52

• Merge branch 'develop' into feature/fix_sampler_madqn

  DriesSmit

  authored
  c4c2509

• fix: Update 'list_of_networks' variable name to be 'networks_used_by_trainer'.

  DriesSmit

  committed
  1f7994a

• fix: Small update to variable naming.

  DriesSmit

  committed
  019da42

• Merge pull request #475 from instadeepai/feature/fix_sampler_maddpg

  Show description for 1aba8ed
  DriesSmit

  authored
  1aba8ed

• fix: Small update variable naming.

  DriesSmit

  committed
  5832921

• fix: Small fix to PPO variable naming.

  DriesSmit

  committed
  f494b83

• Merge pull request #477 from instadeepai/feature/fix_sampler_madqn

  Show description for 1eef1eb
  DriesSmit

  authored
  1eef1eb

• chore: Up the patch version of mava.

  KaleabTessera

  committed
  fa57447

• Merge pull request #485 from instadeepai/feature/release-0.1.3

  Show description for 4b07ae5
  KaleabTessera

  authored
  4b07ae5

Commits on Jun 6, 2022

• fix: Fixed keys in state based arch.

  KaleabTessera

  committed
  06773ee

• fix: Fixed keys in centralised arch.

  KaleabTessera

  committed
  486d963

• feat: Update dependencies and remove lp dependency (it is already part of acme).

  KaleabTessera

  committed
  9c00fa1

• chore: Removed independent lp install.

  KaleabTessera

  committed
  1e40dd7

Commits on Jun 7, 2022

• chore :Improve consistency env_states -> s_t.

  KaleabTessera

  committed
  f1c346e

• fix: Make all tf tests use shared weights.

  KaleabTessera

  committed
  4b163c0

• fix: Fix networked arch.

  KaleabTessera

  committed
  776b612

• chore(tests): speed up tests by using smaller networks.

  KaleabTessera

  committed
  4db7532

• chore: Better test skip reason.

  KaleabTessera

  committed
  2cd12ba

• fix: Update python version for melting pot images.

  KaleabTessera

  committed
  01b7140

Commits on Jun 8, 2022

• fix: pin meltingpot to before py3.9 requirement.

  KaleabTessera

  committed
  05b69e4

Commits on Jun 9, 2022

• chore: More explicit on shared weights in tests.

  KaleabTessera

  committed
  a6d01fa

• fix: networked arch only support shared weights.

  KaleabTessera

  committed
  deb6d6f

Commits on Jun 15, 2022

• Merge pull request #552 from instadeepai/bugfix/fix-old-tf-architectures

  Show description for d2a4004
  KaleabTessera

  authored
  d2a4004