Tags: CarperAI/OpenELM
Tags
0.9 Release (#66) * [Draft] Add test script to visualize walkers and pygame environment, fix galloper and wheel walker typos (#43) * Add pygame support to the simulator. * Simulator Visualzation * Fix gravity Co-authored-by: daia99 <daia99@users.noreply.github.com> Co-authored-by: Marco <marcobellagente93@users.noreply.github.com> * Fix typos in galloper and wheel walkers Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> Co-authored-by: Marco <marcobellagente93@users.noreply.github.com> * Implement demo test script for loading make_walker methods and visualizing Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> Co-authored-by: Marco <marcobellagente93@users.noreply.github.com> * moved pygame reqs to toml, clean up * revert length_calc formula to older one (fix calc) * copied box2d.examples into sodaracer directory, fixes import * removed unused dependancy files for box2d * Slightly modified physics, more close to javascript version, fixed seed typos Co-authored-by: Marco <marcobellagente93@users.noreply.github.com> * clear up naming in sandbox script Co-authored-by: Marco <marcobellagente93@users.noreply.github.com> --------- Co-authored-by: HannahBenita <77296142+HannahBenita@users.noreply.github.com> Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> Co-authored-by: Marco <marcobellagente93@users.noreply.github.com> Co-authored-by: Herbie Bradley <mail@herbiebradley.com> * hotfix for moving galloper demo (#47) * CVT MAP Elites (#48) * Fixed a type mismatch for history_length>1 * adding sklearn dependency for CVT * creating GridMap and CVTMap * updating string env and test * adding --runslow flag to tests * adding GridMap class and test * added fitness plot, more tests and bugfix in string env * updated string matching tests * ascii art for image opt * minor change to image gen test * visualization and prompt tweaking for image gen * finished cvt implementation * minor cleanup * updated configs for cvt, added 3d visualization * fixing up configs * removing sklearn from pyproject.toml * Added documentation to the Sodarace BaseEnvironment (#49) * fixing a bug in finding the min of an empty map, adds min_finite and max_finite (#50) * Update logging code * Fix tests * hotfix fitness stats logging (#52) * hotfix qd_score plotting (#53) * hotfix qd_score method, fix last hotfix error (#54) * Update benchmarks and linting * Fix tests * Prompt evolution (#55) * langchain prompt evolution * small cleanup * Update mutation model * Update requirements.txt (#57) * Snapshot saving loading and determinism (#56) * Adding getter/setter for rng state Co-authored-by: daia99 <daia99@users.noreply.github.com> * Added warnings for rng getter/setter methods Co-authored-by: daia99 <daia99@users.noreply.github.com> * update config with saving options Co-authored-by: daia99 <daia99@users.noreply.github.com> * Added seed to EnvConfig Co-authored-by: daia99 <daia99@users.noreply.github.com> * snapshots saving/loading determinism support for mapelites Co-authored-by: daia99 <daia99@users.noreply.github.com> Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> * re-introducing accidentally deleted classes Co-authored-by: daia99 <daia99@users.noreply.github.com> Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> * added test for loading logic Co-authored-by: daia99 <daia99@users.noreply.github.com> Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> * revert spacing format in env method --------- Co-authored-by: daia99 <daia99@users.noreply.github.com> Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> Co-authored-by: Andrew Dai <adai@tcd.ie> * Minor fixes to map-elites * Add langchain and improved prompt env (#58) * Fix tests * Update mutation model * Minor fixes to map-elites * hotfix for blank log directory and moving new rng functions to prompt env (#59) * P3 updates (#51) * Add P3ProbSol and refactor * P3 genotype using model feature extraction * Mutate solutions and probsols; dimensionality reduction * Fitness with pass@k * OpenAI embeddings for cosine similarity * Undo capitalization changes * Undo capitalization changes * hotfix: generalized snapshot load dim, copying top array, save interval optional, (#61) * QDAIF update * mutation patch * Prompt evolution updates (#62) * antonym prompt task * new prompt experiment * documentation * new mutations for prompts * adding instruction induction/cot datasets * add openai to requirements.txt * add plotly to requirements.txt (req for openai but not installed automatically) * Refactor environments * Update readme and add pdf * Remove duplicate logging appends (#64) * Update for release - refactors and fixes (#65) * Refactor dir structure * Update for release * Update readme --------- Co-authored-by: Andrew <33094749+daia99@users.noreply.github.com> Co-authored-by: HannahBenita <77296142+HannahBenita@users.noreply.github.com> Co-authored-by: Hannah <HannahBenita@users.noreply.github.com> Co-authored-by: Marco <marcobellagente93@users.noreply.github.com> Co-authored-by: ryanz8 <32717024+ryanz8@users.noreply.github.com> Co-authored-by: snat-s <65375294+snat-s@users.noreply.github.com> Co-authored-by: marcobellagente93 <marco.bellagente@gmail.com> Co-authored-by: daia99 <daia99@users.noreply.github.com> Co-authored-by: Andrew Dai <adai@tcd.ie> Co-authored-by: Daniel Scott <danitellod@gmail.com>
v0.2.0 (#36) * Change flake8 config file name * Rtd config change * Update rtd * Test build and inspect * Rename file * Remove redundant code * Remove strategy matrix for action * Update black rev * Remove redundant set seed * Update pyproject.toml * Stop tests on first failure * Frozen dataclass slightly slower init * Rewrite simulator class, with docs * Rename framework simulator * Add optional trlx requirement * Fix duplicate files in wheel issue * Gitignore update * Update pre-commit config * Add flake8-pyproject * Add diff benhm * Fix line length * Update pre-commit config * Linting * Add n_trials to diff benchmark * Try codegen loading * Added completion target walkers (#38) * Create wheel.py * Create galloper.py * create runner.py * remove bool args from add muscle calls * Update runner.py * Fix linting for new seeds * Add crossover test * Fix diff benchmark issues * Update wheel.py * Feature: Added FT Triton support (#39) * Feature: Added Triton support * reformat: prehook commits * Refactor: Final changes and readme * Tests * Add benchmarks * Update CITATION.cff * Benchmarks update * Misc improvements to benchmarks * Add crossover benchmark * Bug fixing (#40) * Fix various things and refactoring * Fixing CI to limit the testing to `test_*.py` files. * Removing `cfg.checkpoints_dir` because we have been only using `cfg.model` in benchmark scripts for either huggingface repo or direct path. * fix bad import and a bug in image task. * fix bad import and a bug in image task. * Evaluate in separate threads. * Prevent warnings from tokenizer by disabling parallelism (we don't have a large dataset to tokenize). * Revert the shebang. Better not to have a shebang for potential env problems. * Add map to crossover benchmark * Fix imports, minor refactor to environments * fix init imports * Improve code execution & benchmarks, add tests * Move benchmarks * Streamline code execution * Refactor sandbox execution code * Add thread safe execution of code * Update execution code * Rename openai benchmark * Cleanup parity benchmark * Move tinygp benchmark to tests * Update crossover benchmark * Minor bugfix * Minor bug fix * Update gitignore * Overhaul crossover benchmark * Improve code generation utils * Remove codex_execute file * Refactor benchmarks and configs * Insertable maps in map-elites * Move benchmarks to separate folder * Minor tests refactor * Rework benchmark triton * Refactor seeds and delete configs * Update map elites and diff models * Update readme * Update readme --------- Co-authored-by: shira eisenberg <shiraeisenberg@uchicago.edu> Co-authored-by: Harsimranjeet Saini <43717480+harry-stark@users.noreply.github.com> Co-authored-by: Herbie Bradley <hyperion@ip-172-31-45-16.ec2.internal> Co-authored-by: Honglu Fan <64070721+honglu2875@users.noreply.github.com>
v0.1.7 Release (#35) * Minor config change * Refactor into src layout * Update conf.py version * Minor update to configs * Minor update to configs 2 * Update docs config * Docs config update * Add citation.cff * Docs update * Fix doc errors * Change contents depth * Update rtd config * Update rtd * Fix rtd * Edit sphinx config * Depth 2 for docs contents * Remove module contents * Edit environment docs * Add docs contents * Depth 3 in docs * toctree depth 4 * index depth 2 * Update docs * Add environments to index * exclude all rtd * Test docs change * Names for openelm docs modules * Clearer section headers for docs * Test recursive rtd * Automatic docs version * Improve map-elites docstrings and doc config * Remove setup.py and change config
0.1.5 release (#32) * initial soft prompt example for stage 3 trlx (#14) * initial softprompt example for stage 3 trlx * clean up * basic runnable changes after trlx pr merge * softprompt prefix padding handling, whole model freezing, cleanup * new toy tasks, restored config register, plot softprompt drift * fix import * minor fixes, +orchestrator to handle softprompt padding * update for new trlx version * fix(sandbox): build typo and updating lock file (#26) * Fix dependency for box2d; Moved graphviz stuff to optional. (#27) * update and cleanup for latest trlx, clarity * bugfix: override get_model_inputs with softprompt support * additional comments, sanity checks * update configs and example scripts * init readme for trlx softprompt tuning setup * formatting * fix filename typo Co-authored-by: Francisco Carvalho <7385326+TheExGenesis@users.noreply.github.com> Co-authored-by: Honglu Fan <64070721+honglu2875@users.noreply.github.com> * Diff processing and evaluations (#29) * fix(sandbox): build typo and updating lock file (#26) * Fix dependency for box2d; Moved graphviz stuff to optional. (#27) * Added a few diff util functions and tests; Added pytest to CI; Added box2d-py (for pytest to pass) and requests to requirements.txt. * fix pytest. * ugh, dependency... * fix typo... (ugh probably drank too much) * fix dependency. * added torch to requirements.txt * Expose `Genotype` and `BaseEnvironment` for others to inherit. * Use `checkpoints_dir` in the config instead of hardcoding "checkpoints". * Fix small bug in ImageOptim mutate. * Modified benchmark config; Added diff benchmark script; Completed verify_diff and added tests. * Fixed minor issues on device and invalid format. * Force `.use_cache` to be True. * Rename `elm.py` into `elm_main.py` to avoid conflicts in import. * Minor changes according to review; Added `DiffState` to represent the validity of diff data sample. * Fix CI. * Box2d CI bug again! Trying a hot-fix... * Another try on swig version. * Another try on swig version. * Seriously?? What about revert back. * Ok, trying again with different install order... Co-authored-by: Francisco Carvalho <7385326+TheExGenesis@users.noreply.github.com> * Fix requirements * Add sodarace tests * fix ADDFILE line count verification. * Add docs with Sphinx * Fix readthedocs syntax * Fix rtd build * Fix rtd build (for real this time) * Rename elm to openelm * Rename util * Linting * Revert "Linting" This reverts commit 8db8623. * Linting utils * Add docstrings to some files * Add Sphinx autodoc specification * Rename benchmark_diff * Improve Sphinx docstrings Co-authored-by: Andrew <33094749+daia99@users.noreply.github.com> Co-authored-by: Francisco Carvalho <7385326+TheExGenesis@users.noreply.github.com> Co-authored-by: Honglu Fan <64070721+honglu2875@users.noreply.github.com> Co-authored-by: Honglu Fan <honglu2875@gmail.com>
Sodarace prompt mutation (#22) * Merge with the main; Redo the changes: add in prompt mutation components for sodaracer. * Fix stuff; Small change in docstring to follow the mainstream. * Add `error_code`. Allow custom diff model class. * Fix error msg parsing. * Improved some variable names; Added in `Map.empty`; If map is still empty, force `MapElites` to call `.random()` instead of `.mutate()`. * Fix batch generation in `Sodarace`. * Fix batch generation in `Sodarace`. * Uniformize API for image task. * omg brain fart... * fixed other brain farts... * Fix typos. * Clean up: use original type instead of type alias; add `__add__` to `__init__`, put default seeds all under `elm.environment`; clean up api for `ELM` and different envs, ... * Error fixes. * reordered `image_init_args` so that people see it together with `sodarace_init_args`. * Minor correction of a comment. * Deleted my old file that does syntax tree parsing (if the need arises, we can easily add it back); Changed the return of `._post_process` according to Genesis's remark. * minor fixes Co-authored-by: Herbie Bradley <mail@herbiebradley.com>