Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

accelerate integration #58

Merged
merged 48 commits into from
Dec 30, 2022
Merged
Changes from 1 commit
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
9c977d0
working v1
younesbelkada Dec 27, 2022
1971cea
add `accelerate` on requirements
younesbelkada Dec 27, 2022
45cad09
add `accelerate` on `setup.py`
younesbelkada Dec 27, 2022
a0ebdaa
add `datasets` on `setup.py`
younesbelkada Dec 27, 2022
dec21f3
small updates
younesbelkada Dec 27, 2022
4254292
rm unneeded file
younesbelkada Dec 27, 2022
19f4d92
replace with `generate`
younesbelkada Dec 27, 2022
35330a9
Update trl/trainer/accelerate_ppo.py
younesbelkada Dec 27, 2022
34773de
correct return
younesbelkada Dec 27, 2022
b810d8a
add dataloader support
younesbelkada Dec 27, 2022
e4c57b2
add `wandb` to `setup.py`
younesbelkada Dec 27, 2022
7516b37
refactor
younesbelkada Dec 27, 2022
40f81e0
test
younesbelkada Dec 27, 2022
b1638e5
fix test
younesbelkada Dec 27, 2022
e2e7a90
rename file
younesbelkada Dec 27, 2022
96b4115
refactor
younesbelkada Dec 27, 2022
5eb46ad
remove unneeded device assignment
younesbelkada Dec 27, 2022
609f718
fix correct device assignment
younesbelkada Dec 27, 2022
4d57b47
standardize docstrings
younesbelkada Dec 27, 2022
fac85b5
add `wandb` on `dev`
younesbelkada Dec 27, 2022
c1b166b
fix slow convergence
younesbelkada Dec 28, 2022
9495f2a
oops
younesbelkada Dec 28, 2022
c813857
revert fix
younesbelkada Dec 28, 2022
157eca6
revert patch
younesbelkada Dec 28, 2022
2efb961
Merge remote-tracking branch 'origin/master' into accelerate-ppo
younesbelkada Dec 28, 2022
0a1c9a2
remove unneeded reshape
younesbelkada Dec 28, 2022
b6004f0
add input safety checker
younesbelkada Dec 28, 2022
f47b907
refactor
younesbelkada Dec 28, 2022
2918a8e
Apply suggestions from code review
younesbelkada Dec 29, 2022
747d5f0
refactor
younesbelkada Dec 29, 2022
7615994
some refactor
younesbelkada Dec 29, 2022
65be5bd
remove unneeded hack
younesbelkada Dec 29, 2022
edd5ea3
adapt dataset
younesbelkada Dec 29, 2022
76c2afd
fix test
younesbelkada Dec 29, 2022
5d41170
remove rollout
younesbelkada Dec 29, 2022
7843a34
remove timing
younesbelkada Dec 29, 2022
6cd89d5
remove `shuffle=True`
younesbelkada Dec 29, 2022
4e802e8
remove `LengthSampler` from trainer
younesbelkada Dec 29, 2022
6012a9b
refactor
younesbelkada Dec 29, 2022
d2c363f
remove text length sampler args from config
younesbelkada Dec 29, 2022
d048bbe
change collate_fn
younesbelkada Dec 29, 2022
66f23b1
fix silent bug
younesbelkada Dec 29, 2022
e318307
rename
younesbelkada Dec 29, 2022
31d12d6
move file
younesbelkada Dec 29, 2022
48c1070
refactor base trainer
younesbelkada Dec 29, 2022
e9cec71
fix collate
younesbelkada Dec 29, 2022
9a987d4
Merge remote-tracking branch 'origin/master' into accelerate-ppo
younesbelkada Dec 29, 2022
244f001
final bug
younesbelkada Dec 29, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add wandb on dev
  • Loading branch information
younesbelkada committed Dec 27, 2022
commit fac85b59afc8a23acf27a1a091069b5aeda07af4
2 changes: 1 addition & 1 deletion setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
requirements = cfg.get('requirements','').split()
extras = {
"test" : ["pytest","pytest-xdist","accelerate", "datasets", "wandb"],
"dev" : ["pytest","pytest-xdist", "black", "isort", "flake8>=3.8.3", "accelerate", "datasets"],
"dev" : ["pytest","pytest-xdist", "black", "isort", "flake8>=3.8.3", "accelerate", "datasets", "wandb"],
}
lic = licenses[cfg['license']]
min_python = cfg['min_python']
Expand Down