Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix additional dataloader creation #220

Merged
Merged
Changes from 1 commit
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
f066178
- added game phase detection file
HelpstoneX Jun 22, 2023
e7b9f00
- changed openspiel git
HelpstoneX Jun 22, 2023
ebfa472
- changed openspiel git
HelpstoneX Jun 24, 2023
ae18d66
fixed phase ids
HelpstoneX Jun 24, 2023
8eb237f
added dataset creation option for specific phases
HelpstoneX Jun 24, 2023
738cd8d
Merge branch 'dataset_creation' of https://github.com/HelpstoneX/Craz…
HelpstoneX Jun 29, 2023
3b56cee
param changes in train_cnn.ipynb
HelpstoneX Jul 3, 2023
826f3b6
- fixed plys_to_end list to only include values for moves that really…
HelpstoneX Jul 4, 2023
b92a8a8
Merge branch 'dataset_creation'
HelpstoneX Jul 5, 2023
cdbe3ab
- changes to train_cnn to make it compatible
HelpstoneX Aug 3, 2023
ce89f69
updated fork
HelpstoneX Aug 10, 2023
e55c318
mcts phase integration working, some improvements missing
HelpstoneX Sep 14, 2023
a2a9a2c
- added phase_to_nets map to make sure the right net is used for each…
HelpstoneX Sep 20, 2023
0be67ff
- added game phase vector to created datasets
HelpstoneX Sep 27, 2023
9e9b009
minor fixes for weighted training
HelpstoneX Sep 27, 2023
1700818
- fixes and improvements to prs.py from cutechess-cli
HelpstoneX Sep 28, 2023
cb575ce
- changes for continuing training from tar file (pytorch)
HelpstoneX Oct 2, 2023
964a982
- added python file for training (exported notebook)
HelpstoneX Oct 2, 2023
c3a2a25
- added python file for executing cutechess shell commands
HelpstoneX Oct 3, 2023
d05228d
- added the option to specify additional eval sets (unweighted) to pa…
HelpstoneX Oct 7, 2023
87456f2
- minor changes
HelpstoneX Oct 7, 2023
4229a04
- minor changes for debugging
HelpstoneX Oct 7, 2023
e9bed77
- bugfix in train_cnn.py for additional dataloaders
HelpstoneX Oct 7, 2023
c13d0be
- bugfix in to correctly determine train iterations
HelpstoneX Oct 9, 2023
4a11bd8
- minor changese in prs.py
HelpstoneX Oct 14, 2023
614a4c9
- minor changes for chess 960
HelpstoneX Oct 14, 2023
5049a1e
- reverted mode and version back to 2 and 3
HelpstoneX Oct 14, 2023
d0cc5f4
fixed bug when executing isready multiple times consecutively while s…
HelpstoneX Oct 26, 2023
b47f44b
alternative bugfix attempt for linux
HelpstoneX Oct 27, 2023
57e9d7b
- temporary fix for chess960 wrong training representation
HelpstoneX Nov 1, 2023
982c650
- changes to incorporate 960 dataset analysis
HelpstoneX Dec 9, 2023
d18251b
chess960 input representation fix (c++ engine files still unadjusted …
HelpstoneX Dec 9, 2023
26cb920
- added plot generating notebooks to git (/etc folder)
HelpstoneX Dec 15, 2023
5e0df73
- added support for naive movecount phases
HelpstoneX Dec 17, 2023
f065280
- minor path fix in dataset_loader.py
HelpstoneX Dec 17, 2023
1a7ab6c
undone temporary fix for broken chess960 input representation
HelpstoneX Dec 19, 2023
69e002c
- added support for phases by movecount in c++ code (currently always…
HelpstoneX Jan 12, 2024
85167cd
- minor plotting adjustments
HelpstoneX Jan 17, 2024
2059aac
- adjusted run_cutechess_experiments.py to be able to do experiments …
HelpstoneX Mar 20, 2024
bf57009
- added documentation
HelpstoneX Apr 11, 2024
09c6810
- minor assertion change in train_cnn.py
HelpstoneX Apr 11, 2024
9d5fa1f
- cleaned code and removed sections that are not needed anymore
HelpstoneX Apr 20, 2024
336f785
- changed underscore naming to camelCase naming in several cases
HelpstoneX Apr 20, 2024
fa3dfe6
- added UCI option Game_Phase_Definition with options "lichess" and "…
HelpstoneX Apr 20, 2024
9c4d507
- added searchSettings to RawNetAgent to access selected gamePhaseDef…
HelpstoneX Apr 22, 2024
687ef8a
- aligned train_cnn.ipynb with code inside train_cnn.py
HelpstoneX Apr 22, 2024
65a302b
- cleaned cell outputs of main notebooks
HelpstoneX May 1, 2024
2fae83a
- further notebook output cleanings
HelpstoneX May 1, 2024
2917f78
- removed files unnecessary for pull request and reverted several fil…
HelpstoneX May 1, 2024
df97fac
- reverted .gitignore and Dockerfile to older state
HelpstoneX May 1, 2024
2fd46bb
- .gitignore update to different previous state
HelpstoneX May 1, 2024
23d4b27
Merge branch 'HelpstoneX-pull_request_preparation'
QueensGambit May 2, 2024
40b15ff
Fix compile error
QueensGambit May 2, 2024
ab8a7a7
Merge remote-tracking branch 'upstream/master'
HelpstoneX Sep 23, 2024
f50550b
fixed creation of additional dataloaders in train_cnn.ipynb
HelpstoneX Sep 23, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
- minor path fix in dataset_loader.py
  • Loading branch information
HelpstoneX committed Dec 17, 2023
commit f06528008e3390ab522600ced2d6d018d9a423f7
4 changes: 3 additions & 1 deletion DeepCrazyhouse/src/preprocessing/dataset_loader.py
Original file line number Diff line number Diff line change
@@ -64,7 +64,9 @@ def load_pgn_dataset(
if phase is None:
zarr_filepaths = glob.glob(main_config[f"planes_{dataset_type}_dir"] + "**/*.zip")
else:
zarr_filepaths = glob.glob(main_config["default_dir"] + f"planes/phase{phase}/{dataset_type}/" + "**/*.zip")
zarr_filepaths = glob.glob(main_config["default_dir"] +
f"planes/{main_config['phase_definition']}/phase{phase}/{dataset_type}/" +
"**/*.zip")
else:
raise Exception(
'Invalid dataset type "%s" given. It must be either "train", "val", "test" or "mate_in_one"' % dataset_type