Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set pip-compile to backtracking and trim unused requirments #1174

Merged
merged 2 commits into from
Dec 8, 2022

Conversation

sambles
Copy link
Contributor

@sambles sambles commented Dec 8, 2022

Fix CI bug with pip compile

  • There are several excess packages in requirements.in which are not needed for CI testing, these have been removed.
  • Set pip-compile to use backtracking when running with python3.7.
  • Tweaked the default in the manual trigger for unittest.yml, it now won't build ktools unless a branch is given as input.

@sambles sambles requested a review from mtazzari December 8, 2022 12:00
@@ -19,7 +19,6 @@ on:
ktools_branch:
description: "Build Ktools before tests: [git ref]"
required: false
default: "develop"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this deletion on purpose?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yup, i missed that from the PR notes, i'll add it in.

I noticed when running a manual trigger, ktools is always built because that value is auto-filled with develop when it should probably be blank as default.

@sambles sambles merged commit b4030cb into master Dec 8, 2022
@sambles sambles deleted the fix/ci-requirements branch December 8, 2022 16:05
sambles added a commit that referenced this pull request Dec 8, 2022
* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7
sambles added a commit that referenced this pull request Dec 8, 2022
* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7
sambles added a commit that referenced this pull request Dec 8, 2022
* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7
sambles added a commit that referenced this pull request Dec 9, 2022
* test ods-tools git install

* Try ods_tools package install

* Set pip-compile to backtracking and trim unused requirments (#1174)

* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7

* update ods build workflow loc

* Add line to uninstall ods_tools

* use "skikit-learn" instead of "sklearn" (same package)

* Run pytest directly

* Update script to build ods_tools on push

* Remove if on build ods_tools
sambles added a commit that referenced this pull request Jan 12, 2023
* refactoring to use ods_tools

* remove unused import

* more pep8

* more pep8

* more pep8

* add default for RiskLevel

* Feature/ods tools migration test (#1176)

* test ods-tools git install

* Try ods_tools package install

* Set pip-compile to backtracking and trim unused requirments (#1174)

* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7

* update ods build workflow loc

* Add line to uninstall ods_tools

* use "skikit-learn" instead of "sklearn" (same package)

* Run pytest directly

* Update script to build ods_tools on push

* Remove if on build ods_tools

* fix tests

* Update unittest.yml

* test call to ods_tool build

* test passed, merged ods fixed and set ci workflow to master

* workaround python3.7 dtype conversion

* Feature/ods tools migration piwind fix (#1182)

* test run piwind

* try piwind

* update workflow branch

* Always build oasislmf package before test

* Fix ref

* force retest

* remove pr branch limit

* f

* Fix def

* disable push - tmp

* fix

* Switch workflow branches

* Prep for merge

* add back push trig

* Run autopep8

Test fix for Platform

Update numpy max ver

Revert "Update numpy max ver"

This reverts commit 14c6c6b.

Fix ods branch selection

Force retest

Fix exposure load

revert test fix

* test platform fix

* Add fix to keep group_id assigment the same as prev version

pep8

* Fix broken fm tests

* Switch piwind workflow to use ods develop

* Set min ods_tools requirment

* Revert "ods_tools requirment" --- SET BEFORE RELEASE

This reverts commit 06e99c8.

* pep8 alignment in a few lines

* Set min ods-tools package to 3.0.0

* Disable ods-tools branch builds in testing

* Skip ods build unless input set

* ODS tools piwind workflow

* remove old import

* Fix old imports

Co-authored-by: sambles <sambles@users.noreply.github.com>
Co-authored-by: Sam Gamble <hexadessa@gmail.com>
Co-authored-by: mtazzari <mtazzari@gmail.com>
sambles added a commit that referenced this pull request Jan 12, 2023
* refactoring to use ods_tools

* remove unused import

* more pep8

* more pep8

* more pep8

* add default for RiskLevel

* Feature/ods tools migration test (#1176)

* test ods-tools git install

* Try ods_tools package install

* Set pip-compile to backtracking and trim unused requirments (#1174)

* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7

* update ods build workflow loc

* Add line to uninstall ods_tools

* use "skikit-learn" instead of "sklearn" (same package)

* Run pytest directly

* Update script to build ods_tools on push

* Remove if on build ods_tools

* fix tests

* Update unittest.yml

* test call to ods_tool build

* test passed, merged ods fixed and set ci workflow to master

* workaround python3.7 dtype conversion

* Feature/ods tools migration piwind fix (#1182)

* test run piwind

* try piwind

* update workflow branch

* Always build oasislmf package before test

* Fix ref

* force retest

* remove pr branch limit

* f

* Fix def

* disable push - tmp

* fix

* Switch workflow branches

* Prep for merge

* add back push trig

* Run autopep8

Test fix for Platform

Update numpy max ver

Revert "Update numpy max ver"

This reverts commit 14c6c6b.

Fix ods branch selection

Force retest

Fix exposure load

revert test fix

* test platform fix

* Add fix to keep group_id assigment the same as prev version

pep8

* Fix broken fm tests

* Switch piwind workflow to use ods develop

* Set min ods_tools requirment

* Revert "ods_tools requirment" --- SET BEFORE RELEASE

This reverts commit 06e99c8.

* pep8 alignment in a few lines

* Set min ods-tools package to 3.0.0

* Disable ods-tools branch builds in testing

* Skip ods build unless input set

* ODS tools piwind workflow

* remove old import

* Fix old imports

Co-authored-by: sambles <sambles@users.noreply.github.com>
Co-authored-by: Sam Gamble <hexadessa@gmail.com>
Co-authored-by: mtazzari <mtazzari@gmail.com>
@awsbuild awsbuild added this to the 1.27.0 milestone Jan 12, 2023
sambles added a commit that referenced this pull request Jan 18, 2023
* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7
sambles added a commit that referenced this pull request Jan 18, 2023
* Set pip-compile to backtracking and trim unused requirments

* Only set backtracking for python3.7
@awsbuild awsbuild modified the milestones: 1.27.0, 1.23.15, 1.26.5 Jan 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants