Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fully use python on GitHub Actions #21671

Merged
merged 23 commits into from
Jan 9, 2025
Merged

Fully use python on GitHub Actions #21671

merged 23 commits into from
Jan 9, 2025

Conversation

seanlip
Copy link
Member

@seanlip seanlip commented Jan 8, 2025

Overview

  1. This PR fixes or fixes part of #N/A
  2. This PR does the following: Uses the Python installation for all workflows on GitHub Actions. Combines the Python setup step with the dependency installation step since both steps, combined, take only about 1 minute (so it's worth just doing that step in all cases). Also attempting to fix a Redis download error reported in [BUG]: Python installation throws `No module named 'cgi'` error #21649 (reply in thread).

Note: This PR Is being made because the "Initializing Containers" step on Docker is failing often on CI with errors that are hard to debug. These include:

  • failed to solve: process "/bin/sh -c apt-get update -y && apt-get upgrade -y curl git npm openjdk-11-jre python3-matplotlib unzip wget jq" did not complete successfully: exit code: 100 (example)
  • failed to solve: process "/bin/sh -c yarn install --pure-lockfile" did not complete successfully: exit code: 1 (example)
  • 0.975 npm ERR! invalid json response body at https://registry.npmjs.org/typescript reason: Invalid response body while trying to fetch https://registry.npmjs.org/typescript: aborted (example)
  • 1.256 error Received malformed response from registry for "react-is". The registry may be down. (example)

A possibility that I considered was to add a retry step to that action. However, I realized that this "initializing containers" step takes 8-10 minutes to run. In contrast, the Python setup + dependency installation step takes 1 minute.

There is therefore no performance or reliability advantage in using the Docker actions. So this PR removes them completely from the workflows and standardizes all the workflows to use a standard Python installation instead.

Essential Checklist

Please follow the instructions for making a code change.

  • I have linked the issue that this PR fixes in the "Development" section of the sidebar. (N/A)
  • I have checked the "Files Changed" tab and confirmed that the changes are what I want to make.
  • I have written tests for my code. (N/A)
  • The PR title starts with "Fix #bugnum: " or "Fix part of #bugnum: ...", followed by a short, clear summary of the changes. (N/A)
  • I have assigned the correct reviewers to this PR (or will leave a comment with the phrase "@{{reviewer_username}} PTAL" if I can't assign them directly).

Proof that changes are correct

This will be determined by the CI check runs.

@seanlip seanlip requested a review from a team as a code owner January 8, 2025 16:41
@seanlip seanlip requested a review from kevintab95 January 8, 2025 16:41
Copy link

oppiabot bot commented Jan 8, 2025

Assigning @kevintab95 for the first pass review of this PR. Thanks!

Copy link

oppiabot bot commented Jan 8, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link

github-actions bot commented Jan 8, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 8, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

1 similar comment
Copy link

oppiabot bot commented Jan 8, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link

github-actions bot commented Jan 8, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 8, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link

github-actions bot commented Jan 8, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 8, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link

oppiabot bot commented Jan 8, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link

github-actions bot commented Jan 8, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 9, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link
Member

@kevintab95 kevintab95 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for codeowner files, thanks Sean!

Copy link

oppiabot bot commented Jan 9, 2025

Unassigning @kevintab95 since they have already approved the PR.

@oppiabot oppiabot bot added the PR: LGTM label Jan 9, 2025
Copy link

oppiabot bot commented Jan 9, 2025

Hi @seanlip, this PR is ready to be merged. Please address any remaining comments prior to merging, and feel free to merge this PR once the CI checks pass and you're happy with it. Thanks!

Copy link

oppiabot bot commented Jan 9, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

@seanlip seanlip requested a review from a team as a code owner January 9, 2025 08:20
@seanlip seanlip requested a review from imchristie January 9, 2025 08:20
Copy link

github-actions bot commented Jan 9, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 9, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link

github-actions bot commented Jan 9, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 9, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

Copy link

github-actions bot commented Jan 9, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 9, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

@seanlip seanlip enabled auto-merge January 9, 2025 15:47
Copy link

github-actions bot commented Jan 9, 2025

🛠️ Hi @seanlip, it looks like the CI checks are failing on your PR. Please look at the logs and follow these instructions to fix them, or report the error as a flake. Thanks!

Copy link

oppiabot bot commented Jan 9, 2025

Hi @seanlip, there are some failing CI checks in your latest push If you think this is due to a flake, please file an issue before restarting the tests. Thanks!

@seanlip
Copy link
Member Author

seanlip commented Jan 9, 2025

I need to merge this in order to unblock failing CI checks due to Redis issues. The main issue with this PR is that it increases the threshold needed for screenshot testing -- will discuss this with @imchristie in #21677.

@seanlip seanlip disabled auto-merge January 9, 2025 17:13
@seanlip seanlip merged commit 329b8d8 into develop Jan 9, 2025
130 checks passed
@seanlip seanlip deleted the use-python-on-actions branch January 9, 2025 17:14
kevintab95 pushed a commit that referenced this pull request Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants