Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Increase in MacOS CI resource costs #12003

Open
kgpai opened this issue Jan 2, 2025 · 4 comments
Open

Increase in MacOS CI resource costs #12003

kgpai opened this issue Jan 2, 2025 · 4 comments
Labels
build triage Newly created issue that needs attention.

Comments

@kgpai
Copy link
Contributor

kgpai commented Jan 2, 2025

Problem description

We are seeing an increase in MacOS CI cost ,which accounts for the largest portion of our CI spend, causing us to go over our CI budget. Our CI build times for MacOS have also been increasing and this is proportional to the costs.
Screenshot 2025-01-02 at 10 17 38 AM

The MacOS build has been failing for a couple of weeks due to which the MacOS caches have not been cached causing an increase in build times. Ideally fixing this should bring down build times in proportion or we need to investigate if MacOS caches are not being hit.

System information

N/A

CMake log

N/A
@kgpai kgpai added build triage Newly created issue that needs attention. labels Jan 2, 2025
@kgpai
Copy link
Contributor Author

kgpai commented Jan 2, 2025

cc: @assignUser @majetideepak

@majetideepak
Copy link
Collaborator

majetideepak commented Jan 2, 2025 •
edited
Loading

@kgpai ccache is currently disabled. As a result both MacOS and Linux jobs are long/expensive.
I have a PR here #11893 to enable ccache.

@majetideepak
Copy link
Collaborator

Macos was previously failing with Arrow download. Now it is failing with thrift download. I have a fix here: #11990

@majetideepak
Copy link
Collaborator

I can see that the ccache is now working for pull requests but not for commits that land on main.
Once @assignUser is back, we can fix this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
build triage Newly created issue that needs attention.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kgpai @majetideepak