Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A51 update: Allow cpu_utilization larger than 1.0 #358

Merged
merged 3 commits into from
Apr 28, 2023

Conversation

yousukseung
Copy link
Contributor

No description provided.

@yousukseung yousukseung marked this pull request as ready for review April 26, 2023 19:30
@yousukseung yousukseung requested a review from ejona86 April 26, 2023 19:30
@yousukseung
Copy link
Contributor Author

@markdroth @dfawley FYI

@markdroth markdroth changed the title A58 update: Allow cpu_utilization larger than 1.0 A51 update: Allow cpu_utilization larger than 1.0 Apr 26, 2023
Copy link
Member

@ejona86 ejona86 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We'll delay merging a bit to let cncf/xds#60 go in.

For posterity: we noticed that if the CPU saturates at 100% when the provided CPU is over 100% (because it was a soft limit, and additional CPU happens to be available) the WRR weights become essentially "qps". Then you get a runaway effect where the backend with highest qps gets more and more qps sent to it. If the system allows the CPU to exceed 100%, it is better to just communicate that to keep the qps:cpu ratio consistent.

@ejona86 ejona86 merged commit 9f090ae into grpc:master Apr 28, 2023
@yousukseung yousukseung deleted the util-over-1 branch May 10, 2023 06:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants