-
Notifications
You must be signed in to change notification settings - Fork 40k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Kube-proxy requests 2x cpu shares of addons. #22022
Conversation
@kubernetes/goog-cluster |
Labelling this PR as size/XS |
@@ -31,6 +31,9 @@ spec: | |||
containers: | |||
- name: kube-proxy | |||
image: {{pillar['kube_docker_registry']}}/kube-proxy:{{pillar['kube-proxy_docker_tag']}} | |||
resources: | |||
requests: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should set limits
ideally.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't want to curtail kube-proxy, I want it to get what it needs (plus I'm not 100% sure how much it will need).
But I guess it doesn't make sense giving unlimited cpu to the proxy if nothing can run on the node, and if it bumps into the limit it's because something else with higher priority came along, and it'll just be slow, unlike memory.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
requests
are OK for now I guess.
Depending on where we go with the QoS policies, this might make kube-proxy
have less priority. But given that it is a DaemonSet, I guess the policies
will be thwarted anyways.
On Thu, Feb 25, 2016 at 3:25 PM, Prashanth B notifications@github.com
wrote:
In cluster/saltbase/salt/kube-proxy/kube-proxy.manifest
#22022 (comment)
:@@ -31,6 +31,9 @@ spec:
containers:
- name: kube-proxy
image: {{pillar['kube_docker_registry']}}/kube-proxy:{{pillar['kube-proxy_docker_tag']}}
- resources:
requests:
I don't want to curtail kube-proxy, I want it to get what it needs (plus
I'm not 100% sure how much it will need).But I guess it doesn't make sense giving unlimited cpu to the proxy if
nothing can run on the node, and if it bumps into the limit it's because
something else with higher priority came along, and it'll just be slow,
unlike memory.—
Reply to this email directly or view it on GitHub
https://github.com/kubernetes/kubernetes/pull/22022/files#r54182925.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah none of the master components set limits, for the same reason. If kube-proxy on a node is really slow it could impact a cluster spanning service, so I think we should leave it as request for now and revisit if required.
98acea3
to
1834834
Compare
1834834
to
7d47d2d
Compare
GCE e2e build/test passed for commit e34bbafd8962dcda8d7f12845e11607eccea4570. |
GCE e2e build/test failed for commit 7d47d2d. Please reference the list of currently known flakes when examining this failure. If you request a re-test, you must reference the issue describing the flake. |
GCE e2e build/test passed for commit 98acea32d0fd69242024073edb8f1ff269d3daff. |
GCE e2e build/test failed for commit 1834834269333cdd07bd2b0d80366e6ba116a473. Please reference the list of currently known flakes when examining this failure. If you request a re-test, you must reference the issue describing the flake. |
GCE e2e build/test passed for commit 7d47d2d. |
@k8s-oncall this should help with services test flake, if the merge bot doesn't get to it overnight |
Merging manually - this doesn't seem risky. |
Kube-proxy requests 2x cpu shares of addons.
Actually - it appeared that it broke kubemark, because we haven't had enough place to run hollow-nodes in the cluster. But this is already fixed. @gmarek |
I am shocked that kube-proxy needs more CPU. It barely does anything. Do
|
I am sure if @bprashanth actually profiled kube-proxy before making this PR ? |
I am sure this was not a wild guess, I am just surprised to believe it needs that much CPU |
in other words - we need to figure out why. RAM I can buy. CPU, no way |
Prashant can elaborate on how he reached the more-cpu-needed conclusion Sent from my iPhone
|
It doesn't need 200m, we need to figure out how much. It surely was starved, it was getting as many shares as pause, see: #21820 (comment). 200m is just a number > than the addons. |
Sure, we can fine-tune it later On Mon, Feb 29, 2016 at 10:00 AM, Prashanth B notifications@github.com
|
see #21820 (comment)
@kubernetes/goog-node 200m should be fine right?