Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable kubernetes_metadata by default for ELK stack #33584

Conversation

kayrus
Copy link
Contributor

@kayrus kayrus commented Sep 27, 2016

Looks like it was accidentally removed and was not restored back in this PR #29883
Because actually this plugin still exists in the image, but new ELK deployment don't allow you to index namespaces, pod names, etc.


This change is Reviewable

@k8s-ci-robot
Copy link
Contributor

Can a kubernetes member verify that this patch is reasonable to test? If so, please reply with "@k8s-bot ok to test" on its own line.

Regular contributors should join the org to skip this step.

While we transition away from the Jenkins GitHub PR Builder plugin, "ok to test" commenters will need to be on the admin list defined in this file.

@piosz
Copy link
Member

piosz commented Sep 28, 2016

ok to test

@piosz
Copy link
Member

piosz commented Sep 28, 2016

I don't think it was remove by accident. Take a look to #26652 (comment)

@aledbf could you please provide more context?
@crassirostris do you understand the change?

@aledbf
Copy link
Member

aledbf commented Sep 28, 2016

could you please provide more context?

The kubernetes_metadata plugin was commented because the pod starts without the service account and token mounted which avoid the normal initialization of the fluentd process.

#26652 (comment)

@crassirostris
Copy link

Yes, sure, the fact that this plugin is needed is out of question.

But just turning it on doesn't seem like a good idea, since it was turned off not without a reason.

Maybe we should provide this filter plugin with explicit path to cert?

@crassirostris
Copy link

My point is, let's solve this problem

@aledbf Do you have any idea right now as for how to fix the problem, mentioned in #26652 ?

@aledbf
Copy link
Member

aledbf commented Sep 28, 2016

Maybe we should provide this filter plugin with explicit path to cert?

that fixes the issue

Using Daemonset also solves the issue #32088

Do you have any idea right now as for how to fix the problem, mentioned in #26652 ?

No but If you start the fluentd pod manually (adding a new manifest file) after the node is running the service account is mounted in the pod so I think this issue is just a timing problem.

@crassirostris
Copy link

Well, if this pr passes gce suite for elasticsearch logging, sounds reasonable

@kayrus
Copy link
Contributor Author

kayrus commented Sep 28, 2016

@aledbf yep, actually I created my own daemonset for fluentd, and it works fine. didn't know the issue related to pure pod.

@piosz
Copy link
Member

piosz commented Sep 29, 2016

In tests the old image is used. Let's wait for #32088 to be merged. I'll prioritize it on my list.

@k8s-github-robot k8s-github-robot added needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. do-not-merge DEPRECATED. Indicates that a PR should not merge. Label can only be manually applied/removed. labels Nov 10, 2016
@apelisse apelisse removed the do-not-merge DEPRECATED. Indicates that a PR should not merge. Label can only be manually applied/removed. label Nov 11, 2016
@vendrov
Copy link
Contributor

vendrov commented Dec 6, 2016

@piosz Do you mind If we will add a comment in the td-agent.conf to "enable" the metadata-plugin in a case of daemon-set usage?.

@crassirostris
Copy link

@keglevich3 Yes, absolutely, go ahead, we will be grateful!

@piosz
Copy link
Member

piosz commented Dec 9, 2016

Sorry for the delay. I'm pretty close to merge #32088 (hopefully will be done within next few days) and then we can disable move forward with this one.

@piosz piosz assigned crassirostris and unassigned piosz Jan 11, 2017
@piosz piosz requested a review from crassirostris January 11, 2017 09:00
@kayrus kayrus force-pushed the kayrus/enable_elk_k8s_metadata branch from 08f2256 to a3ac4a2 Compare January 11, 2017 09:07
@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Jan 11, 2017
@k8s-github-robot k8s-github-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jan 11, 2017
@kayrus
Copy link
Contributor Author

kayrus commented Jan 11, 2017

@piosz done.
JFYI: I already implemented full EFK stack in my private repo: https://github.com/kayrus/elk-kubernetes

@crassirostris
Copy link

@kayrus LGTM, thanks for your efforts!

Just a small thing: could you please bump an image version? I will push it and then you can create another PR using the new image.

Copy link

@crassirostris crassirostris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please bump fluentd image version

@kayrus
Copy link
Contributor Author

kayrus commented Jan 11, 2017

@crassirostris done

@kayrus kayrus force-pushed the kayrus/enable_elk_k8s_metadata branch from a3ac4a2 to 8435d19 Compare January 11, 2017 13:08
Copy link

@crassirostris crassirostris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@k8s-ci-robot
Copy link
Contributor

Jenkins unit/integration failed for commit 8435d19. Full PR test history.

The magic incantation to run this job again is @k8s-bot unit test this. Please help us cut down flakes by linking to an open flake issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@k8s-ci-robot
Copy link
Contributor

Jenkins GKE smoke e2e failed for commit 8435d19. Full PR test history.

The magic incantation to run this job again is @k8s-bot cvm gke e2e test this. Please help us cut down flakes by linking to an open flake issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@k8s-ci-robot
Copy link
Contributor

Jenkins GCI GKE smoke e2e failed for commit 8435d19. Full PR test history.

The magic incantation to run this job again is @k8s-bot gci gke e2e test this. Please help us cut down flakes by linking to an open flake issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@crassirostris
Copy link

@k8s-bot unit test this

@piosz piosz added lgtm "Looks good to me", indicates that a PR is ready to be merged. release-note-none Denotes a PR that doesn't merit a release note. retest-not-required and removed release-note-label-needed labels Jan 11, 2017
@k8s-github-robot
Copy link

Automatic merge from submit-queue

@k8s-github-robot k8s-github-robot merged commit 12e8271 into kubernetes:master Jan 11, 2017
@saad-ali saad-ali added this to the v1.5 milestone Jan 19, 2017
@saad-ali saad-ali added cherry-pick-approved Indicates a cherry-pick PR into a release branch has been approved by the release branch manager. cherrypick-candidate labels Jan 19, 2017
@k8s-cherrypick-bot
Copy link

Commit found in the "release-1.5" branch appears to be this PR. Removing the "cherrypick-candidate" label. If this is an error find help to get your PR picked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/logging cherry-pick-approved Indicates a cherry-pick PR into a release branch has been approved by the release branch manager. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. release-note-none Denotes a PR that doesn't merit a release note. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.