Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reduce debug output when using Kafka plugin #833

Open
sgaragan opened this issue Oct 22, 2024 · 0 comments
Open

Reduce debug output when using Kafka plugin #833

sgaragan opened this issue Oct 22, 2024 · 0 comments

Comments

@sgaragan
Copy link

When we enable the debug flag, the output from the Kafka plugin overwhelms the log output to the point where we cannot capture the start of the log output when running in OpenShift because the log blows through the log buffer. As well, the output is so filled with printing out the kafka properties (upwards of 25k lines/second) that it is almost impossible to find anything.

Is there a way to tune the debug output or at a minimum remove the Kafka property output.

The output looks like the following:

2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): [/etc/pmacct/librdkafka.conf] Reading librdkafka topic configuration.
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: request.required.acks = -1
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: request.timeout.ms = 30000
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: message.timeout.ms = 300000
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: queuing.strategy = fifo
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: produce.offset.report = false
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: partitioner = consistent_random
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: compression.codec = inherit
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: compression.level = -1
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: auto.commit.enable = true
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: auto.commit.interval.ms = 60000
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: auto.offset.reset = largest
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: offset.store.path = .
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: offset.store.sync.interval.ms = -1
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: offset.store.method = broker
2024-10-22T13:53:38Z DEBUG ( covematterhorn01c/core ): librdkafka 'matterhorn.ietf.control-bmp-avro-raw' topic config: consume.callback.max.messages = 0

Thanks,
Sean
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@sgaragan