Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report kafka lag as time unit #195

Open
wants to merge 40 commits into
base: master
Choose a base branch
from

Conversation

davidmparrott
Copy link

@davidmparrott davidmparrott commented Dec 14, 2020

Exporter will now, additionally, report a metric for kafka consumer lag as a unit of time.

Created additional function in collect to perform lag estimation
Information about current produced offsets is added during consumer group metric collection
Interpolation table is now separate file containing relevant struct and methods
Prune added, which can be called at any time to iterate of the interpolation table and remove stale and overly large data
Added ticker to perform pruning at a configurable interval
Prometheus mixin (dashboard only)

@davidmparrott
Copy link
Author

Example from dashboard defined by kafka-mixin/dashboards/kafka-overview.json

Kafka_Exporter_Overview_-_Grafana

@paulojmdias
Copy link

Can we have this available?

@gaantunes
Copy link

@danielqsj if I work on making this mergeable, is there any chance we can merge it?

@danielqsj
Copy link
Owner

@danielqsj if I work on making this mergeable, is there any chance we can merge it?

@gaantunes Yeah, I'm open for this feature.

@gaantunes
Copy link

Cool, thanks. Will look into this in the following days and get back to you. Will need to open a PR from another repo since I don't have access to this one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants