Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resource not found from Kubernetes should be cached and cache should be persistent #3

Open
phutchins opened this issue Jun 4, 2017 · 0 comments

Comments

@phutchins
Copy link
Contributor

phutchins commented Jun 4, 2017

In the case that the plugin gets a log entry from a resource that no longer exists and does not exist in the cache, the Kubernetes API will return an error stating that the resource was not found. This slows down processing considerably.

This can happen if logstash is restarted before it has caught up and a node that it is processing logs for no longer exists. If the cache were persistent, this would usually be OK but we also should cache the fact that the resource was not found if it was not already in the cache so we don't slow down processing.

Also, if the node does not exist and we can't find info about it, we should make sure we still write the node name to the data as we do know that much.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant