Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data transformer: Blacklist nested data structures #250

Open
KristianLyng opened this issue Aug 29, 2022 · 0 comments
Open

Data transformer: Blacklist nested data structures #250

KristianLyng opened this issue Aug 29, 2022 · 0 comments
Labels
enhancement New feature or request good first issue Good for newcomers Transformer

Comments

@KristianLyng
Copy link
Collaborator

A common case we need to address is that a number of senders can't handle nested data structures. The proper way to handle it today is to use flatten/split transformers to handle it. However, sometimes, items are overlooked and still sent downstream.

I suggest we make a new function to the data/metadata transformers that run the same checkVariable() check found in senders/influx.go:62 (obviously extracted from module). This will allow us to discard data that will fail to transmit down stream anyway, without going through HTTP post and whatnot.

@KristianLyng KristianLyng added enhancement New feature or request good first issue Good for newcomers Transformer labels Aug 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers Transformer
Projects
None yet
Development

No branches or pull requests

1 participant