Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better documentation/defaults for high throughput scenarios #117

Open
robbavey opened this issue Jan 15, 2021 · 1 comment
Open

Better documentation/defaults for high throughput scenarios #117

robbavey opened this issue Jan 15, 2021 · 1 comment

Comments

@robbavey
Copy link
Contributor

When using this plugin in certain scenarios, such as HTTP based logstash->logstash communication, or when sending to endpoints with large amounts of latency, using defaults can have a significantly detrimental impact on performance.

We should improve the documentation to include recommendations (http_compression=>true, format=>json_batch, increased batch sizes) to enable improved performance for these scenarios.

Other potential improvements include setting format=>json_batch as default in a future major version, or logging a warning that single http events are being sent via this output when users specify a large batch size in their logstash configuration.

@Catwoolfii
Copy link

@robbavey, hi!
How is the size of json_batch determined?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants