You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The fact is: http calls are way more slower than filter processing.
Http calls don't require CPU load. It is waiting time for the worker.
And so, http calls dramatically slow down pipeline workers throughput.
Pipeline workers count should be tied to CPU load, to match filter processing needs (BTW, workers count default value is CPU count).
So it would be great that http calls are really asynchronous, with detached threads.
Detached threads count should be equal to pool_max setting.
Thanks to this, pipeline workers wouldn't be impacted by http calls.
The text was updated successfully, but these errors were encountered:
Currently, the http call is tied to current worker thread.
Especially, because of this line:
logstash-output-http/lib/logstash/outputs/http.rb
Line 239 in 2cca9dc
The fact is: http calls are way more slower than filter processing.
Http calls don't require CPU load. It is waiting time for the worker.
And so, http calls dramatically slow down pipeline workers throughput.
Pipeline workers count should be tied to CPU load, to match filter processing needs (BTW, workers count default value is CPU count).
So it would be great that http calls are really asynchronous, with detached threads.
Detached threads count should be equal to
pool_max
setting.Thanks to this, pipeline workers wouldn't be impacted by http calls.
The text was updated successfully, but these errors were encountered: