You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Both processors chunk the incoming data array based on the size to pass it on to the next step. The routed_sender uses a promise map with a concurrency setting, while the elasticsearch_sender uses Promise.all to process the array chunks.
The routed_sender's default size is 500, and concurrency is 10.
I believe the elasticsearch_sender should use its respective size settings.
I'm not sure how the settings in the apis array are passed in. Looked around but didn't find it. But it looks like any fields shared between the api configs and the routed_sender would be overwritten by the routed_sender configs.
How would this affect other sender_apis, not just es? Seems like they should all use their own settings.
The text was updated successfully, but these errors were encountered:
ciorg
changed the title
routed_sender size setting conflict with doe
routed_sender size setting conflict with sender_api
Dec 1, 2020
ciorg
changed the title
routed_sender size setting conflict with sender_api
routed_sender size property overwrites sender_api size property
Dec 1, 2020
The size setting in the
elasticsearch_sender_api
is overwritten by therouted_sender
size.Here's the jobs settings that I was using:
Both processors chunk the incoming data array based on the
size
to pass it on to the next step. The routed_sender uses a promise map with a concurrency setting, while the elasticsearch_sender uses Promise.all to process the array chunks.The routed_sender's default size is 500, and concurrency is 10.
I believe the elasticsearch_sender should use its respective size settings.
Looks like it's happening on the api.create -
standard-assets/asset/src/routed_sender/processor.ts
Line 74 in d2f2e2d
if the config were removed from the create action like this:
I'm not sure how the settings in the apis array are passed in. Looked around but didn't find it. But it looks like any fields shared between the api configs and the routed_sender would be overwritten by the routed_sender configs.
How would this affect other sender_apis, not just es? Seems like they should all use their own settings.
The text was updated successfully, but these errors were encountered: