[Backport feature/multi_tenancy] Implementing retry for remote connector to mitigate throttling issue #3013

…2462) * use retryable action; execution context Signed-off-by: zhichao-aws <[email protected]> * change to groupedActionListener Signed-off-by: zhichao-aws <[email protected]> * fix group Signed-off-by: zhichao-aws <[email protected]> * retry policy Signed-off-by: zhichao-aws <[email protected]> * base time Signed-off-by: zhichao-aws <[email protected]> * retry option, cluster settings Signed-off-by: zhichao-aws <[email protected]> * nit Signed-off-by: zhichao-aws <[email protected]> * lint Signed-off-by: zhichao-aws <[email protected]> * change interface to class Signed-off-by: zhichao-aws <[email protected]> * fix ut due to code change Signed-off-by: zhichao-aws <[email protected]> * license header Signed-off-by: zhichao-aws <[email protected]> * add ut Signed-off-by: zhichao-aws <[email protected]> * add test Signed-off-by: zhichao-aws <[email protected]> * fix core interface Signed-off-by: zhichao-aws <[email protected]> * test Signed-off-by: zhichao-aws <[email protected]> * license header Signed-off-by: zhichao-aws <[email protected]> * use exception holder Signed-off-by: zhichao-aws <[email protected]> * add max retry times settings Signed-off-by: zhichao-aws <[email protected]> * fix typo Signed-off-by: zhichao-aws <[email protected]> * nit Signed-off-by: zhichao-aws <[email protected]> * change the order to avoid misleading log Signed-off-by: zhichao-aws <[email protected]> * license header Signed-off-by: zhichao-aws <[email protected]> * move settings to connector Signed-off-by: zhichao-aws <[email protected]> * remove settings Signed-off-by: zhichao-aws <[email protected]> * add test Signed-off-by: zhichao-aws <[email protected]> * add retry_backoff_policy setting Signed-off-by: zhichao-aws <[email protected]> * changes for comments Signed-off-by: zhichao-aws <[email protected]> * fix retry times Signed-off-by: zhichao-aws <[email protected]> * make the error handling more neat in MLSdkAsyncHttpResponseHandler Signed-off-by: zhichao-aws <[email protected]> * change to SageMakerThrottlingException Signed-off-by: zhichao-aws <[email protected]> * use enum for retry backoff policy Signed-off-by: zhichao-aws <[email protected]> * fix seconds to milliseconds in equal jitter policy Signed-off-by: zhichao-aws <[email protected]> * disable retry by default Signed-off-by: zhichao-aws <[email protected]> --------- Signed-off-by: zhichao-aws <[email protected]> (cherry picked from commit 399825f)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Backport feature/multi_tenancy] Implementing retry for remote connector to mitigate throttling issue #3013

[Backport feature/multi_tenancy] Implementing retry for remote connector to mitigate throttling issue #3013

Commits on Sep 30, 2024