Forwarding port changes in 2.4 to main branch (refactor model cache and thread pool)

[b4sjoo]

• refactor model cache and thread pool

Signed-off-by: Yaliang Wu [email protected]

• address comments

Signed-off-by: Yaliang Wu [email protected]

Signed-off-by: Yaliang Wu [email protected]
Signed-off-by: Sicheng Song [email protected]

Description

This PR is a partial forwarding of port changes in branch 2.x (commit #496) to main branch.

Issues Resolved

This PR partially resolves #553 and OpenSearch-SQL #1065

Check List

• New functionality includes testing.
  • All tests pass
• New functionality has been documented.
  • New functionality has javadoc added
• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov-commenter]

Codecov Report

Merging #564 (ad44455) into main (b39a737) will increase coverage by 4.57%.
The diff coverage is 59.06%.

@@             Coverage Diff              @@
##               main     #564      +/-   ##
============================================
+ Coverage     61.58%   66.16%   +4.57%     
- Complexity      709      771      +62     
============================================
  Files            85       86       +1     
  Lines          3223     3257      +34     
  Branches        294      305      +11     
============================================
+ Hits           1985     2155     +170     
+ Misses         1128      991     -137     
- Partials        110      111       +1     

Flag	Coverage Δ
ml-commons	66.16% <59.06%> (+4.57%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...arch/ml/action/forward/TransportForwardAction.java	18.91% <0.00%> (-0.26%)	⬇️
...earch/ml/action/load/TransportLoadModelAction.java	12.84% <0.00%> (ø)
.../ml/action/syncup/TransportSyncUpOnNodeAction.java	55.38% <0.00%> (-1.76%)	⬇️
...java/org/opensearch/ml/profile/MLModelProfile.java	53.84% <ø> (ø)
...g/opensearch/ml/profile/MLPredictRequestStats.java	56.81% <ø> (ø)
...n/java/org/opensearch/ml/model/MLModelManager.java	15.98% <18.04%> (+9.19%)	⬆️
...ch/ml/action/profile/MLProfileTransportAction.java	81.25% <66.66%> (-2.09%)	⬇️
...va/org/opensearch/ml/task/MLPredictTaskRunner.java	82.01% <75.00%> (-0.13%)	⬇️
...va/org/opensearch/ml/model/MLModelCacheHelper.java	99.09% <99.09%> (ø)
.../cluster/MLCommonsClusterManagerEventListener.java	65.62% <100.00%> (-12.50%)	⬇️
... and 11 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.