[enchement](mc)Optimize reading of maxcompute partition tables. (#45148) #45246
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
bp #45148
What problem does this PR solve?
Problem Summary:
Optimize reading of maxcompute partition tables:
num_partitions_in_batch_mode
.mc.split_cross_partition
. The parameter is true, which is more friendly to reading partition tables, and false, which is more friendly to debug.-Darrow.enable_null_check_for_get=false
to be jvm to improve the efficiency of mc arrow data conversion.Release note
None
Check List (For Author)
Test
Behavior changed:
Does this need documentation?
Check List (For Reviewer who merge this PR)