branch-2.1: [fix](iceberg)Bring field_id with parquet files And fix map type's key optional #44470 #44828

github-actions · 2024-12-01T14:20:43Z

Cherry-picked from #44470

…y optional (#44470) ### What problem does this PR solve? 1. Column IDs are required to be stored as [field IDs](http://github.com/apache/parquet-format/blob/40699d05bd24181de6b1457babbee2c16dce3803/src/main/thrift/parquet.thrift#L459) on the parquet schema. ref: https://iceberg.apache.org/spec/?h=field+id#parquet So, we should add field ids. 2. For `MapType`, its key is always required.

doris-robot · 2024-12-01T14:20:49Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

doris-robot · 2024-12-01T14:20:52Z

run buildall

doris-robot · 2024-12-01T14:58:05Z

TeamCity be ut coverage result:
Function Coverage: 36.77% (9619/26161)
Line Coverage: 28.17% (79178/281027)
Region Coverage: 26.83% (40645/151485)
Branch Coverage: 23.66% (20698/87466)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c836706fefa09c421ed9f1a82a74f4b64302e9a9_c836706fefa09c421ed9f1a82a74f4b64302e9a9/report/index.html

dataroaring closed this Dec 1, 2024

dataroaring reopened this Dec 1, 2024

yiguolei merged commit 5f952cf into branch-2.1 Dec 2, 2024
17 of 19 checks passed

github-actions bot deleted the auto-pick-44470-branch-2.1 branch December 2, 2024 02:24

Provide feedback