[Feature] Support dynamic partition pruning (backport #30319)

[mergify]

Open-sourced table formats (e.g. hive) support data partitioning. That is to say, any record in a given data file has the same set of partition values.

This is a common practice for large fact tables (e.g. lineorder can be partitioned by lo_orderdate in the SSB dataset ).

If the predicates generated by the runtime filter (lo_orderdate IN SET(...)) can be applied to the partition columns, we could use this to test if a data file (i.e. scan range) can be skipped or not.

SSB Q1

What type of PR is this:

• BugFix
• Feature
• Enhancement
• Refactor
• UT
• Doc
• Tool

Does this PR entail a change in behavior?

• Yes, this PR will result in a change in behavior.
• No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

• Interface/UI changes: syntax, type conversion, expression evaluation, display information
• Parameter changes: default values, similar parameters but with different default values
• Policy changes: use new policy to replace old one, functionality automatically enabled
• Feature removed
• Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

• I have added test cases for my bug fix or my new feature
• This pr needs user documentation (for new or modified features or behaviors)
  • I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

• I have checked the version labels which the pr will be auto-backported to the target branch
  • 3.1
  • 3.0
  • 2.5
  • 2.4

---

This is an automatic backport of pull request #30319 done by [Mergify](https://mergify.com). Open-sourced table formats (e.g. hive) support data partitioning. That is to say, any record in a given data file has the same set of partition values.

This is a common practice for large fact tables (e.g. lineorder can be partitioned by lo_orderdate in the SSB dataset ).

If the predicates generated by the runtime filter (lo_orderdate IN SET(...)) can be applied to the partition columns, we could use this to test if a data file (i.e. scan range) can be skipped or not.

SSB Q1

What type of PR is this:

• BugFix
• Feature
• Enhancement
• Refactor
• UT
• Doc
• Tool

Does this PR entail a change in behavior?

• Yes, this PR will result in a change in behavior.
• No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

• Interface/UI changes: syntax, type conversion, expression evaluation, display information
• Parameter changes: default values, similar parameters but with different default values
• Policy changes: use new policy to replace old one, functionality automatically enabled
• Feature removed
• Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

• I have added test cases for my bug fix or my new feature
• This pr needs user documentation (for new or modified features or behaviors)
  • I have added documentation for my new feature or new function

[mergify]

Cherry-pick of 3def3c1 has failed:

On branch mergify/bp/branch-3.2/pr-30319
Your branch is up to date with 'origin/branch-3.2'.

You are currently cherry-picking commit 3def3c1d3d.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	modified:   be/src/exec/hdfs_scanner.h
	modified:   be/src/exec/jni_scanner.h
	modified:   be/src/exec/pipeline/scan/connector_scan_operator.h
	modified:   be/src/exprs/runtime_filter_bank.cpp
	modified:   be/src/exprs/runtime_filter_bank.h
	modified:   gensrc/thrift/InternalService.thrift

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   be/src/connector/connector.h
	both modified:   be/src/connector/hive_connector.cpp
	both modified:   be/src/connector/hive_connector.h
	both modified:   be/src/exec/hdfs_scanner.cpp
	both modified:   be/src/formats/parquet/file_reader.cpp
	both modified:   be/test/exec/hdfs_scanner_test.cpp
	both modified:   fe/fe-core/src/main/java/com/starrocks/qe/SessionVariable.java

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

[mergify]

@mergify[bot]: Backport conflict, please reslove the conflict and resubmit the pr