Cannot parse the partition key from SQL for less table scan if the partition keys are specified in OR conditions #13467
pangyifish
started this conversation in
General
Replies: 1 comment 1 reply
-
This is a known limitation of TupleDomain-based predicate pushdown. Same technique could be applied in other connectors as well (eg Iceberg), but seems not quite applicable to eg Hive. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
a
is a hive table partitioned bydt
, stored in s3.I have where conditions like:
Trino ended up doing a full table scan on
a
so I have to add
AND a.dt in (DATE'2022-07-17', DATE'2022-07-18', DATE'2022-07-23', DATE'2022-07-24')
to make it scan less data.version: 380
Beta Was this translation helpful? Give feedback.
All reactions