Push down temporal filters for TIMESTAMP WITH TIME ZONE
columns on Delta Lake
#18664
Labels
TIMESTAMP WITH TIME ZONE
columns on Delta Lake
#18664
Add the ability to subsume temporal filter expressions which can be subsumed to be performed on the parquet row group level over even on the metadata level instead of being applied for each row retrieved.
is equivalent to
(still to be verified -
delta.parquet.time-zone
setting may play out a role in the translation of the expression above)In a similar fashion as it is done for Iceberg with Iceberg on
trino/plugin/trino-iceberg/src/test/java/io/trino/plugin/iceberg/BaseIcebergConnectorTest.java
Lines 1934 to 1960 in cac5b0f
add similar logic (either on the engine or on Delta Lake connector
DeltaLakeMetadata#applyFilter()
method) for being able to subsume such filters.See how it is done on the Iceberg connector:
trino/plugin/trino-iceberg/src/main/java/io/trino/plugin/iceberg/ConstraintExtractor.java
Lines 182 to 196 in cac5b0f
The text was updated successfully, but these errors were encountered: