-
Notifications
You must be signed in to change notification settings - Fork 3.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
3 changed files
with
129 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,117 @@ | ||
# Release 406 (25 Jan 2023) | ||
|
||
## General | ||
|
||
* Add support for [exchange spooling on HDFS](fte-exchange-hdfs) when | ||
fault-tolerant execution is enabled. ({issue}`15160`) | ||
* Add support for `CHECK` constraints in an `INSERT` statement. ({issue}`14964`) | ||
* Improve planner estimates for queries containing outer joins over a subquery | ||
involving `ORDER BY` and `LIMIT`. ({issue}`15428`) | ||
* Improve accuracy of memory usage reporting for table scans. ({issue}`15711`) | ||
* Improve performance of queries parsing date values in ISO 8861 format. ({issue}`15548`) | ||
* Improve performance of queries with selective joins. ({issue}`15569`) | ||
* Remove `legacy-phased` execution scheduler as an option for the | ||
`query.execution-policy` configuration property. ({issue}`15657`) | ||
* Fix failure when `WHERE` or `JOIN` clauses contain a `LIKE` expression with a | ||
non-constant pattern or escape. ({issue}`15629`) | ||
* Fix inaccurate planner estimates for queries with filters on columns without | ||
statistics. ({issue}`15642`) | ||
* Fix queries with outer joins failing when fault-tolerant execution is | ||
enabled. ({issue}`15608`) | ||
* Fix potential query failure when using `MATCH_RECOGNIZE`. ({issue}`15461`) | ||
* Fix query failure when using group-based access control with column masks or | ||
row filters. ({issue}`15583`) | ||
* Fix potential hang during shutdown. ({issue}`15675`) | ||
* Fix incorrect results when referencing a field resulting from the application | ||
of a column mask expression that produces a `row` type. ({issue}`15659`) | ||
* Fix incorrect application of column masks when a mask expression references a | ||
different column in the underlying table. ({issue}`15680`) | ||
|
||
## BigQuery connector | ||
|
||
* Add support for [fault-tolerant execution](/admin/fault-tolerant-execution). ({issue}`15620`) | ||
* Fix possible incorrect results for certain queries like `count(*)` when a | ||
table has recently been written to. ({issue}`14981`) | ||
|
||
## Cassandra connector | ||
|
||
* Fix incorrect results when the Cassandra `list`, `map`, or `set` types contain | ||
user-defined types. ({issue}`15771`) | ||
|
||
## Delta Lake connector | ||
|
||
* Reduce latency for `INSERT` queries on unpartitioned tables. ({issue}`15708`) | ||
* Improve performance of reading Parquet files. ({issue}`15498`) | ||
* Improve memory accounting of the Parquet reader. ({issue}`15554`) | ||
* Improve performance of queries with filters or projections on low-cardinality | ||
string columns stored in Parquet files. ({issue}`15269`) | ||
* Fix reading more data than necessary from Parquet files for queries with | ||
filters. ({issue}`15552`) | ||
* Fix potential query failure when writing to Parquet from a table with an | ||
`INTEGER` range on a `BIGINT` column. ({issue}`15496`) | ||
* Fix query failure due to missing null counts in Parquet column indexes. ({issue}`15706`) | ||
|
||
## Hive connector | ||
|
||
* Add support for table redirections to catalogs using the Hudi connector. ({issue}`14750`) | ||
* Reduce latency for `INSERT` queries on unpartitioned tables. ({issue}`15708`) | ||
* Improve performance of caching. ({issue}`13243 `) | ||
* Improve performance of reading Parquet files. ({issue}`15498`) | ||
* Improve memory accounting of the Parquet reader. ({issue}`15554`) | ||
* Improve performance of queries with filters or projections on low-cardinality | ||
string columns stored in Parquet files. ({issue}`15269`) | ||
* Improve performance of queries with filters when Bloom filter indexes are | ||
present in Parquet files. Use of Bloom filters from Parquet files can be | ||
disabled with the `parquet.use-bloom-filter` configuration property or the | ||
`parquet_use_bloom_filter` session property. ({issue}`14428`) | ||
* Allow coercion between Hive `UNIONTYPE` and Hive `STRUCT`-typed columns. ({issue}`15017`) | ||
* Fix reading more data than necessary from Parquet files for queries with | ||
filters. ({issue}`15552`) | ||
* Fix query failure due to missing null counts in Parquet column indexes. ({issue}`15706`) | ||
* Fix incorrect `schema already exists` error caused by a client timeout when | ||
creating a new schema. ({issue}`15174`) | ||
|
||
## Hudi connector | ||
|
||
* Improve performance of reading Parquet files. ({issue}`15498`) | ||
* Improve memory accounting of the Parquet reader. ({issue}`15554`) | ||
* Improve performance of queries with filters or projections on low-cardinality | ||
string columns stored in Parquet files. ({issue}`15269`) | ||
* Fix reading more data than necessary from Parquet files for queries with | ||
filters. ({issue}`15552`) | ||
* Fix query failure due to missing null counts in Parquet column indexes. ({issue}`15706`) | ||
|
||
## Iceberg connector | ||
|
||
* Add support for changing column types. ({issue}`15515`) | ||
* Add [support for the JDBC catalog](iceberg-jdbc-catalog). ({issue}`9968`) | ||
* ReduceAdd support for changing fields in columns of row type. latency for `INSERT` queries on unpartitioned tables. ({issue}`15708`) | ||
* Improve performance of reading Parquet files. ({issue}`15498`) | ||
* Improve memory accounting of the Parquet reader. ({issue}`15554`) | ||
* Improve performance of queries with filters or projections on low-cardinality | ||
string columns stored in Parquet files. ({issue}`15269`) | ||
* Fix reading more data than necessary from Parquet files for queries with | ||
filters. ({issue}`15552`) | ||
* Fix query failure due to missing null counts in Parquet column indexes. ({issue}`15706`) | ||
* Fix query failure when a subquery contains [time travel](iceberg-time-travel). ({issue}`15607`) | ||
* Fix failure when reading columns that had their type changed from `float` to | ||
`double` by other query engines. ({issue}`15650`) | ||
* Fix incorrect results when reading or writing `NaN` with `real` or `double` | ||
types on partitioned columns. ({issue}`15723`) | ||
|
||
## MongoDB connector | ||
|
||
* Fix schemas not being dropped when trying to drop schemas with the | ||
`mongodb.case-insensitive-name-matching` configuration property enabled. ({issue}`15716`) | ||
|
||
## PostgreSQL connector | ||
|
||
* Add support for changing column types. ({issue}`15515`) | ||
|
||
## SPI | ||
|
||
* Remove the `getDeleteRowIdColumnHandle()`, `beginDelete()`, `finishDelete()`, | ||
`getUpdateRowIdColumnHandle()`, `beginUpdate()`, and `finishUpdate()` methods | ||
from `ConnectorMetadata`. ({issue}`15161`) | ||
* Remove the `UpdatablePageSource` interface. ({issue}`15161`) | ||
* Remove support for multiple masks on a single column. ({issue}`15680`) |