You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
table.read_partitions may do many IO operations, such as the min-max index filter or bloom filter index filter.
If a table has many partitions, the read_partitions will be very slow.
For distributed, we can:
read_partitions return segments instead of partition if the segments > 1000
Distribute the Partitions to cluster
In read2, to check file is segment or partition file
The text was updated successfully, but these errors were encountered:
Summary
table.read_partitions
may do many IO operations, such as the min-max index filter or bloom filter index filter.If a table has many partitions, the
read_partitions
will be very slow.For distributed, we can:
read_partitions
return segments instead of partition if the segments > 1000Partitions
to clusterread2
, to check file issegment
orpartition
fileThe text was updated successfully, but these errors were encountered: