We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
optimize compact
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Summary
Execution of Optimize table x compact statement is rather conservative, utilization of CPU / Bandwidth is rather low.
Optimize table x compact
The text was updated successfully, but these errors were encountered:
compact blocks_select read segment files is not parallel, so it's slow: https://github.com/datafuselabs/databend/blob/61589ffbef98db662b661a63a6c3f1565719dfa6/src/query/storages/fuse/src/operations/mutation/compact_mutator.rs#L95-L155
compact
blocks_select
Sorry, something went wrong.
SELECT/OPTIMIZE
COPY INTO
Another improvement is to compact by batch instead read all the segments one by one compact.
I am trying to read segments in parallel using read_segments
read_segments
Successfully merging a pull request may close this issue.
Summary
Execution of
Optimize table x compact
statement is rather conservative, utilization of CPU / Bandwidth is rather low.The text was updated successfully, but these errors were encountered: