Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make scheduled stages order deterministic #10605

Merged
merged 1 commit into from
Jan 17, 2022

Conversation

sopel39
Copy link
Member

@sopel39 sopel39 commented Jan 14, 2022

The scheduler is single threaded per query so the actual order stages
are processed in the scheduler can affect short queries on fast connectors.

@sopel39 sopel39 requested a review from losipiuk January 14, 2022 09:29
@cla-bot cla-bot bot added the cla-signed label Jan 14, 2022
@sopel39
Copy link
Member Author

sopel39 commented Jan 14, 2022

cc @martint

@sopel39
Copy link
Member Author

sopel39 commented Jan 14, 2022

This is based on AllAtOnceExecutionSchedule preferred ordering. Its mostly about build before probe, but also about planning determinism

@sopel39 sopel39 force-pushed the ks/deterministic_stages branch 4 times, most recently from 14506b3 to 9939117 Compare January 14, 2022 09:37
@sopel39 sopel39 force-pushed the ks/deterministic_stages branch from 9939117 to 6bd2370 Compare January 14, 2022 12:35
The scheduler is single threaded per query so the actual order stages
are processed in the scheduler can affect short queries on fast connectors.
@sopel39 sopel39 force-pushed the ks/deterministic_stages branch from 6bd2370 to ca365e0 Compare January 17, 2022 10:34
@sopel39 sopel39 merged commit 6281038 into trinodb:master Jan 17, 2022
@sopel39 sopel39 deleted the ks/deterministic_stages branch January 17, 2022 10:34
@github-actions github-actions bot added this to the 369 milestone Jan 17, 2022
This was referenced Jan 17, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

2 participants