Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve checkpoint versioning stability #421

Closed
yl-lisen opened this issue Dec 18, 2023 · 1 comment · Fixed by #633
Closed

Improve checkpoint versioning stability #421

yl-lisen opened this issue Dec 18, 2023 · 1 comment · Fixed by #633
Assignees
Labels
enhancement New feature or request state_mgmt streaming query state management

Comments

@yl-lisen
Copy link
Collaborator

yl-lisen commented Dec 18, 2023

Use case

In proton, query state management is works via checkpoints. currently we use a strict checkpoint/recover implementation, which is easily broken when there are any modifications about query pipeline, processors or its header changes.

So we want to improve the stability of checkpoints, and reduce broken scenarios as much as possible

Describe the solution you'd like

Describe alternatives you've considered

Additional context

@yl-lisen yl-lisen added the enhancement New feature or request label Dec 18, 2023
@yl-lisen yl-lisen self-assigned this Dec 18, 2023
@yl-lisen yl-lisen added the state_mgmt streaming query state management label Dec 18, 2023
@jovezhong
Copy link
Contributor

(Jove Github Bot) added it to the current sprint.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request state_mgmt streaming query state management
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants