Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pageserver: generation numbers for manifest objects #9543

Closed
Tracked by #8088 ...
jcsp opened this issue Oct 28, 2024 · 4 comments
Closed
Tracked by #8088 ...

pageserver: generation numbers for manifest objects #9543

jcsp opened this issue Oct 28, 2024 · 4 comments
Assignees
Labels
c/storage/pageserver Component: storage: pageserver t/feature Issue type: feature, for new features or requests

Comments

@jcsp
Copy link
Collaborator

jcsp commented Oct 28, 2024

No description provided.

@jcsp jcsp self-assigned this Oct 28, 2024
@jcsp jcsp added t/feature Issue type: feature, for new features or requests c/storage/pageserver Component: storage: pageserver labels Oct 28, 2024
@arpad-m
Copy link
Member

arpad-m commented Oct 28, 2024

#9545

jcsp added a commit that referenced this issue Oct 29, 2024
## Problem

Indices used to be the only kind of object where we had to search across
generations to find the most recent one. As of
#9543, manifests will need
the same treatment.

## Summary of changes

- Refactor download_index_part to a generic download_generation_object
function, which will be usable for downloading manifest objects as well.
@arpad-m arpad-m closed this as completed Oct 29, 2024
@arpad-m arpad-m reopened this Oct 29, 2024
@arpad-m
Copy link
Member

arpad-m commented Oct 29, 2024

Second PR: #9555

@jcsp jcsp closed this as completed in 8e2e9f0 Oct 29, 2024
@arpad-m arpad-m reopened this Oct 29, 2024
jcsp added a commit that referenced this issue Oct 31, 2024
## Problem

The final part of #9543 will
be a chaos test that creates/deletes/archives/offloads timelines while
restarting pageservers and migrating tenants. Developing that test
showed up a few places where we log errors during normal shutdown.

## Summary of changes

- UninitializedTimeline's drop should log at info severity: this is a
normal code path when some part of timeline creation encounters a
cancellation `?` path.
- When offloading and finding a `RemoteTimelineClient` in a
non-initialized state, this is not an error and should not be logged as
such.
- The `offload_timeline` function returned an anyhow error, so callers
couldn't gracefully pick out cancellation errors from real errors:
update this to have a structured error type and use it throughout.
@arpad-m
Copy link
Member

arpad-m commented Nov 8, 2024

The missing item here is tests, which will be addressed by #9609

@arpad-m
Copy link
Member

arpad-m commented Nov 18, 2024

The PR merged, closing.

@arpad-m arpad-m closed this as completed Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c/storage/pageserver Component: storage: pageserver t/feature Issue type: feature, for new features or requests
Projects
None yet
Development

No branches or pull requests

2 participants