Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement Bulk Object Deletion Database Queries #515

Open
NiaStorj opened this issue Oct 8, 2024 · 10 comments
Open

Implement Bulk Object Deletion Database Queries #515

NiaStorj opened this issue Oct 8, 2024 · 10 comments
Assignees
@jewharton
Labels
edge

Comments

@NiaStorj
Copy link

NiaStorj commented Oct 8, 2024 •
edited
Loading

Goal:

Allow multiple objects to be able to delete multiple items from a bucket via satellite db methods

AC:

The implementation should follow what's laid out in the design doc (storj/design-docs#17)
@NiaStorj NiaStorj added the edge label Oct 8, 2024
@jewharton jewharton self-assigned this Oct 8, 2024
@storj-gerrit
Copy link

storj-gerrit bot commented Oct 10, 2024

Change satellite/metabase: rename DeleteBucketObjects to DeleteAllBucketObjects mentions this issue.

@storj-gerrit
Copy link

storj-gerrit bot commented Oct 11, 2024

Change satellite/metabase: add method for deleting certain objects from bucket mentions this issue.

storjBuildBot pushed a commit to storj/storj that referenced this issue Oct 11, 2024
@jewharton
satellite/metabase: rename DeleteBucketObjects to DeleteAllBucketObjects
27d2363 
This change renames the metainfo DB method responsible for deleting all
objects in a bucket. The updated name clarifies the method's purpose,
and the original name will be used for a method that only deletes
specific objects from a bucket.

References storj/edge#515

Change-Id: I4d83700a2fb4dec784b884a05c87019a0aadf116
@storj-gerrit
Copy link

storj-gerrit bot commented Oct 17, 2024

Change satellite/metabase: allow DeleteBucketObjects to insert delete markers mentions this issue.

@storj-gerrit
Copy link

storj-gerrit bot commented Oct 18, 2024

Change satellite/metabase: add suspended versioning support to DeleteBucketObjects mentions this issue.

@jewharton jewharton mentioned this issue Nov 6, 2024
Open
storjBuildBot pushed a commit to storj/storj that referenced this issue Dec 10, 2024
@jewharton
satellite/metabase: add method for bulk deleting objects from bucket
afccb34 
This change introduces a metainfo database method that deletes multiple
objects from a bucket at once. This is planned to be used as part of
the satellite's DeleteObjects operation.

References storj/edge#515

Change-Id: Ifdb509592a28d278e2cd920cb16e0e9b303c7812
@storj-gerrit
Copy link

storj-gerrit bot commented Jan 2, 2025

Change satellite/metabase: make DeleteObjects use and return stream ID suffix mentions this issue.

storjBuildBot pushed a commit to storj/storj that referenced this issue Jan 9, 2025
@jewharton
satellite/metabase: make DeleteObjects use and return stream ID suffix
537e5ff 
This change updates the DeleteObjects metabase method to accept the
stream ID suffixes of objects to deleted. In addition, this information
is returned for each deleted object.

This prepares the method for use by the metainfo RPC service, which
requires this information to construct object version IDs.

References storj/edge#515

Change-Id: I219ee379d967f32b9e0ee17f815263f5a5bc483f
@storj-gerrit
Copy link

storj-gerrit bot commented Jan 10, 2025

Change satellite/metabase: make DeleteObjects respect Object Lock for unversioned buckets mentions this issue.

storjBuildBot pushed a commit to storj/storj that referenced this issue Jan 13, 2025
@jewharton
satellite/metabase: add versioning support to DeleteObjects
251d40e 
This change allows the DeleteObjects satellite DB method to
properly delete objects from buckets with versioning enabled.

References storj/edge#515

Change-Id: I165c7bc2bc31a7f197c1d8361d54fee5560a0fae
@storj-gerrit
Copy link

storj-gerrit bot commented Jan 16, 2025

Change satellite/metabase: make DeleteObjects respect Object Lock for versioned buckets mentions this issue.

@storj-gerrit
Copy link

storj-gerrit bot commented Jan 18, 2025

Change satellite/metabase: make DeleteObjects respect Object Lock for suspended buckets mentions this issue.

@storj-gerrit
Copy link

storj-gerrit bot commented Feb 8, 2025

Change satellite/metabase: add stream ID filtering to DeleteObjectExactVersion mentions this issue.

storjBuildBot pushed a commit to storj/storj that referenced this issue Feb 11, 2025
@jewharton
satellite/metabase: add stream ID filtering to DeleteObjectExactVersion
34b02d5 
This change allows the DeleteObjectExactVersion method to filter by
stream ID suffix when selecting objects to delete. This functionality
is intended for use by our DeleteObjects implementation.

References storj/edge#515

Change-Id: I09a99dad94aa7caa3c8a1ccd387c2a0d094b01a7
storjBuildBot pushed a commit to storj/storj that referenced this issue Feb 12, 2025
@jewharton
satellite/metabase: add suspended versioning support to DeleteObjects
0028024 
This change allows the DeleteObjects satellite DB method to properly
delete objects from buckets with versioning suspended.

References storj/edge#515

Change-Id: If62d8d2e39b001916cd758d5f5ce25a052300889
@storj-gerrit
Copy link

storj-gerrit bot commented Feb 12, 2025

Change satellite/metabase: make DeleteObjects respect Object Lock mentions this issue.

storjBuildBot pushed a commit to storj/storj that referenced this issue Feb 21, 2025
@jewharton
satellite/metabase: make DeleteObjects respect Object Lock
327c6b0 
This change allows objects with active Object Lock settings to be
protected from deletion by the DeleteObjects metainfo DB method.

References storj/edge#515

Change-Id: I1d5b3eaf8b4e02317bf7bdea630219df555c6f2f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jewharton jewharton

Labels
edge
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jewharton @NiaStorj