Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[pixels-common] support listing more than 1000 objects in S3. #121

Closed
bianhq opened this issue Oct 5, 2021 · 1 comment
Closed

[pixels-common] support listing more than 1000 objects in S3. #121

bianhq opened this issue Oct 5, 2021 · 1 comment
Assignees
@bianhq
Labels
bug Something isn't working
Milestone
Storage Enhancement

Comments

@bianhq
Copy link
Contributor

bianhq commented Oct 5, 2021

The listObjects API of AWS sdk only returns up to 1000 objects.
However, some tables may have more than 1000 objects in the same bucket.
Listing more than 1000 objects should be supported.
@bianhq bianhq added the enhancement New feature or request label Oct 5, 2021
@bianhq bianhq self-assigned this Oct 5, 2021
@bianhq bianhq added bug Something isn't working and removed enhancement New feature or request labels Oct 8, 2021
bianhq added a commit that referenced this issue Oct 8, 2021
@bianhq
[Issue #121]: fix listing objects. (#123)
8f058f4 
Support listing more than 1000 object in a bucket.
@bianhq
Copy link
Contributor Author

bianhq commented Oct 8, 2021

Resolved.

@bianhq bianhq closed this as completed Oct 8, 2021
@bianhq bianhq added this to the Pixels-on-S3 milestone Oct 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bianhq bianhq

Labels
bug Something isn't working
Projects
None yet
Milestone
Storage Enhancement
Development

No branches or pull requests
1 participant
@bianhq