Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow config to specify the bucket exists #23932

Merged

Conversation

rullzer
Copy link
Member

@rullzer rullzer commented Nov 6, 2020

In the 99% case the bucket is just always there. And if it is not the
read/write will fail hard anyways. Esp on big instances the Objectstore
is not always fast and this can save a few hundered ms of each request
that acess the objectstore.

In short it is adding

'verify_bucket_exists' => false

To the S3 config part

Signed-off-by: Roeland Jago Douma roeland@famdouma.nl

In the 99% case the bucket is just always there. And if it is not the
read/write will fail hard anyways. Esp on big instances the Objectstore
is not always fast and this can save a few hundered ms of each request
that acess the objectstore.

In short it is adding

'verify_bucket_exists' => false

To the S3 config part

Signed-off-by: Roeland Jago Douma <roeland@famdouma.nl>
Copy link
Member

@juliushaertl juliushaertl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense 👍

@kesselb
Copy link
Contributor

kesselb commented Nov 6, 2020

I think that should be the default without a configuration option.

@MorrisJobke
Copy link
Member

I think that should be the default without a configuration option.

Get's tricky for multibucket setups, where the needed buckets are created on the fly.

@MorrisJobke MorrisJobke merged commit 9e2ced6 into master Nov 6, 2020
@MorrisJobke MorrisJobke deleted the enh/s3/do_not_check_bucket_exists_on_every_request branch November 6, 2020 15:13
@MorrisJobke MorrisJobke added the pending documentation This pull request needs an associated documentation update label Nov 6, 2020
@MorrisJobke
Copy link
Member

Documentation needed. Especially in sample config as well as the implications on multibucket (and preview multibucket setups).

joshtrichards added a commit to joshtrichards/nc-documentation that referenced this pull request Sep 3, 2023
As developed in nextcloud/server#23932

Also includes caveat language re: multibucket scenarios

Signed-off-by: Josh Richards <josh.t.richards@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3. to review Waiting for reviews enhancement pending documentation This pull request needs an associated documentation update performance 🚀
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants