Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce the minimal chunk size from 100 to 10. #1087

Merged
merged 1 commit into from
Feb 7, 2022

Conversation

arthurschreiber
Copy link
Member

A Pull Request should be associated with an Issue.

We'd like to set the minimum chunk size to a value lower than 100. Copying 100 rows at a time is fine for tables that have a low average row length, but copying 100 rows at a time from tables that have a large average row lengths is causing replication lag in our clusters.

Description

This PR lowers the minimum chunk-size value from 100 to 10.

  • contributed code is using same conventions as original code
  • script/cibuild returns with no formatting errors, build errors or unit test errors.

Copy link
Contributor

@dm-2 dm-2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one small change - please can you also update the "allowed range" values in the help text in this PR? Thanks!

@dm-2 dm-2 added this to the v1.1.5 milestone Feb 7, 2022
@dm-2 dm-2 merged commit dc9a2e3 into master Feb 7, 2022
@dm-2 dm-2 modified the milestones: v1.1.5, v1.1.4 Feb 7, 2022
@dm-2 dm-2 mentioned this pull request Feb 7, 2022
@dm-2 dm-2 deleted the arthur/reduce-minimal-chunk-size branch February 25, 2022 15:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants