Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimise unassigned shards iteration after allocator timeout #14977

Merged
merged 16 commits into from
Aug 8, 2024

Conversation

imRishN
Copy link
Member

@imRishN imRishN commented Jul 25, 2024

Description

This PR optimises on how shards are marked throttled once it is timed out. Earlier it use to iterate over all unassigned shards for every batch, now it would collect all the shards that needs to ignored at once and iterate over unassigned shards once.

Related Issues

Resolves #14944

Check List

  • Functionality includes testing.
  • [] API changes companion pull request created, if applicable.
  • [ ] Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Copy link
Contributor

❌ Gradle check result for fad910e: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Copy link
Contributor

✅ Gradle check result for 235ea10: SUCCESS

@Bukhtawar Bukhtawar dismissed their stale review August 7, 2024 08:20

New comment

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Copy link
Contributor

github-actions bot commented Aug 7, 2024

❌ Gradle check result for 3cfa046: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

github-actions bot commented Aug 7, 2024

❕ Gradle check result for 3a80281: UNSTABLE

  • TEST FAILURES:
      1 org.opensearch.cluster.MinimumClusterManagerNodesIT.testThreeNodesNoClusterManagerBlock

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Copy link
Contributor

github-actions bot commented Aug 8, 2024

✅ Gradle check result for 8933879: SUCCESS

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Copy link
Contributor

github-actions bot commented Aug 8, 2024

❕ Gradle check result for 9aee4e9: UNSTABLE

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

@Bukhtawar Bukhtawar merged commit 555a56d into opensearch-project:main Aug 8, 2024
34 of 35 checks passed
@Bukhtawar Bukhtawar added the backport 2.x Backport to 2.x branch label Aug 8, 2024
opensearch-trigger-bot bot pushed a commit that referenced this pull request Aug 8, 2024
* Optimise unassigned shards iteration after allocator timeout

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
(cherry picked from commit 555a56d)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
harshavamsi pushed a commit to harshavamsi/OpenSearch that referenced this pull request Aug 20, 2024
…rch-project#14977)

* Optimise unassigned shards iteration after allocator timeout

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
wdongyu pushed a commit to wdongyu/OpenSearch that referenced this pull request Aug 22, 2024
…rch-project#14977)

* Optimise unassigned shards iteration after allocator timeout

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
imRishN added a commit to imRishN/OpenSearch that referenced this pull request Sep 4, 2024
…rch-project#14977)

* Optimise unassigned shards iteration after allocator timeout

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
imRishN added a commit to imRishN/OpenSearch that referenced this pull request Sep 4, 2024
…rch-project#14977)

* Optimise unassigned shards iteration after allocator timeout

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Bukhtawar pushed a commit that referenced this pull request Sep 4, 2024
…imeout & Fix responsibility check for existing shards allocator when timed out (#15648)

* Optimise unassigned shards iteration after allocator timeout (#14977)

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Bukhtawar pushed a commit that referenced this pull request Sep 4, 2024
…timeout & fix responsibility check for existing shards allocator when timed out (#15650)

* Optimise unassigned shards iteration after allocator timeout (#14977)

* Fix responsibility check for existing shards allocator when timed out (#15223)

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
akolarkunnu pushed a commit to akolarkunnu/OpenSearch that referenced this pull request Sep 10, 2024
…rch-project#14977)

* Optimise unassigned shards iteration after allocator timeout

Signed-off-by: Rishab Nahata <rnnahata@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch bug Something isn't working Cluster Manager Other skip-changelog
Projects
Status: ✅ Done
Development

Successfully merging this pull request may close these issues.

[BUG] Optimise unassigned shards iteration after allocator timeout
3 participants