[Backport 2.x] Concurrent Search Tasks Response Updates

[opensearch-trigger-bot]

Backport e3740f7 from #7673.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/16634/
• CommitID: b15e9f3
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[jed326]

Build failure due to V_3_0_0. 2.9 branch isn't created yet so going to leave this open for now.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/16680/
• CommitID: ab35d5d
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[jed326]

I can take a look at this test failure shortly.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocation
      1 org.opensearch.indices.replication.SegmentReplicationIT.testScrollCreatedOnReplica

• URL: https://build.ci.opensearch.org/job/gradle-check/16685/
• CommitID: ab35d5d
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #7856 (1195448) into 2.x (35ba672) will decrease coverage by 0.07%.
The diff coverage is 85.86%.

❗ Current head 1195448 differs from pull request most recent head f840f53. Consider uploading reports for the commit f840f53 to get more accurate results

@@             Coverage Diff              @@
##                2.x    #7856      +/-   ##
============================================
- Coverage     70.58%   70.52%   -0.07%     
+ Complexity    56460    56433      -27     
============================================
  Files          4665     4666       +1     
  Lines        267675   267763      +88     
  Branches      39634    39651      +17     
============================================
- Hits         188944   188844     -100     
- Misses        62496    62617     +121     
- Partials      16235    16302      +67     

Impacted Files	Coverage Δ
...n/java/org/opensearch/tasks/TaskResourceStats.java	75.51% <76.47%> (-5.05%)	⬇️
...ain/java/org/opensearch/tasks/TaskThreadUsage.java	77.77% <77.77%> (ø)
...erver/src/main/java/org/opensearch/tasks/Task.java	84.81% <93.75%> (+3.90%)	⬆️

... and 451 files with indirect coverage changes

[jed326]

org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT > test {p0=tasks.list/10_basic/tasks_list test} FAILED
    java.lang.AssertionError: Failure at [tasks.list/10_basic:25]: field [tasks.$task_id.resource_stats] doesn't have a true value
    Expected: not null
         but: was null

Looks like this is a mixed cluster with 1.3 and the problem is that resource_stats does not exist in 1.3. The problem is with the test and not the underlying code.

[jed326]

@reta should we just merge this PR as is and then I will open a new one with the test fix or is there a better way to handle this?

[reta]

@reta should we just merge this PR as is and then I will open a new one with the test fix or is there a better way to handle this?

@jed326 I will push the fix for tests tomorrow (sorry far from laptop), we should fix the tests right away before merging, moreover you find out the problem already, thank you.

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.search.SearchWeightedRoutingIT.testShardRoutingWithNetworkDisruption_FailOpenEnabled

• URL: https://build.ci.opensearch.org/job/gradle-check/16723/
• CommitID: 1195448
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[reta]

@jed326 looks good? we will bring version + tests changes to main

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: SUCCESS ✅
• URL: https://build.ci.opensearch.org/job/gradle-check/16724/
• CommitID: f840f53

[jed326]

@reta looks good to me. Thanks!

[reta]

@kotwanikunal may I ask you please to approve this backport? thank you