Retry only specified tests #8825
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
andrross
requested review from
reta,
anasalkouz,
Bukhtawar,
CEHENKLE,
dblock,
gbbafna,
setiah,
kartg,
kotwanikunal,
mch2,
nknize,
owaiskazi19,
Rishikesh1159,
ryanbogan,
saratvemulapalli,
shwetathareja,
dreamer-89,
tlfeng,
VachaShah,
dbwiddis and
sachinpkale
as code owners
Gradle Check (Jenkins) Run Completed with:
|
Codecov Report
@@ Coverage Diff @@
## main #8825 +/- ##
============================================
+ Coverage 71.06% 71.10% +0.03%
+ Complexity 57241 57236 -5
============================================
Files 4757 4757
Lines 269804 269804
Branches 39454 39454
============================================
+ Hits 191733 191831 +98
+ Misses 61870 61791 -79
+ Partials 16201 16182 -19 |
kotwanikunal
approved these changes
Jul 24, 2023
|
@andrross Should we outline the process to add or remove these tests in one of the readmes? |
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <andrross@amazon.com>
andrross
force-pushed
the
retry-explicit-tests
branch
from
554e680 to
64ea3a4
Compare
@kotwanikunal I added a section to the TESTING.md documentation |
kotwanikunal
approved these changes
Jul 24, 2023
Gradle Check (Jenkins) Run Completed with:
|
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Jul 24, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <andrross@amazon.com> (cherry picked from commit 5d78de6) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
dreamer-89
pushed a commit
that referenced
this pull request
Jul 26, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 (cherry picked from commit 5d78de6) Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
andrross
added a commit
to andrross/OpenSearch
that referenced
this pull request
Jul 27, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com>
6 tasks
andrross
added a commit
that referenced
this pull request
Jul 27, 2023
The intent of #8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com>
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Jul 27, 2023
The intent of #8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com> (cherry picked from commit 5495c64) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
kotwanikunal
pushed a commit
that referenced
this pull request
Jul 28, 2023
The intent of #8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering (cherry picked from commit 5495c64) Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
baba-devv
pushed a commit
to baba-devv/OpenSearch
that referenced
this pull request
Jul 28, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com>
baba-devv
pushed a commit
to baba-devv/OpenSearch
that referenced
this pull request
Jul 29, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <andrross@amazon.com>
baba-devv
pushed a commit
to baba-devv/OpenSearch
that referenced
this pull request
Jul 29, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com>
4 tasks
kaushalmahi12
pushed a commit
to kaushalmahi12/OpenSearch
that referenced
this pull request
Sep 12, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: Kaushal Kumar <ravi.kaushal97@gmail.com>
kaushalmahi12
pushed a commit
to kaushalmahi12/OpenSearch
that referenced
this pull request
Sep 12, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: Kaushal Kumar <ravi.kaushal97@gmail.com>
brusic
pushed a commit
to brusic/OpenSearch
that referenced
this pull request
Sep 25, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: Ivan Brusic <ivan.brusic@flocksafety.com>
brusic
pushed a commit
to brusic/OpenSearch
that referenced
this pull request
Sep 25, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: Ivan Brusic <ivan.brusic@flocksafety.com>
shiv0408
pushed a commit
to Gaurav614/OpenSearch
that referenced
this pull request
Apr 25, 2024
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: Shivansh Arora <hishiv@amazon.com>
shiv0408
pushed a commit
to Gaurav614/OpenSearch
that referenced
this pull request
Apr 25, 2024
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <andrross@amazon.com> Signed-off-by: Shivansh Arora <hishiv@amazon.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The flaky-test-finder.rb script was used to collect this list.
Full test failure details
227 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testNodeDropWithOngoingReplication (18079,18079,18420,18425,18426,18467,18482,18485,18487,18489,18489,18492,18495,18496,18497,18499,18502,18510,18510,18516,18517,18517,18519,18526,18526,18531,18533,18534,18534,18537,18539,18541,18542,18543,18546,18550,18555,18563,18568,18575,18583,18595,18595,18595,18596,18599,18599,18599,18600,18606,18610,18611,18612,18614,18615,18616,18618,18619,18620,18624,18625,18627,18628,18629,18630,18631,18633,18635,18635,18648,18649,18653,18659,18660,18667,18667,18672,18680,18685,18707,18712,18723,18724,18728,18728,18732,18738,18739,18739,18746,18757,18762,18763,18766,18775,18777,18777,18781,18782,18795,18796,18800,18801,18804,18804,18805,18808,18811,18815,18817,18818,18821,18826,18830,18832,18837,18838,18841,18841,18842,18852,18856,18857,18857,18861,18867,18871,18873,18873,18876,18879,18879,18879,18888,18889,18895,18900,18919,18920,18934,18947,18947,18947,18950,18951,18953,18956,18959,18962,18968,18974,18976,18977,18979,18982,18983,18983,18989,18989,18989,18991,18993,18993,18998,18999,19001,19002,19008,19009,19013,19013,19019,19021,19025,19029,19038,19041,19047,19048,19051,19053,19054,19055,19056,19060,19061,19062,19063,19063,19065,19066,19068,19069,19069,19075,19077,19080,19084,19090,19091,19092,19092,19093,19094,19099,19101,19102,19102,19106,19107,19109,19118,19119,19127,19135,19142,19142,19147,19152,19154,19157,19157,19159,19166,19168,19183,19193) 149 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testDropPrimaryDuringReplication (18001,18001,18001,18021,18031,18040,18076,18079,18091,18099,18126,18139,18140,18160,18193,18197,18202,18219,18219,18230,18265,18280,18306,18320,18345,18348,18361,18365,18377,18389,18389,18404,18435,18489,18510,18517,18526,18534,18539,18543,18577,18605,18612,18624,18624,18635,18667,18719,18728,18728,18763,18777,18782,18801,18804,18807,18826,18830,18857,18873,18888,18895,18974,18983,18993,19004,19013,19024,19029,19063,19069,19101,19102,19120,19142,19156,19157,19170,19176,19195,19202,19222,19275,19289,19290,19319,19321,19335,19391,19418,19428,19437,19465,19495,19520,19521,19564,19577,19644,19654,19654,19690,19704,19716,19729,19729,19729,19775,19842,19850,19859,19901,19904,19909,19914,19922,19924,19934,19937,19940,19960,19974,19993,20002,20026,20027,20027,20035,20043,20046,20046,20056,20063,20070,20070,20076,20129,20163,20179,20213,20348,20372,20376,20377,20399,20405,20423,20461,20487) 147 org.opensearch.search.SearchWeightedRoutingIT.testStrictWeightedRoutingWithCustomString (18022,18043,18043,18088,18088,18202,18202,18280,18296,18351,18351,18365,18365,18373,18389,18389,18389,18415,18415,18454,18454,18506,18509,18569,18626,18626,18626,18654,18696,18696,18700,18701,18730,18730,18730,18806,18806,18806,18807,18810,18810,18816,18816,18833,18833,19010,19024,19026,19026,19033,19039,19052,19070,19070,19163,19187,19195,19195,19200,19202,19266,19292,19336,19398,19398,19406,19418,19442,19442,19463,19463,19472,19472,19474,19474,19474,19492,19492,19494,19514,19514,19518,19520,19520,19521,19521,19542,19542,19555,19562,19619,19619,19789,19789,19821,19824,19853,19853,19859,19859,19888,19903,19940,19940,19947,19961,19969,19985,19985,19985,19986,19987,19987,19993,19993,19993,19997,20008,20008,20014,20014,20023,20023,20023,20026,20037,20041,20048,20051,20095,20159,20163,20170,20170,20177,20230,20230,20324,20390,20455,20482,20482,20487,20580,20673,20673,20673) 101 org.opensearch.remotestore.RemoteStoreRefreshListenerIT.testRemoteRefreshRetryOnFailure (18020,18054,18060,18063,18074,18074,18074,18107,18110,18126,18143,18163,18182,18193,18205,18219,18225,18225,18230,18260,18269,18285,18293,18313,18338,18338,18348,18361,18371,18371,18379,18385,18393,18393,18467,18541,18541,18541,18543,18583,18611,18611,18612,18612,18624,18672,18705,18705,18712,18727,18727,18728,18728,18738,18763,18763,18766,18782,18782,18817,18817,18817,18821,18823,18823,18833,18852,18873,18873,18968,18977,18981,18981,19019,19021,19052,19052,19056,19056,19062,19107,19133,19168,19171,19171,19198,19198,19238,19282,19341,19359,19359,19388,19422,19454,19454,19459,19503,19509,19509,19968) 75 org.opensearch.cluster.allocation.AwarenessAllocationIT.testThreeZoneOneReplicaWithForceZoneValueAndLoadAwareness (18021,18040,18042,18072,18150,18255,18320,18335,18377,18412,18425,18497,18516,18575,18606,18624,18627,18630,18724,18728,18804,18805,18808,18900,18950,18999,19056,19069,19080,19101,19118,19188,19233,19245,19276,19289,19308,19321,19343,19399,19428,19430,19475,19644,19652,19654,19681,19684,19693,19698,19730,19757,19761,19767,19866,19870,19901,19904,19960,19978,19999,20040,20080,20089,20178,20291,20322,20330,20352,20402,20529,20598,20604,20644,20676) 65 org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithInvokeFlush (19251,19251,19272,19277,19329,19329,19331,19331,19335,19343,19358,19372,19373,19373,19373,19568,19582,19598,19607,19626,19650,19653,19659,19670,19674,19679,19727,19752,19759,19785,19814,19830,19833,19854,19857,19875,19917,19919,19923,19960,19968,19999,20043,20078,20105,20162,20165,20222,20225,20261,20296,20312,20315,20325,20378,20386,20394,20399,20405,20408,20424,20573,20575,20596,20602) 54 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPressureServiceStats (18040,18043,18057,18067,18088,18187,18197,18197,18198,18198,18207,18207,18207,18210,18222,18285,18286,18286,18294,18294,18294,18296,18356,18373,18375,18375,18393,18393,18397,18401,18415,18415,18427,18435,18505,18506,18509,18569,18577,18577,18605,18626,18645,18645,18654,18671,18696,18696,18716,18716,18716,18727,18727,20646) 50 org.opensearch.cluster.service.MasterServiceTests.classMethod (18106,18106,18184,18184,18379,18379,18563,18563,18568,18568,18575,18575,18672,18672,18723,18723,18738,18738,19013,19013,19013,19013,19056,19056,19056,19056,19094,19094,19397,19397,19397,19397,19397,19397,19541,19541,19633,19633,19718,19718,19825,19825,19825,19825,20298,20298,20305,20305,20613,20613) 48 org.opensearch.indices.replication.SegmentReplicationIT.testScrollCreatedOnReplica (18029,18048,18060,18140,18232,18324,18365,18404,18409,18539,18596,18627,18629,18727,18730,18757,18834,19172,19193,19242,19336,19356,19405,19441,19492,19586,19597,19626,19631,19698,19731,19742,19767,19879,19910,19952,19975,19978,20043,20162,20213,20223,20240,20273,20313,20449,20530,20647) 45 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testBasicTaskResourceTracking (18044,18113,18143,18193,18213,18265,18269,18360,18385,18467,18497,18611,18833,18857,18871,18895,19048,19094,19181,19199,19233,19358,19368,19534,19613,19619,19671,19752,19888,19897,19919,19950,19955,19960,19997,20175,20220,20230,20231,20288,20317,20320,20392,20644,20663) 44 org.opensearch.cluster.routing.MovePrimaryFirstTests.testClusterGreenAfterPartialRelocation (18013,18176,18200,18201,18209,18228,18233,18236,18237,18573,18574,18582,18587,18592,18593,18604,18697,18718,18740,18742,18743,18747,18750,18756,18835,18843,18844,18851,18855,19161,19173,19174,20020,20100,20174,20238,20247,20264,20383,20456,20463,20486,20572,20650) 44 org.opensearch.cluster.routing.MovePrimaryFirstTests.classMethod (18013,18176,18200,18201,18209,18228,18233,18236,18237,18573,18574,18582,18587,18592,18593,18604,18697,18718,18740,18742,18743,18747,18750,18756,18835,18843,18844,18851,18855,19161,19173,19174,20020,20100,20174,20238,20247,20264,20383,20456,20463,20486,20572,20650) 42 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.classMethod (18492,18492,18667,18667,18808,18808,18818,18818,19008,19008,19038,19038,19354,19354,19369,19369,19396,19396,19449,19449,19501,19501,19653,19653,19862,19862,19875,19875,19942,19942,20046,20046,20091,20091,20230,20230,20240,20240,20298,20298,20443,20443) 38 org.opensearch.snapshots.DedicatedClusterSnapshotRestoreIT.testIndexDeletionDuringSnapshotCreationInQueue (18005,18015,18128,18143,18207,18222,18224,18260,18265,18353,18405,18425,18542,18763,18821,18823,18951,19048,19080,19276,19366,19395,19508,19601,19730,19751,19901,19904,19924,20026,20031,20050,20118,20129,20348,20484,20545,20655) 35 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocation (18499,18633,18645,18660,18979,19014,19021,19118,19135,19142,19330,19418,19539,19713,19720,19854,19859,19887,19887,19891,19935,19941,19967,20007,20071,20085,20145,20179,20240,20330,20399,20484,20525,20525,20557) 34 org.opensearch.remotestore.multipart.RemoteStoreMultipartIT.testStaleCommitDeletionWithInvokeFlush (19917,19919,19942,19960,19965,19967,19968,19984,20043,20063,20070,20078,20126,20135,20165,20165,20168,20259,20261,20262,20298,20315,20325,20333,20366,20378,20392,20399,20405,20476,20540,20567,20573,20596) 34 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.classMethod (18048,18048,18404,18404,18616,18616,19054,19054,19119,19119,19156,19156,19331,19331,19331,19331,19395,19395,19584,19584,19629,19629,19681,19681,19718,19718,19733,19733,19825,19825,19844,19844,19937,19937) 33 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreInSameRemoteStoreEnabledIndex (18537,18550,18555,18575,18577,18595,18596,18611,18620,18628,18630,18660,18680,18680,18705,18727,18728,18738,18739,18757,18758,18775,18801,18842,18842,18989,18991,19004,19013,19016,19061,19068,19127) 30 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testPressureServiceStats (18492,18808,18818,19008,19038,19272,19354,19369,19396,19449,19501,19613,19862,19875,19909,19909,19909,19964,19967,19967,20091,20298,20304,20304,20312,20364,20364,20364,20443,20443) 30 org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithoutInvokeFlush (19243,19251,19276,19294,19308,19318,19319,19325,19329,19330,19331,19341,19350,19354,19358,19358,19369,19373,19373,19389,19433,19441,19591,19623,19650,19733,19742,19785,19785,19788) 27 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocationWithSegRepFailure (18027,18610,19061,19289,19323,19343,19358,19636,19759,19764,19919,19919,19919,19935,20023,20058,20071,20089,20089,20261,20283,20399,20531,20671,20671,20675,20681) 26 org.opensearch.search.backpressure.SearchBackpressureIT.testSearchShardTaskCancellationWithHighCpu (18015,18023,18029,18031,18034,18044,18048,18051,18062,18085,18110,18115,18120,18122,18131,18137,18149,18152,18184,18185,18193,18213,18246,18270,18333,18429) 25 org.opensearch.cluster.service.MasterServiceTests.testThrottlingForMultipleTaskTypes (18106,18184,18379,18563,18568,18575,18672,18723,18738,19013,19013,19056,19056,19094,19397,19397,19397,19541,19633,19718,19825,19825,20298,20305,20613) 23 org.opensearch.search.SearchWeightedRoutingIT.testSearchAggregationWithNetworkDisruption_FailOpenEnabled (18221,18327,18381,18420,18563,18628,18757,19008,19060,19077,19313,19388,19455,19640,19759,19858,19875,20062,20149,20149,20179,20276,20476) 23 org.opensearch.cluster.allocation.ClusterRerouteIT.testDelayWithALargeAmountOfShards (18131,18139,18324,18342,18403,18467,18489,18725,18804,18841,19109,19198,19334,19497,19517,19660,19833,19991,20052,20141,20276,20331,20405) 20 org.opensearch.search.backpressure.SearchBackpressureIT.testSearchTaskCancellationWithHighCpu (18001,18004,18005,18016,18032,18042,18045,18053,18060,18063,18072,18083,18107,18119,18128,18156,18195,18273,18320,18430) 20 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testStartReplicationListenerSuccess (18011,18039,18060,18114,18196,18224,18255,18283,18296,18340,18373,18397,18410,18981,19004,19016,19192,19290,19422,19514) 18 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicaHasDiffFilesThanPrimary (18645,18700,18700,18700,18730,18739,18782,18810,19016,19171,19171,19266,19391,19482,19550,19725,20646,20680) 17 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPitCreatedOnReplica (18308,18833,18834,18888,19092,19318,19321,19504,19519,19635,19661,19737,19761,19914,19964,20008,20313) 16 org.opensearch.indices.replication.SegmentReplicationIT.testDropPrimaryDuringReplication (19451,19477,19551,19570,19657,19670,19704,19733,19733,20094,20339,20511,20522,20522,20541,20675) 16 org.opensearch.index.IndexSettingsTests.testDefaultSearchPipelineWithoutFeatureFlag (20320,20361,20366,20372,20376,20377,20378,20386,20392,20394,20395,20396,20397,20402,20404,20408) 15 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testCancellation (18467,18517,19056,19062,19395,19395,19614,19850,19978,20123,20168,20168,20367,20378,20487) 13 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testRelocateWhileContinuouslyIndexingAndWaitingForRefresh (18680,18680,19783,19901,19913,19997,20118,20157,20163,20177,20240,20288,20288) 12 org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=pit/10_basic/Delete all} (18042,18088,18182,18738,18782,18989,19209,19463,19731,20449,20557,20644) 12 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPrimaryStopped_ReplicaPromoted (18244,18258,18841,19199,19517,19551,19623,19651,19935,19958,20145,20306) 12 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.classMethod (18085,18085,18364,18364,18974,18974,19356,19356,19558,19558,19608,19608) 12 org.opensearch.index.IndexServiceTests.testAsyncTranslogTrimTaskOnClosedIndex (18027,18079,18728,18900,19063,19504,19578,19678,19875,20386,20423,20490) 10 org.opensearch.indices.replication.SegmentReplicationIT.testPitCreatedOnReplica (18022,19549,19619,19706,19718,19956,19958,20107,20367,20397) 10 org.opensearch.gateway.RecoveryFromGatewayIT.testReuseInFileBasedPeerRecovery (18039,18220,18265,19308,19373,19418,19495,19555,19664,20229) 9 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreRemoteStoreIndicesWithoutRemoteTranslog (18534,18542,18580,18680,18766,18861,18977,19009,19108) 9 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreRemoteStoreIndicesWithRemoteTranslog (18531,18534,18542,18680,18766,18861,18861,18920,19108) 9 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessAfterFailureInFirstAttemptAfterSnapshotAndMetadataUpload (18048,18404,18616,19054,19119,19156,19733,19825,20339) 9 org.opensearch.index.reindex.BulkByScrollResponseTests.testFromXContent (20020,20100,20174,20238,20247,20264,20383,20486,20572) 8 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testReplicaHasDiffFilesThanPrimary (19062,20404,20443,20476,20476,20493,20493,20523) 8 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testShardAlreadyReplicating (19984,20235,20469,20503,20525,20556,20580,20613) 8 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnThirdAttemptAttempt (19308,19348,19436,19436,19436,19511,19511,19927) 8 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testTaskResourceTrackingDuringTaskCancellation (18276,18415,18489,19062,19817,19952,20074,20590) 7 org.opensearch.search.SearchTimeoutIT.testSimpleTimeout (19539,19774,19834,20168,20352,20529,20580) 7 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testCancelPrimaryAllocation (18206,19202,19205,19385,19672,20487,20638) 7 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testDropPrimaryDuringReplication (19935,20063,20157,20229,20229,20229,20240) 7 org.opensearch.indices.replication.SegmentReplicationIT.testReplicationPostDeleteAndForceMerge (18042,18127,19133,19249,19555,19678,20165) 7 org.opensearch.indices.replication.SegmentReplicationAllocationIT.testSingleIndexShardAllocation (18120,18712,18871,19211,19242,19974,20672) 6 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testRestartPrimary (18120,18144,18685,20001,20044,20095) 6 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testScrollWithConcurrentIndexAndSearch (19653,19698,19942,20046,20230,20240) 6 org.opensearch.remotestore.CreateRemoteIndexClusterDefaultDocRep.testRemoteStoreTranslogDisabledByUser (18039,18313,18365,19519,19942,20647) 6 org.opensearch.indices.replication.SegmentReplicationIT.testCancellation (18624,18781,18953,19127,19159,19562) 6 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshAfterCommit (19331,19331,19395,19584,19681,19718) 6 org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT.testIndexCreateBlockIsRemovedWhenAnyNodesNotExceedHighWatermarkWithAutoReleaseEnabled (18225,18672,18757,19311,19945,20618) 6 org.opensearch.cluster.metadata.IndexGraveyardTests.testXContent (20020,20100,20174,20247,20486,20572) 5 org.opensearch.upgrade.DetectEsInstallationTaskTests.testTaskExecution (18697,18697,18697,18843,18843) 5 org.opensearch.search.pit.DeletePitMultiNodeIT.testDeleteWhileSearch (18115,18611,19785,19967,20506) 5 org.opensearch.search.ConcurrentSegmentSearchTimeoutIT.testSimpleTimeout (19536,19578,20098,20275,20635) 5 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testScrollCreatedOnReplica (20443,20443,20484,20522,20530) 5 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetSegmentFiles (18085,19356,19608,19888,19937) 5 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnSecondAttempt (19008,19330,19373,19426,19445) 4 org.opensearch.search.aggregations.bucket.DoubleTermsIT.classMethod (19070,19070,19070,19070) 4 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testReadRangeBlobWithRetries (19106,19108,19183,19736) 4 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testReadNonexistentBlobThrowsNoSuchFileException (18205,18871,19251,19690) 4 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testReadBlobWithRetries (19118,19494,19658,20138) 4 org.opensearch.remotestore.multipart.RemoteStoreMultipartIT.testStaleCommitDeletionWithoutInvokeFlush (20078,20122,20129,20141) 4 org.opensearch.indices.replication.SegmentReplicationIT.classMethod (20367,20397,20449,20625) 3 org.opensearch.test.rest.ClientYamlTestSuiteIT.test {p0=search.aggregation/20_terms/string profiler via global ordinals} (18220,19650,19792) 3 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreShallowCopySnapshotWithDifferentRepo (18815,18823,18842) 3 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testSnapshotAndRestore (18054,19422,19651) 3 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testWriteBlobWithRetries (19250,19564,19887) 3 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testReplicationAfterForceMerge (19166,19995,20286) 3 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testPrimaryStopped_ReplicaPromoted (19485,19771,20298) 3 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testPitCreatedOnReplica (20450,20476,20523) 3 org.opensearch.remotestore.CreateRemoteIndexIT.testRemoteStoreOverrideTranslogDisabledCorrectly (19368,19898,20051) 3 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetCheckpointMetadata (18364,19558,20042) 3 org.opensearch.index.translog.RemoteFSTranslogTests.testMetadataFileDeletion (19430,19610,20548) 3 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testAfterCommit (19629,19844,19937) 3 org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting (18185,18230,18365) 3 org.opensearch.http.SearchRestCancellationIT.testAutomaticCancellationDuringFetchPhase (18821,19941,20424) 3 org.opensearch.cluster.ClusterHealthIT.testHealthOnClusterManagerFailover (19184,19924,20313) 3 org.opensearch.client.ReindexIT.testReindexTask (18275,18342,19718) 3 org.opensearch.client.PitIT.testDeleteAllAndListAllPits (18195,19195,20663) 2 org.opensearch.snapshots.SnapshotStatusApisIT.testStatusAPIStatsForBackToBackShallowSnapshot (20063,20450) 2 org.opensearch.snapshots.SnapshotStatusApisIT.testStatusAPICallForShallowCopySnapshot (19914,19988) 2 org.opensearch.snapshots.CloneSnapshotIT.testCloneShallowSnapshotIndex (19553,19610) 2 org.opensearch.snapshots.CloneSnapshotIT.testCloneAfterRepoShallowSettingDisabled (19466,19811) 2 org.opensearch.search.SearchWeightedRoutingIT.testShardRoutingWithNetworkDisruption_FailOpenEnabled (20298,20482) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testWriteRead (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testSnapshotWithLargeSegmentFiles (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testMultipleSnapshotAndRollback (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testDeleteBlobs (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.classMethod (19184,19788) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testSnapshotWithLargeSegmentFiles (18054,19651) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testList (18054,19651) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testIndicesDeletedFromRepository (18054,19651) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testDeleteBlobs (18054,19651) 2 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.classMethod (20646,20646) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testRestartPrimary (19491,19997) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testReplicationPostDeleteAndForceMerge (18763,20511) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testIndexReopenClose (18667,20109) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testCancelPrimaryAllocation (19093,20516) 2 org.opensearch.remotestore.RemoteStoreStatsIT.testDownloadStatsCorrectnessSinglePrimarySingleReplica (20395,20395) 2 org.opensearch.remotestore.RemoteStoreStatsIT.testDownloadStatsCorrectnessSinglePrimaryMultipleReplicaShards (20396,20518) 2 org.opensearch.remotestore.RemoteStoreIT.testRemoteTranslogCleanup (18800,18800) 2 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.classMethod (19628,19628) 2 org.opensearch.monitor.fs.FsHealthServiceTests.testFailsHealthOnHungIOBeyondHealthyTimeout (20596,20604) 2 org.opensearch.indices.replication.SegmentReplicationRelocationIT.classMethod (20525,20671) 2 org.opensearch.index.ShardIndexingPressureIT.testShardIndexingPressureTrackingDuringBulkWrites (18234,19704) 2 org.opensearch.http.netty4.Netty4HttpServerTransportTests.testLargeCompressedResponse (18697,18756) 2 org.opensearch.common.util.concurrent.QueueResizableOpenSearchThreadPoolExecutorTests.classMethod (19264,19264) 2 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search/90_search_after/date} (19480,19480) 2 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=pit/10_basic/Delete all} (19454,20390) 2 org.opensearch.action.admin.indices.create.CreateIndexIT.testCreateAndDeleteIndexConcurrently (18056,18403) 2 org.opensearch.action.admin.indices.create.CreateIndexIT.classMethod (18056,18403) 2 org.opensearch.action.admin.cluster.tasks.PendingTasksBlocksIT.testPendingTasksWithClusterNotRecoveredBlock (19442,19959) 1 org.opensearch.snapshots.SnapshotStatusApisIT.testStatusAPICallInProgressShallowSnapshot (20056) 1 org.opensearch.snapshots.SnapshotStatusApisIT.testCorrectCountsForDoneShards (19988) 1 org.opensearch.search.basic.SearchWithRandomIOExceptionsIT.testRandomDirectoryIOExceptions (18396) 1 org.opensearch.search.basic.SearchWithRandomIOExceptionsIT.classMethod (18396) 1 org.opensearch.search.aggregations.metrics.CardinalityIT.classMethod (19720) 1 org.opensearch.search.aggregations.bucket.terms.StringTermsIT.classMethod (19731) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testReadNonExistingPath (19788) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testList (19184) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testIndicesDeletedFromRepository (19184) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testContainerCreationAndDeletion (19788) 1 org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.classMethod (19329) 1 org.opensearch.repositories.gcs.GoogleCloudStorageBlobContainerRetriesTests.testReadBlobWithPrematureConnectionClose (19608) 1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testWriteRead (18054) 1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testReadNonExistingPath (18136) 1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testMultipleSnapshotAndRollback (18054) 1 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testWriteLargeBlob (20168) 1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicationAfterPrimaryRefreshAndFlush (19934) 1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicationAfterForceMerge (20612) 1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testIndexReopenClose (20036) 1 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testNodeDropWithOngoingReplication (20476) 1 org.opensearch.remotestore.RemoteStoreStatsIT.testStatsResponseFromLocalNode (20525) 1 org.opensearch.remotestore.RemoteStoreStatsIT.testStatsOnShardUnassigned (20396) 1 org.opensearch.remotestore.RemoteStoreStatsIT.testStatsOnRemoteStoreRestore (20395) 1 org.opensearch.remotestore.RemoteStoreIT.testRemoteSegmentCleanup (18800) 1 org.opensearch.remotestore.RemoteStoreBackpressureIT.testWritesRejectedDueToTimeLagBreach (19162) 1 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing (19628) 1 org.opensearch.remotestore.CreateRemoteIndexTranslogDisabledIT.testRemoteStoreTranslogDisabledByUser (18115) 1 org.opensearch.remotestore.CreateRemoteIndexTranslogDisabledIT.testDefaultRemoteStoreNoUserOverride (20313) 1 org.opensearch.remotestore.CreateRemoteIndexIT.testRemoteStoreTranslogDisabledByUser (18833) 1 org.opensearch.remotestore.CreateRemoteIndexIT.testRemoteStoreOverrideTranslogRepoCorrectly (19761) 1 org.opensearch.remotestore.CreateRemoteIndexIT.classMethod (19761) 1 org.opensearch.recovery.ReplicationCollectionTests.testStartMultipleReplicationsForSingleShard (19465) 1 org.opensearch.indices.state.CloseWhileRelocatingShardsIT.testCloseWhileRelocatingShards (19939) 1 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testsSuccessfulReplication_listenerCompletes (19433) 1 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testOnNewCheckpointFromNewPrimaryCancelOngoingReplication (19577) 1 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.classMethod (19577) 1 org.opensearch.indices.replication.SegmentReplicationIT.testScrollWithConcurrentIndexAndSearch (19914) 1 org.opensearch.indices.replication.SegmentReplicationIT.testReplicationAfterPrimaryRefreshAndFlush (20625) 1 org.opensearch.indices.replication.SegmentReplicationIT.testReplicaHasDiffFilesThanPrimary (20165) 1 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetSegmentFilesFailure (20006) 1 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetCheckpointMetadataFailure (18974) 1 org.opensearch.indices.DateMathIndexExpressionsIntegrationIT.testIndexNameDateMathExpressions (18136) 1 org.opensearch.indices.DateMathIndexExpressionsIntegrationIT.testAutoCreateIndexWithDateMathExpression (19475) 1 org.opensearch.index.translog.RemoteFSTranslogTests.testConcurrentWriteViewsAndSnapshot (19887) 1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnThirdAttempt (19937) 1 org.opensearch.index.shard.IndexShardIT.testIndexCanChangeCustomDataPath (18136) 1 org.opensearch.index.reindex.UpdateByQueryBasicTests.testMultipleSources (19092) 1 org.opensearch.index.reindex.DeleteByQueryBasicTests.testMultipleSources (20675) 1 org.opensearch.index.ShardIndexingPressureSettingsIT.classMethod (18230) 1 org.opensearch.index.SegmentReplicationPressureIT.testBelowReplicaLimit (20074) 1 org.opensearch.index.SegmentReplicationPressureIT.testAddReplicaWhileWritesBlocked (20213) 1 org.opensearch.http.SearchRestCancellationIT.testAutomaticCancellationMultiSearchDuringFetchPhase (18342) 1 org.opensearch.http.SearchRestCancellationIT.testAutomaticCancellationDuringQueryPhase (18034) 1 org.opensearch.gateway.ReplicaShardAllocatorIT.testPreferCopyWithHighestMatchingOperations (19021) 1 org.opensearch.common.util.concurrent.QueueResizableOpenSearchThreadPoolExecutorTests.testResizeQueueDown (19264) 1 org.opensearch.cluster.coordination.AwarenessAttributeDecommissionIT.testNodesRemovedAfterZoneDecommission_ClusterManagerNotInToBeDecommissionedZone (18166) 1 org.opensearch.client.ReindexIT.testDeleteByQueryTask (20604) 1 org.opensearch.client.PitIT.testCreateAndDeletePit (19195) 1 org.opensearch.blocks.SimpleBlocksIT.testAddBlockWhileDeletingIndices (19557) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=update/20_doc_upsert/Doc upsert} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=snapshot.restore/10_basic/Create a snapshot and then restore it} (19854) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search/330_fetch_fields/Test basic field retrieval} (18396) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/40_range/Empty Agg Body} (18133) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/270_median_absolute_deviation_metric/bad arguments} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/20_terms/string profiler via global ordinals} (19077) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/20_terms/Long test} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/100_avg_metric/Metadata test} (18396) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.stats/11_metric/Metric - _all include_segment_file_sizes} (18396) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.shrink/10_basic/Shrink index via API} (18806) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.get_settings/10_basic/Get /_settings with local flag} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.get/10_basic/Should return an exception when querying invalid indices} (18396) 1 org.opensearch.aliases.IndexAliasesIT.testSameAlias (19308) 1 org.opensearch.action.admin.indices.create.ShrinkIndexIT.testCreateShrinkIndex (20026)Related Issues
Resolves #8798
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.