Skip to content

YARN-11200 numa support in branch-2.10 #4587

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 28, 2022
Merged

YARN-11200 numa support in branch-2.10 #4587

merged 1 commit into from
Jul 28, 2022

Conversation

Samrat002
Copy link
Contributor

Description of PR

YARN-11200

How was this patch tested?

tested patch in the EMR cluster (5.x series)

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 15m 38s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 29s Maven dependency ordering for branch
+1 💚 mvninstall 13m 14s branch-2.10 passed
+1 💚 compile 7m 42s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 38s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 40s branch-2.10 passed
+1 💚 mvnsite 3m 45s branch-2.10 passed
+1 💚 javadoc 3m 35s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 17s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 7s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 28s Maven dependency ordering for patch
+1 💚 mvninstall 1m 53s the patch passed
-1 ❌ compile 1m 34s /patch-compile-hadoop-yarn-project_hadoop-yarn-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-yarn in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
-1 ❌ javac 1m 34s /patch-compile-hadoop-yarn-project_hadoop-yarn-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-yarn in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
+1 💚 compile 6m 6s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 6m 6s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 30s /results-checkstyle-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn-project/hadoop-yarn: The patch generated 6 new + 187 unchanged - 0 fixed = 193 total (was 187)
+1 💚 mvnsite 3m 18s the patch passed
-1 ❌ javadoc 0m 59s /results-javadoc-javadoc-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-jdkAzulSystems,Inc.-1.7.0_262-b10 with JDK Azul Systems, Inc.-1.7.0_262-b10 generated 1 new + 2 unchanged - 0 fixed = 3 total (was 2)
+1 💚 javadoc 2m 52s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 5m 53s the patch passed
_ Other Tests _
+1 💚 unit 1m 8s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 48s hadoop-yarn-common in the patch passed.
-1 ❌ unit 16m 12s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 8s The patch does not generate ASF License warnings.
121m 21s
Reason Tests
Failed junit tests hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestNumaResourceHandlerImpl
hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestNumaResourceAllocator
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/1/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux c9030cf8bcc7 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / addad56
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/1/testReport/
Max. process+thread count 179 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/1/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 8m 34s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 26s Maven dependency ordering for branch
+1 💚 mvninstall 13m 15s branch-2.10 passed
+1 💚 compile 7m 46s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 36s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 40s branch-2.10 passed
+1 💚 mvnsite 3m 43s branch-2.10 passed
+1 💚 javadoc 3m 36s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 16s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 4s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 27s Maven dependency ordering for patch
+1 💚 mvninstall 1m 52s the patch passed
-1 ❌ compile 2m 6s /patch-compile-hadoop-yarn-project_hadoop-yarn-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-yarn in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
-1 ❌ javac 2m 6s /patch-compile-hadoop-yarn-project_hadoop-yarn-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-yarn in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
+1 💚 compile 6m 4s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 6m 4s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 29s /results-checkstyle-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 186 unchanged - 0 fixed = 187 total (was 186)
+1 💚 mvnsite 3m 17s the patch passed
+1 💚 javadoc 3m 8s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 52s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 5m 54s the patch passed
_ Other Tests _
+1 💚 unit 1m 10s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 49s hadoop-yarn-common in the patch passed.
+1 💚 unit 16m 4s hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 7s The patch does not generate ASF License warnings.
114m 38s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/2/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux 24608df9e18e 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / 72727247687763b64e38b851ab8140c2e12bd603
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/2/testReport/
Max. process+thread count 178 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/2/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 37s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 53s Maven dependency ordering for branch
+1 💚 mvninstall 13m 20s branch-2.10 passed
+1 💚 compile 7m 38s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 40s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 40s branch-2.10 passed
+1 💚 mvnsite 3m 41s branch-2.10 passed
+1 💚 javadoc 3m 37s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 15s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 8s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 25s Maven dependency ordering for patch
+1 💚 mvninstall 1m 53s the patch passed
+1 💚 compile 6m 44s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javac 6m 44s the patch passed
+1 💚 compile 6m 34s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 6m 34s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 29s /results-checkstyle-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 186 unchanged - 0 fixed = 187 total (was 186)
+1 💚 mvnsite 3m 17s the patch passed
+1 💚 javadoc 3m 11s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 52s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 5m 52s the patch passed
_ Other Tests _
+1 💚 unit 1m 11s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 49s hadoop-yarn-common in the patch passed.
+1 💚 unit 16m 3s hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 6s The patch does not generate ASF License warnings.
111m 54s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/3/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux e32ed62f7668 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / 9da62bb85edc904dbcfbce70915a0971f4505223
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/3/testReport/
Max. process+thread count 184 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/3/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@Samrat002 Samrat002 changed the title YARN-11200 Backport numa to branch-2.10 YARN-11200 numa support in branch-2.10 Jul 19, 2022
@PrabhuJoseph
Copy link
Contributor

Thanks @Samrat002 for backporting the patch. Could you fix the checkstyle issue.

@Samrat002 Samrat002 force-pushed the YARN-numa-backport branch from 13bea92 to 1dfe2d0 Compare July 24, 2022 12:45
@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 57s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 28s Maven dependency ordering for branch
+1 💚 mvninstall 13m 22s branch-2.10 passed
+1 💚 compile 7m 41s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 37s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 40s branch-2.10 passed
+1 💚 mvnsite 3m 46s branch-2.10 passed
+1 💚 javadoc 3m 36s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 16s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 7s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 29s Maven dependency ordering for patch
+1 💚 mvninstall 1m 54s the patch passed
+1 💚 compile 6m 51s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javac 6m 51s the patch passed
+1 💚 compile 6m 40s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 6m 40s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 29s /results-checkstyle-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 187 unchanged - 0 fixed = 188 total (was 187)
+1 💚 mvnsite 3m 18s the patch passed
+1 💚 javadoc 3m 7s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 47s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 5m 52s the patch passed
_ Other Tests _
+1 💚 unit 1m 11s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 48s hadoop-yarn-common in the patch passed.
+1 💚 unit 16m 13s hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 3s The patch does not generate ASF License warnings.
112m 31s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/6/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux a2533aa44817 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / 1dfe2d03300108f851b33852570bbd82b1f1964c
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/6/testReport/
Max. process+thread count 178 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/6/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 56s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 31s Maven dependency ordering for branch
+1 💚 mvninstall 13m 29s branch-2.10 passed
+1 💚 compile 7m 32s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 41s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 39s branch-2.10 passed
+1 💚 mvnsite 3m 38s branch-2.10 passed
+1 💚 javadoc 3m 37s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 18s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 7s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 26s Maven dependency ordering for patch
+1 💚 mvninstall 1m 53s the patch passed
+1 💚 compile 6m 48s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javac 6m 48s the patch passed
+1 💚 compile 6m 37s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 6m 37s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 1m 28s /results-checkstyle-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 187 unchanged - 0 fixed = 188 total (was 187)
+1 💚 mvnsite 3m 17s the patch passed
+1 💚 javadoc 3m 11s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 54s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 5m 50s the patch passed
_ Other Tests _
+1 💚 unit 1m 11s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 49s hadoop-yarn-common in the patch passed.
+1 💚 unit 16m 14s hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 8s The patch does not generate ASF License warnings.
112m 10s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/7/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux 925eb84a0d38 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / 9d522a48e8242b09c0ae354987e384554d29f755
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/7/testReport/
Max. process+thread count 185 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/7/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 8m 34s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 30s Maven dependency ordering for branch
+1 💚 mvninstall 13m 23s branch-2.10 passed
+1 💚 compile 7m 35s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 40s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 39s branch-2.10 passed
+1 💚 mvnsite 3m 43s branch-2.10 passed
+1 💚 javadoc 3m 38s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 17s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 5s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 29s Maven dependency ordering for patch
+1 💚 mvninstall 1m 52s the patch passed
+1 💚 compile 6m 47s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javac 6m 47s the patch passed
+1 💚 compile 6m 35s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 6m 35s the patch passed
+1 💚 blanks 0m 1s The patch has no blanks issues.
+1 💚 checkstyle 1m 29s the patch passed
+1 💚 mvnsite 3m 17s the patch passed
+1 💚 javadoc 3m 10s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 54s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 5m 52s the patch passed
_ Other Tests _
+1 💚 unit 1m 11s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 50s hadoop-yarn-common in the patch passed.
-1 ❌ unit 16m 6s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 7s The patch does not generate ASF License warnings.
120m 11s
Reason Tests
Failed junit tests hadoop.yarn.server.nodemanager.amrmproxy.TestFederationInterceptor
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/8/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux 90c6fa5a29fc 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / c12f934b31c0f181aa425f12730455065b0a012d
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/8/testReport/
Max. process+thread count 178 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/8/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@Samrat002 Samrat002 force-pushed the YARN-numa-backport branch from c12f934 to fcac6b3 Compare July 27, 2022 17:09
@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 9s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+0 🆗 detsecrets 0m 1s detect-secrets was not available.
+0 🆗 xmllint 0m 1s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 27s Maven dependency ordering for branch
+1 💚 mvninstall 14m 1s branch-2.10 passed
+1 💚 compile 7m 41s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 55s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 34s branch-2.10 passed
+1 💚 mvnsite 3m 27s branch-2.10 passed
+1 💚 javadoc 3m 20s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 8s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 10s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 25s Maven dependency ordering for patch
+1 💚 mvninstall 1m 52s the patch passed
+1 💚 compile 6m 48s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javac 6m 48s the patch passed
+1 💚 compile 7m 0s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 7m 0s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 31s the patch passed
+1 💚 mvnsite 3m 20s the patch passed
+1 💚 javadoc 3m 8s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 55s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 15s the patch passed
_ Other Tests _
+1 💚 unit 1m 12s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 50s hadoop-yarn-common in the patch passed.
+1 💚 unit 16m 6s hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 7s The patch does not generate ASF License warnings.
113m 22s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/10/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux 65b77e696592 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / c51ce6d41e660b9dfda0a31ff470accaa27b115b
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/10/testReport/
Max. process+thread count 179 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/10/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 44s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 30s Maven dependency ordering for branch
+1 💚 mvninstall 14m 4s branch-2.10 passed
+1 💚 compile 7m 41s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 7m 0s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 40s branch-2.10 passed
+1 💚 mvnsite 3m 32s branch-2.10 passed
+1 💚 javadoc 3m 27s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 7s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 16s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 26s Maven dependency ordering for patch
+1 💚 mvninstall 1m 56s the patch passed
+1 💚 compile 6m 55s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javac 6m 55s the patch passed
+1 💚 compile 6m 59s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 6m 59s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 33s the patch passed
+1 💚 mvnsite 3m 20s the patch passed
+1 💚 javadoc 3m 6s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 54s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 16s the patch passed
_ Other Tests _
+1 💚 unit 1m 12s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 51s hadoop-yarn-common in the patch passed.
+1 💚 unit 16m 6s hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 8s The patch does not generate ASF License warnings.
115m 16s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/9/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux e35044e8cdac 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / c51ce6d41e660b9dfda0a31ff470accaa27b115b
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/9/testReport/
Max. process+thread count 185 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/9/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@Samrat002
Copy link
Contributor Author

@PrabhuJoseph please review !
checkstyle warnings are fixed

@Samrat002
YARN-11200 Backport numa to branch-2.10
7558b54 
YARN-11200. Fix Test error

YARN-11200. Fix build error

fix package info checkstyle error

fix package info checkstyle error

fix package info checkstyle error

add package info

adding extra space

Triiger jenkins

Import correctly in package-info for numa
@Samrat002 Samrat002 force-pushed the YARN-numa-backport branch from c51ce6d to 7558b54 Compare July 28, 2022 05:17
@hadoop-yetus
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 54s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+0 🆗 xmllint 0m 0s xmllint was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ branch-2.10 Compile Tests _
+0 🆗 mvndep 3m 28s Maven dependency ordering for branch
+1 💚 mvninstall 13m 20s branch-2.10 passed
+1 💚 compile 7m 31s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 6m 38s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 1m 39s branch-2.10 passed
+1 💚 mvnsite 3m 44s branch-2.10 passed
+1 💚 javadoc 3m 36s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 3m 17s branch-2.10 passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 8s branch-2.10 passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 26s Maven dependency ordering for patch
+1 💚 mvninstall 1m 52s the patch passed
+1 💚 compile 6m 49s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javac 6m 49s the patch passed
+1 💚 compile 7m 52s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 javac 7m 52s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 26s the patch passed
+1 💚 mvnsite 3m 4s the patch passed
+1 💚 javadoc 3m 5s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 2m 52s the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
+1 💚 spotbugs 6m 12s the patch passed
_ Other Tests _
+1 💚 unit 1m 12s hadoop-yarn-api in the patch passed.
+1 💚 unit 3m 50s hadoop-yarn-common in the patch passed.
+1 💚 unit 16m 10s hadoop-yarn-server-nodemanager in the patch passed.
+1 💚 asflicense 1m 6s The patch does not generate ASF License warnings.
113m 16s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/11/artifact/out/Dockerfile
GITHUB PR #4587
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets xmllint
uname Linux 1ee49f02fe53 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / 7558b54
Default Java Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/11/testReport/
Max. process+thread count 179 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4587/11/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@PrabhuJoseph
Copy link
Contributor

Thanks @Samrat002 for the backport.

@PrabhuJoseph PrabhuJoseph merged commit 4200e5a into apache:branch-2.10 Jul 28, 2022
@Samrat002 Samrat002 deleted the YARN-numa-backport branch July 28, 2022 09:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Samrat002 @hadoop-yetus @PrabhuJoseph