HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail #3028

snehavarma · 2021-05-20T11:07:35Z

PR to add new configuration of appendblob with HNS accounts.

Testing done: It was ensured that the xml gets generated with the append blob config and runs successfully.

hadoop-yetus · 2021-05-20T12:20:07Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 54s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	33m 42s		trunk passed
+1 💚	mvnsite	0m 40s		trunk passed
+1 💚	shadedclient	16m 9s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 31s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	0m 30s		the patch passed
+1 💚	shellcheck	0m 1s		No new issues.
+1 💚	shadedclient	15m 50s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	0m 31s		hadoop-azure in the patch passed.
+1 💚	asflicense	0m 31s		The patch does not generate ASF License warnings.
		71m 16s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/1/artifact/out/Dockerfile
GITHUB PR	#3028
Optional Tests	dupname asflicense mvnsite unit codespell shellcheck shelldocs
uname	Linux 6596ffcd4d12 4.15.0-142-generic #146-Ubuntu SMP Tue Apr 13 01:11:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `6b3c9db`
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/1/testReport/
Max. process+thread count	576 (vs. ulimit of 5500)
modules	C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/1/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

snvijaya · 2021-05-21T04:33:51Z

hadoop-tools/hadoop-azure/dev-support/testrun-scripts/runtests.sh

 combination=NonHNS-SharedKey
-properties=("fs.azure.abfs.account.name" "fs.azure.test.namespace.enabled" "fs.azure.account.auth.type")
-values=("{account name}.dfs.core.windows.net" "false" "SharedKey")
+properties=("fs.azure.abfs.account.name" "fs.azure.test.namespace.enabled" "fs.azure.account.auth.type"


A new combination called AppendBlob-HNS-OAuth needs to be added. It will have all properties of HNS OAuth + append blob test config.

Leave current set of combination untouched.

snvijaya

Please check comments.

snehavarma · 2021-05-21T11:42:15Z

Testing done: It was ensured that the xml gets generated with the append blob config and runs successfully

hadoop-yetus · 2021-05-21T12:44:28Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 52s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	33m 36s		trunk passed
+1 💚	mvnsite	0m 40s		trunk passed
+1 💚	shadedclient	16m 10s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 32s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	0m 30s		the patch passed
+1 💚	shellcheck	0m 1s		No new issues.
+1 💚	shadedclient	15m 32s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	0m 35s		hadoop-azure in the patch passed.
+1 💚	asflicense	0m 33s		The patch does not generate ASF License warnings.
		70m 57s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/2/artifact/out/Dockerfile
GITHUB PR	#3028
Optional Tests	dupname asflicense mvnsite unit codespell shellcheck shelldocs
uname	Linux 486d414f4b02 4.15.0-142-generic #146-Ubuntu SMP Tue Apr 13 01:11:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `0dfa5f3`
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/2/testReport/
Max. process+thread count	599 (vs. ulimit of 5500)
modules	C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/2/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2021-05-24T10:57:04Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 49s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+1 💚	mvninstall	33m 38s		trunk passed
+1 💚	mvnsite	0m 36s		trunk passed
+1 💚	shadedclient	15m 48s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+1 💚	mvninstall	0m 28s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	0m 28s		the patch passed
+1 💚	shellcheck	0m 1s		No new issues.
+1 💚	shadedclient	15m 26s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	0m 29s		hadoop-azure in the patch passed.
+1 💚	asflicense	0m 29s		The patch does not generate ASF License warnings.
		70m 5s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/3/artifact/out/Dockerfile
GITHUB PR	#3028
Optional Tests	dupname asflicense mvnsite unit codespell shellcheck shelldocs
uname	Linux d1957e55fc9d 4.15.0-142-generic #146-Ubuntu SMP Tue Apr 13 01:11:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `b403f01`
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/3/testReport/
Max. process+thread count	597 (vs. ulimit of 5500)
modules	C: hadoop-tools/hadoop-azure U: hadoop-tools/hadoop-azure
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3028/3/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

surendralilhore · 2021-06-09T05:23:40Z

+1

surendralilhore · 2021-06-09T06:44:17Z

Committed to trunk, please raise PR for 3.2 and 3.3

…he#3028) (cherry picked from commit 4c039fa)

… (#3125) (cherry picked from commit 4c039fa)

…he#3028)

…ts fail (apache#3028) (apache#3125) (cherry picked from commit 4c039fa) Change-Id: I3779f49f1c60efc03d4483c3bde7ce94d5743f8c

Setting appendblob enabled to false for NonHNS combination

6b3c9db

vinaysbadami approved these changes May 20, 2021

View reviewed changes

snvijaya reviewed May 21, 2021

View reviewed changes

snvijaya suggested changes May 21, 2021

View reviewed changes

Incorporating the comments

0dfa5f3

Merge branch 'apache:trunk' into HADOOP-17715

b403f01

bilaharith approved these changes May 25, 2021

View reviewed changes

surendralilhore merged commit 4c039fa into apache:trunk Jun 9, 2021

snehavarma added a commit to snehavarma/hadoop that referenced this pull request Jun 21, 2021

HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail (apac…

580f742

…he#3028) (cherry picked from commit 4c039fa)

surendralilhore pushed a commit that referenced this pull request Jul 12, 2021

HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail (#3028)…

ab3809c

… (#3125) (cherry picked from commit 4c039fa)

kiran-maturi pushed a commit to kiran-maturi/hadoop that referenced this pull request Nov 24, 2021

HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail (apac…

5d2657e

…he#3028)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail #3028

HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail #3028

Uh oh!

snehavarma commented May 20, 2021 •

edited

Loading

Uh oh!

hadoop-yetus commented May 20, 2021

Uh oh!

snvijaya May 21, 2021

Uh oh!

snehavarma May 21, 2021

Uh oh!

snvijaya left a comment

Uh oh!

snehavarma commented May 21, 2021

Uh oh!

hadoop-yetus commented May 21, 2021

Uh oh!

hadoop-yetus commented May 24, 2021

Uh oh!

surendralilhore commented Jun 9, 2021

Uh oh!

surendralilhore commented Jun 9, 2021

Uh oh!

Uh oh!

HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail #3028

HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail #3028

Uh oh!

Conversation

snehavarma commented May 20, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hadoop-yetus commented May 20, 2021

Uh oh!

snvijaya May 21, 2021

Choose a reason for hiding this comment

Uh oh!

snehavarma May 21, 2021

Choose a reason for hiding this comment

Uh oh!

snvijaya left a comment

Choose a reason for hiding this comment

Uh oh!

snehavarma commented May 21, 2021

Uh oh!

hadoop-yetus commented May 21, 2021

Uh oh!

hadoop-yetus commented May 24, 2021

Uh oh!

surendralilhore commented Jun 9, 2021

Uh oh!

surendralilhore commented Jun 9, 2021

Uh oh!

Uh oh!

snehavarma commented May 20, 2021 •

edited

Loading