ci: Add test case for hdfs over gcs bucket

[ArmandoZ]

Issue: #3504

Adds test case for hdfs over gcs bucket. Tested locally with my own gcs bucket.

TODO: Need to change how we obtain secret information from the test case (please see comments in code)

[Xuanwo]

Workflow: https://github.com/apache/opendal/actions/runs/7811201570/job/21305944190?pr=4167

2024-02-07 07:15:21,938 ERROR conf.Configuration: error parsing conf core-site.xml
com.ctc.wstx.exc.WstxParsingException: Illegal processing instruction target ("xml"); xml (case insensitive) is reserved by the specs.
 at [row,col,system-id]: [21,5,"file:/home/runner/hadoop-3.3.5/etc/hadoop/core-site.xml"]
	at com.ctc.wstx.sr.StreamScanner.constructWfcException(StreamScanner.java:634)
	at com.ctc.wstx.sr.StreamScanner.throwParseError(StreamScanner.java:504)
	at com.ctc.wstx.sr.BasicStreamReader.readPIPrimary(BasicStreamReader.java:4004)
	at com.ctc.wstx.sr.BasicStreamReader.nextFromProlog(BasicStreamReader.java:2138)
	at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1179)
	at org.apache.hadoop.conf.Configuration$Parser.parseNext(Configuration.java:3405)
	at org.apache.hadoop.conf.Configuration$Parser.parse(Configuration.java:3191)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:3084)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:3045)
	at org.apache.hadoop.conf.Configuration.loadProps(Configuration.java:2923)
	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2905)
	at org.apache.hadoop.conf.Configuration.get(Configuration.java:1247)
	at org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1301)
	at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1527)
	at org.apache.hadoop.fs.FileSystem$Cache.<init>(FileSystem.java:3615)
	at org.apache.hadoop.fs.FileSystem.<clinit>(FileSystem.java:206)
could not find method getRootCauseMessage from class (null) with signature (Ljava/lang/Throwable;)Ljava/lang/String;
could not find method getStackTrace from class (null) with signature (Ljava/lang/Throwable;)Ljava/lang/String;

[ArmandoZ]

Workflow: https://github.com/apache/opendal/actions/runs/7811201570/job/21305944190?pr=4167

Got it. I'm looking into that. Will let you know when ready to run again.

[Xuanwo]

Test failed for:

hdfsBuilderConnect(forceNewInstance=0, nn=gs://***, port=0, kerbTicketCachePath=(NULL), userName=(NULL)) error:
UnsupportedFileSystemException: No FileSystem for scheme "gs"org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "gs"
	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3546)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3569)
	at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3673)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3624)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557)
	at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:278)
	at org.apache.hadoop.fs.FileSystem$1.run(FileSystem.java:275)
	at java.base/java.security.AccessController.doPrivileged(Native Method)
	at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:275)

[ArmandoZ]

Test failed for:

Direct reason is hadoop didn't read the gcs-connector jar library. Probably need to set HADOOP_CLASSPATH under ci environment to read that. Updated.

[Xuanwo]

Test passed! Thanks a lot for your work!

[Xuanwo]

Thanks!

[ArmandoZ]

Sounds great! Thanks for the support!