feat(bindings/go): Add full native support from C to Go.

[yuchanns]

PR for #4848.

Let's rock!

I'm so excited that I can't help but complete it all at once. If this is too big to review, I can split it into smaller chunks.

• Full implementation on top of C binding.
• All behavior tests except those not supported by C binding yet. writer, read_with, eg.
• Documentation for all APIs.

NOTE: this PR contains two experimental services memory and aliyun-drive to show how it works for behavior test purposes. Officially distributions need to be managed by @Xuanwo.

[yuchanns]

Bindings Go CI failed because the Go version is lower than 1.22.4 (1.20).

And considering 1.20 is out of maintenance, I think it is time to update to the latest version.

Each major Go release is supported until there are two newer major releases. For example, Go 1.5 was supported until the Go 1.7 release, and Go 1.6 was supported until the Go 1.8 release. We fix critical problems, including critical security problems, in supported releases as needed by issuing minor revisions (for example, Go 1.6.1, Go 1.6.2, and so on).

IMO we need to update the CI configuration because it is tailored for CGO.

Here is an example from my POC. It is really simple and easy.

[Xuanwo]

And considering 1.20 is out of maintenance, I think it is time to update to the latest version.

Great, welcome to bump the go version in a new PR.

[Xuanwo]

CGO_ENABLE=0!

[Xuanwo]

This PR is outstanding overall! Excellent implementation, well-documented, and comprehensive tests (fully integrated testing). This is the best PR I've encountered this year!

Let's first address the CI and merge it into the main branch, then we can refine the API naming and other details.

[Xuanwo]

Let's use github.com/apache/opendal/bindings/go so users can use go binding from git now.

[yuchanns]

I'm not sure whether go support get sub directory.

[yuchanns]

Oh it doesn't work.

[Xuanwo]

It doesn't work since we are now pointintg to opendal.apache.org/go. After we change our mod to github.com/apache/opendal/bindings/go. It should work.

[Xuanwo]

Ok, seems the ci changes need to go along with this PR.

[Zheaoli]

Here's my personal thought.

The original Go binding is a full-function and cross-platform binding. The new Go binding has a good tech design and the ability to extend the function. But for now, I think we need a lot of time to solve some issues, such as binary release and distribution and cross-platform test(for now, I believe we specialize in Linux), keep the service we support is same with the old Go bindings.

So I think maybe we can make this feature as experimental and we add a new directory binding/go-ffi and remove the binding/go-ffi when the new Go binding is ready?

[yuchanns]

seems the ci changes need to go along with this PR.

Yes. I closed it.

[yuchanns]

So I think maybe we can make this feature as experimental and we add a new directory binding/go-ffi and remove the binding/go-ffi when the new Go binding is ready?

I'm ok with that. But I don't think the old version is full functional. Seems it only implements read and write.

[Zheaoli]

I'm ok with that. But I don't think the old version is full functional. Seems it only implements read and write.

New Go Binding!

[yuchanns]

Benchmark is in absence. I should add one Later.

[Xuanwo]

Hi, @Zheaoli, Thanks a lot for raising your concern.

The original Go binding is a full-function and cross-platform binding.

This is incorrect. In fact, it cannot even be used with go get.

But for now, I think we need a lot of time to solve some issues, such as binary release and distribution and cross-platform test(for now, I believe we specialize in Linux), keep the service we support is same with the old Go bindings.

This is true. I have a feeling that we will finally reintroduce CGO support for other platforms. It would be great if someone could take on the task of making the Go bindings cross-platform and fully functional. However, if no one is interested, I'm satisfied with the Go bindings working on Linux platforms for now.

So I think maybe we can make this feature as experimental and we add a new directory binding/go-ffi and remove the binding/go-ffi when the new Go binding is ready?

The old Go binding has never been usable, published, or maintained. The most recent change to the Go binding was four months ago, with the latest meaningful update occurring on October 21, 2023. I prefer not to keep the old go binding unless someone steps up to help maintain it.

[Xuanwo]

Mostly LGTM, perfect PR!

[Xuanwo]

Hi, @Zheaoli, would you like to leave a final comment?

[Zheaoli]

LGTM