new feature: Support more storage services and APIs for Go bindings.

[diqiu50]

Feature Description

In Go, we are using OpenDAL to implement file and directory operations for storage systems such as S3, HDFS, GCS, OSS, and Azure Blob. We need to support the following features:

1. Go service support for HDFS, GCS, OSS, and Azure Blob.
2. Go service support for macOS.
3. The Go binding API should support the RangeBounds parameter in the Reader, as in the Rust version.

Problem and Solution

The main issues:

1. The backend storage systems does not support HDFS, GCS, OSS, and Azure Blob..
2. The Go binding API does not support offset-based read operation.

Additional Context

No response

Are you willing to contribute to the development of this feature?

• Yes, I am willing to contribute to the development of this feature.

[Xuanwo]

• Adding support for GCS, OSS, and Azblob should be straightforward, but HDFS requires some testing first.
• Adding macOS support should be easy as well, I suppose.
• Read and write support should be implemented in the C binding first.

cc @yuchanns, any comments?

[Xuanwo]

Enable services here should be enough: https://github.com/apache/opendal-go-services/blob/main/.github/scripts/matrix.yaml

[yuchanns]

Adding support for GCS, OSS, and Azblob should be straightforward, but HDFS requires some testing first.

Yes, for most of the features, it can be enabled by appending services to the matrix of the opendal-go-services.

Adding macOS support should be easy as well, I suppose.

It depends on https://github.com/jupiterrider/ffi. And yes, it requires little effort to support.

Read and write support should be implemented in the C binding first.

I'll take a look at it if nobody is interested.

[Xuanwo]

It depends on jupiterrider/ffi. And yes, it requires little effort to support.

Hi, @yuchanns, can our current workflow support macOS by simply adding macos-latest? Are there other things we need to do?

[yuchanns]

Hi, @yuchanns, can our current workflow support macOS by simply adding macos-latest? Are there other things we need to do?

I think so. And there are some works to do with opendal-go-services. We need to generate artifacts for both Darwin amd64 and arm64.