Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

new feature: Options API for object_store #5115

Open
1 task
linhr opened this issue Sep 12, 2024 · 1 comment
Open
1 task

new feature: Options API for object_store #5115

linhr opened this issue Sep 12, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@linhr
Copy link

linhr commented Sep 12, 2024

Feature Description

The object_store::ObjectStore trait has APIs such as put_opts(), put_multipart_opts() and get_opts(). It would be desirable to implement these APIs in the OpenDAL integration.

Problem and Solution

In the OpenDAL integration, these APIs return an "unimplemented" error, since #3713. I guess it might be possible to process the object_store options in the arguments and convert them to OpenDAL operations. I'm not sure if all the options can be supported though.

Additional Context

I'm using Apache DataFusion to build query engines. DataFusion uses the object_store::ObjectStore trait and its options API, and I'd like to adapt it to OpenDAL so that more data sources can be integrated.

Are you willing to contribute to the development of this feature?

  • Yes, I am willing to contribute to the development of this feature.
@linhr linhr added the enhancement New feature or request label Sep 12, 2024
@Xuanwo
Copy link
Member

Xuanwo commented Sep 12, 2024

Thank you very much for completing this. I will look into the API to see how we can implement it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants