Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Apache Iceberg #1830

Open
mvgijssel opened this issue Jun 13, 2024 · 7 comments
Open

Support for Apache Iceberg #1830

mvgijssel opened this issue Jun 13, 2024 · 7 comments
Assignees

Comments

@mvgijssel
Copy link

Hi folks!

Not sure if this is the right place to ask, but are there plans to support Apache Iceberg natively? I understand it's possible to create a S3 peer to store files in the AVRO format, but this would still require an additional pipeline to convert those files for Apache Iceberg.

@serprex
Copy link
Contributor

serprex commented Jun 13, 2024

#1792

@mvgijssel
Copy link
Author

I need to learn how to search 🙈

@iamKunalGupta iamKunalGupta linked a pull request Jun 13, 2024 that will close this issue
10 tasks
@iamKunalGupta
Copy link
Member

iamKunalGupta commented Jun 14, 2024

Hi there @mvgijssel!
Just a quick question, what are you planning to use as the underlying iceberg catalog?

@mvgijssel
Copy link
Author

I was contemplating loading it into Snowflake Iceberg tables!

@iamKunalGupta
Copy link
Member

I was contemplating loading it into Snowflake Iceberg tables!

Are you planning to use the Snowflake Catalog or or use some other Catalog?

@mvgijssel
Copy link
Author

Snowflake catalog sounds the easiest! If that doesn’t work we can run our own / check if AWS has something.

@iamKunalGupta
Copy link
Member

#1697
#1869
#1870

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants