Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dekaf materialization endpoint support #1840

Draft
wants to merge 8 commits into
base: master
Choose a base branch
from

Conversation

jshearer
Copy link
Contributor

@jshearer jshearer commented Dec 18, 2024

Description:

(Describe the high level scope of new or changed features)

Workflow steps:

(How does one use this feature, and how has it changed)

Documentation links affected:

(list any documentation links that you created, or existing ones that you've identified as needing updates, along with a brief description)

Notes for reviewers:

(anything that might help someone review this PR)


This change is Reviewable

@jshearer jshearer force-pushed the jshearer/dekaf_materialization_endpoint_support branch 3 times, most recently from d81232a to 173b9a2 Compare January 6, 2025 15:42
* Connector projections: emit required constraints for all keys, and recommended constraints for all other fields
* Schema: Build a schema from the collection's projections that will match the extracted documents
* Extraction: Implement field extraction using the `extractors` crate to emit documents that match the collection's projections
@jshearer jshearer force-pushed the jshearer/dekaf_materialization_endpoint_support branch from 173b9a2 to 2528553 Compare January 6, 2025 19:14
… a Session and write them to the correct ops logs journal
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant