Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP : DNM : Kinesis Integration #254

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

boneill42
Copy link

Just putting this up as a place holder for now. I may have time to hack on this over the next couple days, and will try to fold in the work we've done.

@Gauravshah
Copy link

working on similar code :) should have opened a pull request

@boneill42
Copy link
Author

@Gauravshah I'm happy to close this one and contribute to yours?
Or if you want to merge into this one, have at it.

@Gauravshah
Copy link

Gauravshah commented Oct 16, 2017 via email

@Gauravshah
Copy link

@boneill42 please have a look at https://github.com/druid-io/tranquility/compare/master...GoshPosh:kinesis?expand=1 , should give some directions if you need something.

@gianm
Copy link
Member

gianm commented Oct 25, 2017

@boneill42 is this still WIP or are you ready for review?

@boneill42
Copy link
Author

Still WIP... i have the rest of the code, just didn't push it up yet. Give me until the end of the weekend (10/29).

@gianm
Copy link
Member

gianm commented Oct 25, 2017

No rush, was just curious

@guptaraul89
Copy link

I am looking for kinesis to druid connectors. Is there any way possible / any documents to ingest data into druid from Kinesis data streams?

@boneill42
Copy link
Author

boneill42 commented Jan 18, 2018 via email

@guptaraul89
Copy link

Awesome! thank you. Sent you an email.

@Gauravshah
Copy link

@gianm should we consider building something similar to http://druid.io/docs/0.9.1.1/development/extensions-core/kafka-ingestion.html for kinesis instead of doing it on tranquility ?

@boneill42
Copy link
Author

@Gauravshah I believe that's the plan (pull vs. push model), which is honestly why I haven't spent a ton of time getting this in a stage to merge. The pull model is the way to go.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants