Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for S3 multipart upload API #142

Closed
sajithshn opened this issue Aug 11, 2020 · 1 comment
Closed

Add support for S3 multipart upload API #142

sajithshn opened this issue Aug 11, 2020 · 1 comment

Comments

@sajithshn
Copy link
Contributor

Amazon S3 has a multipart API that lets users upload objects as multiple parts and finally merge them to form a single object. This functionality is really useful when it comes to strong event streams in (near) realtime to S3 objects.

Add support for use this API in the S3 connector (https://github.com/siddhi-io/siddhi-io-s3) of Streaming Integrator

Please refer [1] and [2] for more information

[1] - https://docs.aws.amazon.com/AmazonS3/latest/dev/usingHLmpuJava.html
[2] - https://docs.aws.amazon.com/AmazonS3/latest/dev/mpListPartsJavaAPI.html

@Anvesh9265
Copy link

I tried uploading a pdf into s3bukcet by sending it as encoded in request and decoding the encoded message in esb level and creating object in s3 bucket using s3 connector of 2.0.4 latest version but the file is creating with decoded content only but not in its format. so does connector allows only message data in file content field or it can also create the object with the content provided

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants