Adding a pattern to copy an object between two S3 buckets using S3 Event Notification to SQS to EventBridge Pipes to Step Function #2087
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ent Notification to SQS to EventBridge Pipes to Step Function resolves: aws-samples#2086
|
@dastra Thanks for your contribution. Tested it and looks good. |
parikhudit
reviewed
Feb 28, 2024
| @@ -0,0 +1,61 @@ | |||
| { | |||
| "title": "Copy an object between two S3 buckets using S3 Event Notification to SQS to EventBridge Pipes to Step Function", | |||
There was a problem hiding this comment.
Length needs to be below 75 characters
parikhudit
reviewed
Feb 28, 2024
| @@ -0,0 +1,61 @@ | |||
| { | |||
| "title": "Copy an object between two S3 buckets using S3 Event Notification to SQS to EventBridge Pipes to Step Function", | |||
| "description": "Create a Step Functions workflow to query Amazon Athena.", | |||
There was a problem hiding this comment.
Could you kindly update this?
parikhudit
reviewed
Feb 28, 2024
| "name": "Dan Straw", | ||
| "image": "https://avatars.githubusercontent.com/u/271028", | ||
| "bio": "Senior Solutions Architect at AWS", | ||
| "linkedin": "https://www.linkedin.com/in/danstraw/" |
There was a problem hiding this comment.
only LinkedIn id is required e.g. danstraw
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Issue #, if available: #2086
Description of changes:
This sample project demonstrates how to copy an object between two S3 buckets and manipulate it in transit. When an object is created in the source S3 bucket, an S3 Event Notification is fires and enqueued onto an SQS Queue. The EventBridge service polls the SQS Queue and invokes an EventBridge pipe. The EventBridge Pipe then executes an AWS Step Functions Express Workflow state machine. This copies the file from the source S3 Bucket to the destination S3 Bucket. In a real world scenario the state machine would be modified to manipulate the file as desired
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.