New pattern submission - API GW to SQS to Lambda to DynamoDB

[ravikirang28]

Description

New Serverless pattern for building an API endpoint for asynchronous processing. This pattern explains how to deploy a SAM application with Amazon API Gateway, Amazon SQS, AWS Lambda, and Amazon DynamoDB.

Language

Python

Framework

SAM

Description

This pattern explains how to deploy a SAM application with Amazon API Gateway, Amazon SQS, AWS Lambda, and Amazon DynamoDB. This pattern can be used as an example for building APIs which responds to requests quickly and offloads the processing to reliable and scalable serverless components.

• This pattern deploys an Amazon API Gateway HTTP API with route /submit configured with basic authentication.
• On receiving a request, API Gateway will invoke a Lambda authorizer which validates the request and returns a policy informing API Gateway to accept or deny the request. Basic auth is used here for simplicity but lambda authorizer can be even used to authorize requests with any IDP of choice.
• When request is accepted, API Gateway sends the message payload to a queue in SQS. SQS uses another queue as Dead Letter Queue to send the messages in case of continued failures to process the messages from downstream lambda.
• Messages from SQS is posted to a lambda function to process them.
• Lambda function receives the messages from SQS and saves them into a DynamoDB table.

Deployment commands

sam deploy --guided

GitHub PR for template:

#1480

Payload example

Example POST Request: https://{HttpApiEndpoint}.execute-api.us-east-1.amazonaws.com/submit

• Request Header: "Content-Type: application/json"
• Request Header: "Authorization: Basic " (where credentials is the Base64 encoding of ID and password joined by a single colon :)
• Request Body: {"eventId":"value1", "message":"event message for testing"}

Additional Resources

Lambda Authorizers
Amazon SQS dead-letter queues
Working with HTTP APIs

Author bio

Name: Ravi Kiran Ganji
Description (up to 255 chars): I am a Senior Cloud Application Architect at AWS Professional Services, and Serverless Enthusiast.