In this Project, We will build an ETL pipeline using the Spotify API on AWS.The pipeline will retrieve data from the spotify API,transform it to a different format and load it into a AWS data store.
- Integrating with Spotify API and extracting Data
- Deploying code on AWS Lambda for Data Extraction
- Adding trigger to run the extraction automatically
- Writing transformation function
- Building automated trigger on transformation function
- Store files on S3 properly
- Building Analytics Tables on data files using Glue and Athena
This dataset contains information about music, artist, albums and songs - Spotify API
- S3 (Simple Storage Service)
- AWS Lambda
- Cloudwatch
- Glue Crawler
- Data Catalog
- Amazon Athena