Data ingestion and feature preparation This directory contains notebooks and code for the data ingestion and feature preparation steps of the data pipeline. Step 1- Data Preparation Step 1 - Data Preparation, optimized with Spark's Higher Order Functions Step 2 - Feature Preparation