Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)
-
Updated
Feb 27, 2024 - Python
#
airflow-docker
Here are 134 public repositories matching this topic...
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
python aws uber power-bi data-engineering data-modeling aws-redshift airflow-docker uber-data apache-airflow etl-pipeline uber-eats expenses-dashboard expenses-tracker
-
Updated
Jun 29, 2022 - Jupyter Notebook
Sync DAG changes from Git to Airflow
-
Updated
Sep 10, 2024
An open-source project dedicated to constructing robust data pipelines and scalable software infrastructure. We leverage industry-standard tools favored by developers to enhance efficiency and reliability. Uniquely, these pipelines are field-tested on farms across Sumatra, Indonesia, ensuring real-world applicability and resilience.
portfolio computer-vision django-application software-engineering traefik stem airflow-docker dataengineering django-docker ultralytics
-
Updated
May 27, 2024 - Python
Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/
docker redis distributed-systems airflow aws-s3 scheduler celery docker-airflow airflow-docker gcp-container-builder work-manager
-
Updated
Jun 2, 2019 - Python
My self-learning about Apache Airflow
-
Updated
Jul 13, 2022 - Python
Airflow Pipeline for Machine Learning
nlp data-science machine-learning airflow pipeline docker-compose transformers airflow-docker mlops huggingface zero-shot-classification
-
Updated
May 25, 2023 - Python
Apache Airflow Guide
python airflow awesome big-data distributed data-engineering business-intelligence awesome-list airflow-plugin airflow-docker awesome-resources business-analytics airflow-dags airflow-operators
-
Updated
May 7, 2024 - Python
🎵 LyricWave - Your AI Music Composer 🎶 Compose Unique MP4 Songs Effortlessly! LyricWave uses AI to create personalized music by harmonizing lyrics with captivating melodies and synthetic vocals. Unleash your musical creativity today! 🚀🎶
docker flask airflow mongodb docker-compose pytorch celery music-generation flask-api airflow-docker apache-airflow airflow-dags huggingface airflow-operators huggingface-transformers music-processing stable-diffusion suno-ai musicgen audiocraft
-
Updated
Mar 26, 2024 - Python
This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and workflows.
python docker yaml airflow sql superset data-engineering workflows airflow-docker treasuredata apache-superset airflow-dags wsl2 airflow-testing sample-dags airflow-community
-
Updated
Feb 9, 2024 - Python
An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS application using Apache Airflow as an orchestration tool and various data warehouse technologies and finally using Apache Superset to connect to DWH for generating BI dashboards for weekly reports
airflow pyspark datawarehouse airflow-docker dataengineering amazon-s3 posgresql azure-blob-storage etl-pipeline apache-superset bi-dashboards
-
Updated
Dec 7, 2022 - Python
From data gathering to model deployment. Complete ML pipeline using Docker, Airflow and Python.
python docker machine-learning airflow tutorial sklearn regression tutorials airflow-docker ml-pipeline
-
Updated
Oct 10, 2023 - Python
Docker for airflow with mysql as backend
-
Updated
Nov 15, 2018 - Shell
Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator
docker bigquery airflow etl docker-compose google-cloud-storage data-warehouse airflow-docker etl-pipeline
-
Updated
May 23, 2021 - Python
Quick Docker Compose deployment for Apache Airflow version 2.x. Ideal for local development
docker-airflow airflow-docker apache-airflow airflow-deployment celery-executor airflow-docker-containers docker-compose-airflow
-
Updated
Sep 13, 2022 - Shell
In this project, you will be building a Twitter Scheduler using Apache Airflow on Docker.
-
Updated
Aug 29, 2020 - Python
An airflow deployment configuration with sane defaults
-
Updated
Jun 6, 2019 - Python
A starting point for a data stack using Python, Apache Airflow and Metabase.
python docker template data-science airflow stack sphinx metabase data-engineering airflow-docker data-stack airflow-dags doccano
-
Updated
Dec 8, 2022 - Python
Run Apache Airflow using Docker containers
-
Updated
Sep 5, 2018 - Python
Tools to streamline Jupyter Notebook Prototypes into robust Data Products
-
Updated
Dec 26, 2022 - Python
Improve this page
Add a description, image, and links to the airflow-docker topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the airflow-docker topic, visit your repo's landing page and select "manage topics."