Skip to content

TOROS Observatory Operations Pipeline running on Apache Airflow

Notifications You must be signed in to change notification settings

toros-astro/torosairflow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Toros Manager on Apache Airflow

Early prototype for the TOROS Manager using Apache Airflow pipeline framework. This only shows the pipeline concept.

Installation

Prerequisites:

  • git (you probably have it installed already)
  • Docker

Clone it locally:

git clone https://github.com/toros-astro/torosairflow
cd torosairflow

The first time you set it up, you have to run the initdb container while running postgres container in a different console.

In one terminal window type:

docker-compose up postgres

and wait for it to finish set up.

In a second terminal (check you're still in the torosairflow directory) type:

docker-compose up initdb

Once initdb exits cleanly, you can stop the postgres container of the previous step.

From now on, to run the pipeline simpy type:

docker-compose up

The webserver shold be running in http://localhost:8080.


(c) TOROS Dev Team

About

TOROS Observatory Operations Pipeline running on Apache Airflow

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published