Skip to content

Commit

Permalink
Merge pull request #72 from Matts966/fix/doc
Browse files Browse the repository at this point in the history
Updated doc
  • Loading branch information
Matts966 authored Oct 17, 2021
2 parents e5f7f9f + 5a712d0 commit 0da2dc7
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 1 deletion.
10 changes: 9 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ wget -P $temp https://github.com/Matts966/alphasql/releases/latest/download/alph

## Extract DAG from SQL set

`alphadag` finds dependencies between table references and create table statements.
`alphadag` finds dependencies between table references and create table statements, function calls and create function statements.

```bash
# To extract DAG from your SQL set
Expand Down Expand Up @@ -98,8 +98,14 @@ You can resolve side effects such as `INSERT` and `UPDATE` statements before sim

You can extract dependencies containing tables and functions by `--with_tables` and `--with_functions` options.

#### With tables

![dag.dot](./samples/sample/with_all/dag.png)

### With functions

![dag.dot](./samples/sample-function-dependency/with_all/dag.png)

## Parallel Execution

For BigQuery, the output DAG can be run parallely using
Expand All @@ -109,6 +115,8 @@ For BigQuery, the output DAG can be run parallely using

### bq-airflow-dag-generator

![airflow DAG](./samples/airflow.png)

`bq-airflow-dag-generator` as Python package can generate Airflow DAG by simple Python script.

```Python
Expand Down
Binary file added samples/airflow.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 0da2dc7

Please sign in to comment.