Skip to content

Commit

Permalink
Generate DAG docs
Browse files Browse the repository at this point in the history
  • Loading branch information
sarayourfriend committed May 24, 2023
1 parent 843f272 commit ded9ff1
Show file tree
Hide file tree
Showing 2 changed files with 10 additions and 7 deletions.
8 changes: 5 additions & 3 deletions catalog/DAGs.md
Original file line number Diff line number Diff line change
Expand Up @@ -669,10 +669,12 @@ It runs on Saturdays at 00:00 UTC in order to happen before the data refresh.
The DAG will automatically delete the oldest snapshots when more snaphots exist
than it is configured to retain.

Requires two variables:
Relies on three variables:

`AIRFLOW_RDS_ARN`: The ARN of the RDS DB instance that needs snapshots.
`AIRFLOW_RDS_SNAPSHOTS_TO_RETAIN`: How many historical snapshots to retain.
`CATALOG_RDS_DB_IDENTIFIER`: (Required) The "DBIdentifier" of the RDS DB
instance. `CATALOG_RDS_SNAPSHOTS_TO_RETAIN`: (Required) How many historical
snapshots to retain. `CATALOG_RDS_REGION`: (Optional) The region of the RDS DB
instance. Defaults to `us-east-1`.

## `science_museum_workflow`

Expand Down
9 changes: 5 additions & 4 deletions catalog/dags/maintenance/rotate_db_snapshots.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,12 @@
The DAG will automatically delete the oldest snapshots when more snaphots
exist than it is configured to retain.
Requires three variables:
Relies on three variables:
`CATALOG_RDS_DB_IDENTIFIER`: The "DBIdentifier" of the RDS DB instance.
`CATALOG_RDS_SNAPSHOTS_TO_RETAIN`: How many historical snapshots to retain.
`CATALOG_RDS_REGION`: The region of the RDS DB instance.
`CATALOG_RDS_DB_IDENTIFIER`: (Required) The "DBIdentifier" of the RDS DB instance.
`CATALOG_RDS_SNAPSHOTS_TO_RETAIN`: (Required) How many historical snapshots to retain.
`CATALOG_RDS_REGION`: (Optional) The region of the RDS DB instance. Defaults to
`us-east-1`.
"""

import logging
Expand Down

0 comments on commit ded9ff1

Please sign in to comment.