New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

use views for staging and refresh only in CI deployments #525

Draft

pnadolny13 wants to merge 1 commit into main from use_views_better

Contributor

pnadolny13 commented Jan 18, 2023 •

edited

Loading

consistently make all staging models views
when we deploy in CI we should refresh our views, similar to seed. Then following that we dont need to keep rebuilding the views.
add a test for slack notifications for consistency

TODO:

still need to figure out staging jobs, they dont need to run daily after EL if they are views. Maybe just run tests
consider going to opposite direction too and making all staging models tables to break pipeline if source tests fail before exposing to downstream models. Bad data wont make it to staging table then.


          use views for staging and refresh only in CI deployments

223dbab

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet