Skip to content

Commit

Permalink
Add data quality tooling to the "what and why" of dagster (#22269)
Browse files Browse the repository at this point in the history
This is one of the first pages users see when coming to dagster; feels
important to reference data quality here.
  • Loading branch information
dpeng817 authored Jun 6, 2024
1 parent 9c002c4 commit 5c7568d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/content/getting-started/what-why-dagster.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ Dagster’s asset-centric approach to building data pipelines makes it easy to:

- **Understand how an asset - like a database table or report - is produced.** Everyone in your organization can understand the data lineage and how data assets relate to each other, even if they didn’t build the pipeline themselves.
- **Determine if an asset is up to date.** It’s easy to tell exactly why assets are out-of-date, whether it might be late upstream data or errors in code.
- **Diagnose data quality issues.** Building data quality checks into your pipelines is straightforward, and you can be notified automatically when data quality issues arise.
- **Standardize best practices.** [Software-defined Assets (SDAs)](/concepts/assets/software-defined-assets), the Dagster concept that produces data assets, are a unifying abstraction across all data teams. SDAs enable easier collaboration and rapid adoption of best practices such as domain-specific languages, continuous integration, local development, and testing.
- **Simplify debugging.** Every run and computation is tied to the goal of producing data, so debugging tools like logs are specific to the assets being produced. When something goes wrong, you can quickly identify the problematic asset, address it, and only need to re-execute that asset.

Expand Down

1 comment on commit 5c7568d

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Deploy preview for dagster-docs ready!

✅ Preview
https://dagster-docs-jnitzrvfh-elementl.vercel.app
https://master.dagster.dagster-docs.io

Built with commit 5c7568d.
This pull request is being automatically deployed with vercel-action

Please sign in to comment.