Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhancement request: add checks of CDM *_datetime fields #490

Open
TomWhite-MedStar opened this issue Sep 29, 2023 · 0 comments
Open

enhancement request: add checks of CDM *_datetime fields #490

TomWhite-MedStar opened this issue Sep 29, 2023 · 0 comments
Labels
new check New DQ check to be added

Comments

@TomWhite-MedStar
Copy link
Contributor

Some data sources contain timestamp information and are able to populate the *_datetime fields. However, there is no easy way to assess which sources do so.

There are two classes of datetime rules that might be helpful:

  1. Validation/Conformance (?): When datetime fields are populated, does their date component match that of the comparable date field? Possible rule: CAST(field_datetime AS DATE) = field_date
  2. Validation/Completeness (?): When datetime fields are populated, do they have a non-zero time component? Possible rule: (CAST(field_datetime AS DATE) = field_date) AND (field_datetime > field_date)

This information would be helpful for:

  • Internal ETL efforts
  • External sharing of profiled datasets so that network users know which data sources are possible candidates for phenotypes and analyses that require datetime logic.
@katy-sadowski katy-sadowski added the new check New DQ check to be added label Sep 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new check New DQ check to be added
Projects
None yet
Development

No branches or pull requests

2 participants