Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

7dav new geo ids #1416

Merged
merged 10 commits into from
Jan 31, 2022
Merged

7dav new geo ids #1416

merged 10 commits into from
Jan 31, 2022

Conversation

qx-teo
Copy link
Contributor

@qx-teo qx-teo commented Dec 10, 2021

Description

7dav signals give NA values for the first 6 days a new geo_id is introduced, as there is not enough data for the smoother. We fix this by shifting the check to dynamic checks, and checking row by row (ignoring the first 6 rows of each geo_id in the checking window)

Changelog

Itemize code/test/documentation changes and files added/removed.

  • dynamic.py
  • test_dynamic.py
  • static.py
  • test_static.py

Moved check_val_missing to dynamic checks.
Increased granularity, now informs for each geo_id+date combination for missing values
Ignores first 6 days of the checking period since 7dav signals return NAs as part of smoothing
Move check_na_values to test_dynamic, changed test assertions to fit
Keeping error_name as check_val_missing for easier processing, shifted relavant info to message
Added na value outside of checking range to test for filtering
Apply filter to df to only consider dates within the checking window
Test dataframe had time_value in the wrong type, should be datetime.date
@qx-teo
Copy link
Contributor Author

qx-teo commented Jan 20, 2022

@nmdefries this should be fixed now, failing test as a result of #1477

@krivard krivard merged commit dbea6ad into main Jan 31, 2022
@krivard krivard deleted the 7dav_new_geo_ids branch January 31, 2022 19:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants