Remove a field that isn't parsing to resolve dbt errors #3502
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This field
holiday_website__from_provider_
is causing problems with ingestion. I don't think we need it so let's remove it to resolve the errors:19:36:31 Error while reading table: cal-itp-data-infra-staging.external_airtable.california_transit__services, error message: JSON parsing error in row starting at position 4758: Array specified for non-repeated field: holiday_website__from_provider_. File: gs://test-calitp-airtable/california_transit__services/dt=2024-10-15/ts=2024-10-15T17:37:25.484855+00:00/services.jsonl.gz 19:36:31 compiled Code at target/run/calitp_warehouse/models/intermediate/transit_database/dimensions/int_transit_database__services_dim.sql
Describe your changes and why you're making them. Please include the context, motivation, and relevant dependencies.
Resolves #3487
Type of change
How has this been tested?
Post-merge follow-ups
Document any actions that must be taken post-merge to deploy or otherwise implement the changes in this PR (for example, running a full refresh of some incremental model in dbt). If these actions will take more than a few hours after the merge or if they will be completed by someone other than the PR author, please create a dedicated follow-up issue and link it here to track resolution.
Double check dbt errors on the next day to make sure it's resolved.