Fix handling of columns with Decimal data type in delta input source #17376
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The Delta Decimal type wasn't handled correctly in the Druid Delta connector, resulting in the error:
Unsupported fieldType[Decimal(4, 2)] for fieldName[price]
.There were no tests or existing tables with the Decimal type, so I've updated the existing table,
complex-types-table
to include this data type.Note that the Decimal type can only be handled as a double at most in Druid. For a big decimal that cannot fit inside a double, it should be ingested as a string.
Release note
Fix handling of columns with Decimal data type in the
delta
input source.