The most important change in this release is removing the dependency on list schemas endpoint of Iglu repos. This change makes it possible to use static Iglu registries with RDB Loader.
Another notable change in this release is that columns are prefixed with an underscore in Databricks Loader if the column name starts with a number, e.g. 1_my_field becomes _1_my_field.
Additionally, we've upgraded some of the dependencies to fix some vulnerabilities and fixed a problem that causes NPEs in the Batch Transformer.
Changelog
- Upgrade dependencies to fix some vulnerabilities (#1364)
- Fix NPEs in TypesAccumulator (#1363)
- Create migration for only max schema key of the same schema model (#1360)
- Transformer Stream: don't use hard-coded window timestamps in the tests (#1360)
- Use lookupSchemasUntil function instead of listSchemasLike function (#1360)
- Upgrade schema-ddl to 0.25.0 (#1362)