Skip to content
This repository has been archived by the owner on Sep 26, 2023. It is now read-only.

Releases: snowplow-incubator/snowplow-snowflake-loader

Version 0.5.0

28 Aug 09:43
Compare
Choose a tag to compare

New features

  • Integrate the storage transformation bad rows type (#85)

Internal

  • Use explicit kryo class registration (#84)
  • Bump Snowplow Scala Analytics SDK to 0.4.1 (#87)

Version 0.4.2

03 Apr 15:11
Compare
Choose a tag to compare

New features

  • Truncate string values exceeding column's limits (#42)

Internal

  • Bump Scala Analytics SDK to 0.4.0 (#73)
  • Bump release-manager to 0.4.1 (#81)

Version 0.4.1

22 Feb 18:22
Compare
Choose a tag to compare

New features

  • Make it possible to selectively skip setup steps (#78)

Bug fixes

  • Revert VARCHAR precision removal (#80)

Version 0.4.0

17 Jan 17:28
Compare
Choose a tag to compare

Deduplication, stability and performance improvements.

New features

  • Add in-batch natural deduplication (#48)
  • Add cross-batch natural deduplication (#33)
  • Add table migration command (#68)
  • Add optional host property to configuration (#59)
  • Add ON_ERROR setting (#43)

Internal

  • Add a link to wiki to README (#65)
  • Update JDBC useragent to self-identify Snowplow (#52)
  • Update README markdown in according with CommonMark (#46)

Stability improvements

  • Use s3committer in Transformer (#67)
  • Recover DynamoDB on expired token exception (#51)
  • Fix silent skip for folder outside of a stage (#62)
  • Remove VARCHAR-precision when loading from temporary table (#54)
  • Truncate columns on loading (#55)
  • Widen geo_region to 3 characters (#58)
  • Setup of warehouse should set Auto Suspend to 5 mins and Auto Resume to true (#15)
  • Widen sensitive columns in atomic.events to support pseudonymization (#56)

Version 0.3.1

02 Feb 08:31
Compare
Choose a tag to compare

Hotfix release.

Bug fixes

  • Remove part-* pattern from Transformer (#44)

Version 0.3.0

28 Dec 19:08
Compare
Choose a tag to compare

First public release

New features

  • Allow loader to use temporary credentials (#37)
  • Allow JDBC credentials to be stored in EC2 parameter store (#36)
  • Allow loader to use the full AWS credentials chain (#32)
  • Use self-describing configuration (#19)
  • Add --dry-run option (#9)

Bug fixes

  • Fix loading of NULLs as strings (#14)
  • Bump Snowflake JDBC driver to 3.3.2 (#29)
  • Bump Scala Analytics SDK to 0.2.1 (#27)
  • Bump AWS SDK to 1.11.208 (#26)
  • Make SparkContext initializing eagerly (#24)

Licensing

  • Remove all references to Project Strawberry (#16)
  • Change License to Apache 2.0 (#34)

Under the hood

  • Use transaction for altering table and load (#25)
  • Add AWS credentials to stage (#20)

Version 0.2.0

05 Oct 11:47
Compare
Choose a tag to compare

Bug fixes

  • Change file format to JSON (#7)
  • Refactor getUnprocessed to use DynamoDB scan (#17)

Testing and deployment

  • Adde deployment to all snowplow-hosted-assets buckets (#4)
  • Create test specification to check atomic.events DDL correctness (#8)

Stability and other improvements

  • Add preliminary checks for Snowflake entities (#11)
  • Bump Snowflake JDBC to 3.2.5 (#2)
  • Add support for other regions (#6)
  • Improve load error message (#5)
  • Separate AWS region from Snowflake region (#12)

Version 0.1.0

31 Aug 13:41
Compare
Choose a tag to compare

Initial release