Version 1.4.0 (2020-10-21)

New experimental enrich asset (enrich-fs2 aka New Horizons), multiple bug fixes, all known Snyk Maven and Docker fixes, JDK11, new YAUAA context.

New features

• Stream FS2: add (#346)
• Common: add benchmarking module (#370)
• Common: add toThrift and toRaw methods to CollectorPayload (#345)

Bugfixes

• Common: switch to HostName.asInetAddress to validate IP addresses (#355)
• Common: fix NullPointerException on serializing invalid state (#371)
• Common: fix API Request Enrichment output deserialization (#374)
• Common: fix PiiPseudonymizerEnrichment for arrays and improve unit tests coverage (#334)
• Common: fix PII enrichment adding empty objects instead of missing properties (#351)
• Common: fix PathNotFoundException in PII enrichment (#339)
• Common: fix pattern matching against null in ScrambleMapFunction (#338)
• Common: fix flaky ThriftLoader test (#306)
• Common: handle empty query string parameters in adapters (#341)
• Common: get rid of placeholder schema in enrichment configurations (#302)

Dependency updates

• Beam: bump Scio to 0.9.3 (#308)
• Stream: bump log4j-core to 2.13.3 (#368)
• Stream: bump base-debian to 0.2.1 (#359)
• Common: bump scala-forex to 1.0.0 (#349)
• Common: bump scala-referer-parser to 1.1.0 (#348)
• Common: bump scala-weather to 1.0.0 (#347)
• Common: bump iglu-scala-client to 1.0.2 (#52)
• Common: bump scala-maxmind-iplookups to 0.7.1 (#323)
• Common: bump snowplow-badrows to 2.1.0 (#325)
• Common: bump YAUAA to 5.19 (#314)
• Common: bump postgresql to 42.2.16 (#369)
• Common: bump jackson-databind to 2.10.5 (#367)
• Common: bump to JDK 11 (#362)

Under the hood

• Beam: use test Maxmind databases (#269)
• Common: make assets publishing independent of each other (#373)
• Common: disable formatting on compile (#358)
• Common: add sbt publishLocal operation to test action (#357)
• Common: replace deprecated constructors in EnrichedEventSpec (#354)
• Common: improve unit tests coverage (#335)
• Common: use test Maxmind databases (#350)
• Common: move EnrichmentConf into its own module (#303)
• Common: get rid of Eval instances (#300)
• Common: add tests for Input for SQL enrichment (#316)
• Stream: remove unused Maxmind database (#352)

Version 1.3.2 (2020-09-06)

Bugfix release, affecting IAB and SQL Query enrichments.

• Discourse post

Bugfixes

• Common: convert null fields in EnrichedEvent to None in PartiallyEnrichedEvent (#331)
• Common: skip the SQL enrichment on null placeholders (#315)
• Beam: check that IP address is valid IPv4 or IPv6 before passing to IAB enrichment (#329)

Under the hood

• Beam: fix unit tests failing after update of MaxMind database (#327)

Version 1.3.1 (2020-07-28)

A couple of bug-fixes on common enrich library and updated base image for Beam Enrich:

• Common: fix JS enrichment failing without return statement (#295)
• Beam: bump k8s-dataflow to 0.2.0 (#293)
• Common: Skip sql enrichment on null values as placeholders (#291)

Version 1.3.0 (2020-07-14)

First release in unified repository with dependency bumps and bugfixes.

Common

• Fix ClassCastException with multi-thread access (#278)
• Replace use of erasure with runtimeClass (#252)
• Enable IP Lookup Enrichment for IPv6 with port number (#284)
• Enable IAB Enrichment for IPv6 (#282)
• Bump iab-spiders-and-robots-client to 0.2.0 (#262)
• Bump scalafmt to 2.6.1 (#265)
• Bump sbt-scalafmt to 2.4.0 (#264)
• Use Nashorn instead of Rhino for JS enrichment (#138)
• Bump SBT to 1.3.12 (#6)
• Bump Scala to 2.12.11 (#7)
• Apply automated code formatting for all projects (#263)

Beam

• Reduce MaximumRecordSize to 6900000 bytes (#287)
• Make metrics optional (#285)
• Bump scio to 0.9.2 (#277)

Stream

• Bump amazon-kinesis-client to 1.13.3 (#286)