3.7.3

Enrich now ignores (during validation) HTTP resources defined in $ref keyword in Iglu schemas, avoiding expensive external lookups.

Changelog

• enrich-pubsub: check max message attricutes length (#782)
• common: upgrade iglu-scala-client to 1.3.1 (#781)

3.7.2

This release adds ability to decode base64-encoded events if initial Thrift serialization fails.

Changelog

• Try to base64 decode event if initial Thrift serialization fails (#777)

3.7.1

A patch release that bumps dependencies for potential security vulnerabilities.

Changelog

• Bump net.minidev json-smart to 2.4.10 (#771)

3.7.0

Starting from this version, it is now possible to use environment variables in all the config files of the app (application hocon, resolver, enrichments).

It also bumps YAUAA to the latest version, so that it correctly detects Chrome 109.

Last but not least, SQL, API and JS enrichment are now activated in the integration tests on Github Actions and we've added a cache for UA parser enrichment that will improve its performance.

Changelog

• common: bump http4s to 0.21.34 (#744)
• common: bump postgresql to 42.5.2 (#743)
• common: bump netty to 4.1.87.Final (#742)
• common: bump yauaa to 7.11.0 (#741)
• enrich-kinesis: activate JS enrichment, SQL enrichment and API request enrichment in integration tests (#724)
• common: parse Iglu resolver and enrichment configs as HOCON instead of JSON (#736)
• Add UA parser enrichment cache (#738)

Version 3.6.1

Enrich 3.6.1 updates the YAUAA to 7.9.0 because of CVE-2022-23496. Also, it bumps Iglu Scala Client to 1.3.0.

Full changelog

• common: bump iglu scala client to 1.3.0 (#734)
• common: Update Yauaa to 7.9.0 (#734)

Version 3.6.0

Enrich 3.6.0 updates the YAUAA enrichment to support Client Hints and improves the Sendgrid adapter to remove duplicate events from a payload.

Full changelog

• common: Prune system libs from distroless image (#728)
• common: remove duplicates from Sendgrid adapter payload (#725)
• common: Upgrade yauaa to 7.x (#639)

Version 3.5.1

This is a maintenance release, to upgrade dependencies to newer versions

Changelog

• enrich-kinesis: exclude aws glue libs from the build (#722)
• common: bump slf4j to 2.0.3 (#721)
• enrich-pubsub: bump GCP sdk to 2.14.0 (#719)
• common: bump netty to 4.1.84.Final (#718)
• common: bump protobuf-java to 3.21.9 (#717)
• common: bump jackson-databind to 2.13.4.2 (#716)
• common: bump commons-text to 1.10.0 (#715)
• enrich-kinsis: bump amazon-kinesis-client to 2.4.3 (#714)
• enrich-kinesis: exclude amazon-kinesis-producer from build (#713)
• enrich-kinesis: add integration tests with localstack and testcontainers (#706)
• common: use correct event id for PII event's parent context (#709)
• common: bump specs2 to 4.17.0 (#707)
• common: remove common info from v_etl (#704)

3.5.0

This release introduces enrich-kafka, the newest member of 2nd generation enrich apps, following enrich-kinesis and enrich-pubsub!

enrich-kafka is cloud agnostic which means that it can run on AWS, on GCP, on Azure, on-premise or on localhost. Both enrich-kafka and recently announced enrich-rabbitmq-experimental enable us to run Snowplow pipeline anywhere.

Instructions to setup and configure enrich can be found on our docs website.

Version 3.4.1

This release comes with a few improvements.

• Enrich uses latest version of Iglu Scala client that comes with better caching, which improves the performance of enrich.
• enrich-kinesis retries ProvisionedThroughputExceededException errors forever (more details on the issue).
• enrich-kinesis adds STS support, making it possible for Enrich deployed on an EKS cluster to assume irsa role with corresponding permissions.
• Enrich does not try to URL decode the user agent any more. This could lead to bad rows in case the user agent was containing some unallowed characters.

Changelog

• Enrich-kinesis: improve sink retry policy for when throttled by kinesis (#697)
• common: use iglu-scala-client with improved caching (#699)
• enrich-kinesis: add STS v2 to runtime dependencies (#643)
• Common: remove url decoding the user agent (#695)
• enrich-rabbitmq: fix jar patch in Github worflow for releasing (#702)

How to upgrade

If you are already using a recent version for Enrich, then upgrading is as simple as pulling the latest docker image:

docker pull snowplow/snowplow-enrich-pubsub:3.4.1
docker pull snowplow/snowplow-enrich-kinesis:3.4.1
docker pull snowplow/stream-enrich-kafka:3.4.1
docker pull snowplow/snowplow-enrich-rabbitmq-experimental:3.4.1

More information can be found on our docs website.

Version 3.4.0

This release adds a new experimental asset that can write collector payloads to RabbitMQ.

Setup guide can be found here and configuration reference here.

Changelog

• Add RabbitMQ asset (#679)