v1.22.0

1.22.0 (2024-03-19)

Bug Fixes

• decrease async destination pending events (229e9d3)
• destType issue in eloqua stats (#4475) (229e9d3)
• eloqua: destType issue (229e9d3)
• too many connections in router transform (#4492) (3da9179)

Miscellaneous

• deps: bump github.com/bugsnag/bugsnag-go/v2 from 2.2.1 to 2.3.0 (229e9d3)
• deps: bump github.com/marcboeker/go-duckdb from 1.5.6 to 1.6.1 (#4469) (229e9d3)
• deps: bump github.com/marcboeker/go-duckdb from 1.5.6 to 1.6.1 (#4469) (5438a85)
• deps: bump github.com/prometheus/client_model from 0.5.0 to 0.6.0 (229e9d3)
• deps: bump github.com/prometheus/client_model from 0.5.0 to 0.6.0 (#4448) (229e9d3)
• deps: bump github.com/tidwall/gjson from 1.17.0 to 1.17.1 (229e9d3)
• deps: bump github.com/tidwall/gjson from 1.17.0 to 1.17.1 (#4449) (229e9d3)
• deps: bump google.golang.org/grpc from 1.61.0 to 1.62.1 (#4454) (6baa913)
• deps: bump google.golang.org/protobuf from 1.32.0 to 1.33.0 (#4474) (229e9d3)
• deps: bump google.golang.org/protobuf from 1.32.0 to 1.33.0 (#4474) (66dcdb6)
• fix databricks merge query (#4471) (b17cd48)
• forcing major release 1.22.0 (2065907)
• go-kit bump 0.20.2 -> 0.23.2 (#4459) (f4185e2)
• sending blank event to event schemas (#4484) (858c251)
• vacuum reports table when size > 5GB (229e9d3)

v1.22.0-rc.1

1.22.0-rc.1 (2024-03-18)

Features

• internal batch endpoint (#4394) (3f87930)
• openAPI spec for rudder-server (#4376) (a606282)
• toggle event ordering for workspace/destination (#4278) (3d43b69)

Bug Fixes

• always look for list item error for bingads audience (#4430) (1af8d75)
• decrease async destination pending events (229e9d3)
• decrease async destination pending events (92a149b)
• destType issue in eloqua stats (#4475) (229e9d3)
• destType issue in eloqua stats (#4475) (8fcaa9a)
• dontbatch-not-persisted (1af8d75)
• dontbatch-not-persisted (6b54972)
• eloqua: destType issue (229e9d3)
• eloqua: destType issue (851b63b)
• empty customVal in rt tables (#4437) (5abe242)
• enable archiver for use rudder storage for dtaging file entries (#4433) (ea78ee5)
• send throttling rate limit per second (#4419) (3501578)
• wrong processor out of order stats (#4426) (00b43d7)

Miscellaneous

• deps: bump github.com/aws/aws-sdk-go from 1.50.13 to 1.50.23 (#4412) (019b128)
• deps: bump github.com/aws/aws-sdk-go from 1.50.23 to 1.50.29 (#4438) (8886f17)
• deps: bump github.com/bugsnag/bugsnag-go/v2 from 2.2.0 to 2.2.1 (#4422) (fe95e15)
• deps: bump github.com/bugsnag/bugsnag-go/v2 from 2.2.1 to 2.3.0 (229e9d3)
• deps: bump github.com/bugsnag/bugsnag-go/v2 from 2.2.1 to 2.3.0 (d4948f8)
• deps: bump github.com/marcboeker/go-duckdb from 1.5.6 to 1.6.1 (#4469) (229e9d3)
• deps: bump github.com/marcboeker/go-duckdb from 1.5.6 to 1.6.1 (#4469) (5438a85)
• deps: bump github.com/minio/minio-go/v7 from 7.0.66 to 7.0.67 (#4415) (b569f78)
• deps: bump github.com/prometheus/client_model from 0.5.0 to 0.6.0 (229e9d3)
• deps: bump github.com/prometheus/client_model from 0.5.0 to 0.6.0 (722d025)
• deps: bump github.com/prometheus/client_model from 0.5.0 to 0.6.0 (#4448) (229e9d3)
• deps: bump github.com/prometheus/client_model from 0.5.0 to 0.6.0 (#4448) (2a1d077)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (a044053)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (#4442) (4070a17)
• deps: bump github.com/tidwall/gjson from 1.17.0 to 1.17.1 (229e9d3)
• deps: bump github.com/tidwall/gjson from 1.17.0 to 1.17.1 (1a46de4)
• deps: bump github.com/tidwall/gjson from 1.17.0 to 1.17.1 (#4449) (229e9d3)
• deps: bump github.com/tidwall/gjson from 1.17.0 to 1.17.1 (#4449) (9f440ef)
• deps: bump golang.org/x/oauth2 from 0.16.0 to 0.17.0 (#4386) (2f5c7ae)
• deps: bump golangci/golangci-lint-action from 3 to 4 (#4393) (c9928f0)
• deps: bump google.golang.org/grpc from 1.61.0 to 1.62.1 (#4454) (6baa913)
• deps: bump google.golang.org/protobuf from 1.32.0 to 1.33.0 (#4474) (229e9d3)
• deps: bump google.golang.org/protobuf from 1.32.0 to 1.33.0 (#4474) (66dcdb6)
• fast http client in processor transformer (#4432) (1bc759b)
• fix databricks merge query (#4471) (b17cd48)
• fix snyk reported security issues with benchmark k8s deployment (#4400) (ba93342)
• go-kit bump 0.20.2 -> 0.23.2 (#4459) (f4185e2)
• merge release 1.20.0 in main branch (#4391) (99db4e2)
• processor transformer uses parent ctx to create new request (#4431) (8dde92c)
• release 1.21.0 (763e0bc)
• send source name in metadata to transformer (#4443) (3088a10)
• sending blank event to event schemas (#4484) ([858c251](858c251...

v1.21.1

1.21.1 (2024-03-14)

Bug Fixes

• always look for list item error for bingads audience (#4430) (b9a02e9)

v1.21.0

1.21.0 (2024-03-06)

Features

• internal batch endpoint (#4394) (3f87930)
• openAPI spec for rudder-server (#4376) (a606282)
• toggle event ordering for workspace/destination (#4278) (3d43b69)

Bug Fixes

• dontbatch-not-persisted (f13b550)
• empty customVal in rt tables (#4437) (5abe242)
• enable archiver for use rudder storage for dtaging file entries (#4433) (ea78ee5)
• send throttling rate limit per second (#4419) (3501578)
• wrong processor out of order stats (#4426) (00b43d7)

Miscellaneous

• deps: bump github.com/aws/aws-sdk-go from 1.50.13 to 1.50.23 (#4412) (019b128)
• deps: bump github.com/aws/aws-sdk-go from 1.50.23 to 1.50.29 (#4438) (8886f17)
• deps: bump github.com/bugsnag/bugsnag-go/v2 from 2.2.0 to 2.2.1 (#4422) (fe95e15)
• deps: bump github.com/minio/minio-go/v7 from 7.0.66 to 7.0.67 (#4415) (b569f78)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (a044053)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (#4442) (4070a17)
• deps: bump golang.org/x/oauth2 from 0.16.0 to 0.17.0 (#4386) (2f5c7ae)
• deps: bump golangci/golangci-lint-action from 3 to 4 (#4393) (c9928f0)
• fast http client in processor transformer (#4432) (1bc759b)
• fix snyk reported security issues with benchmark k8s deployment (#4400) (ba93342)
• merge release 1.20.0 in main branch (#4391) (99db4e2)
• processor transformer uses parent ctx to create new request (#4431) (8dde92c)
• send source name in metadata to transformer (#4443) (3088a10)
• set 1000 as default max limit (#4315) (02fbd08)
• some non-exhaustive processor drop count stats (52a828e)
• some non-exhaustive processor drop count stats (#4446) (61a820d)
• ununsed code (#4408) (d8c413e)

v1.21.0-rc.3

1.21.0-rc.3 (2024-03-06)

Features

• internal batch endpoint (#4394) (3f87930)
• openAPI spec for rudder-server (#4376) (a606282)
• toggle event ordering for workspace/destination (#4278) (3d43b69)

Bug Fixes

• dontbatch-not-persisted (f13b550)
• empty customVal in rt tables (#4437) (5abe242)
• enable archiver for use rudder storage for dtaging file entries (#4433) (ea78ee5)
• send throttling rate limit per second (#4419) (3501578)
• wrong processor out of order stats (#4426) (00b43d7)

Miscellaneous

• deps: bump github.com/aws/aws-sdk-go from 1.50.13 to 1.50.23 (#4412) (019b128)
• deps: bump github.com/aws/aws-sdk-go from 1.50.23 to 1.50.29 (#4438) (8886f17)
• deps: bump github.com/bugsnag/bugsnag-go/v2 from 2.2.0 to 2.2.1 (#4422) (fe95e15)
• deps: bump github.com/minio/minio-go/v7 from 7.0.66 to 7.0.67 (#4415) (b569f78)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (a044053)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (#4442) (4070a17)
• deps: bump golang.org/x/oauth2 from 0.16.0 to 0.17.0 (#4386) (2f5c7ae)
• deps: bump golangci/golangci-lint-action from 3 to 4 (#4393) (c9928f0)
• fast http client in processor transformer (#4432) (1bc759b)
• fix snyk reported security issues with benchmark k8s deployment (#4400) (ba93342)
• merge release 1.20.0 in main branch (#4391) (99db4e2)
• processor transformer uses parent ctx to create new request (#4431) (8dde92c)
• send source name in metadata to transformer (#4443) (3088a10)
• set 1000 as default max limit (#4315) (02fbd08)
• some non-exhaustive processor drop count stats (52a828e)
• some non-exhaustive processor drop count stats (#4446) (61a820d)
• ununsed code (#4408) (d8c413e)

v1.21.0-rc.2

1.21.0-rc.2 (2024-03-05)

Features

• internal batch endpoint (#4394) (3f87930)
• openAPI spec for rudder-server (#4376) (a606282)
• toggle event ordering for workspace/destination (#4278) (3d43b69)

Bug Fixes

• empty customVal in rt tables (#4437) (5abe242)
• enable archiver for use rudder storage for dtaging file entries (#4433) (ea78ee5)
• send throttling rate limit per second (#4419) (3501578)
• wrong processor out of order stats (#4426) (00b43d7)

Miscellaneous

• deps: bump github.com/aws/aws-sdk-go from 1.50.13 to 1.50.23 (#4412) (019b128)
• deps: bump github.com/aws/aws-sdk-go from 1.50.23 to 1.50.29 (#4438) (8886f17)
• deps: bump github.com/bugsnag/bugsnag-go/v2 from 2.2.0 to 2.2.1 (#4422) (fe95e15)
• deps: bump github.com/minio/minio-go/v7 from 7.0.66 to 7.0.67 (#4415) (b569f78)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (a044053)
• deps: bump github.com/snowflakedb/gosnowflake from 1.7.2 to 1.8.0 (#4442) (4070a17)
• deps: bump golang.org/x/oauth2 from 0.16.0 to 0.17.0 (#4386) (2f5c7ae)
• deps: bump golangci/golangci-lint-action from 3 to 4 (#4393) (c9928f0)
• fast http client in processor transformer (#4432) (1bc759b)
• fix snyk reported security issues with benchmark k8s deployment (#4400) (ba93342)
• merge release 1.20.0 in main branch (#4391) (99db4e2)
• processor transformer uses parent ctx to create new request (#4431) (8dde92c)
• send source name in metadata to transformer (#4443) (3088a10)
• set 1000 as default max limit (#4315) (02fbd08)
• some non-exhaustive processor drop count stats (52a828e)
• some non-exhaustive processor drop count stats (#4446) (61a820d)
• ununsed code (#4408) (d8c413e)

v1.21.0-rc.1

1.21.0-rc.1 (2024-03-04)

Features

• internal batch endpoint (#4394) (3f87930)
• openAPI spec for rudder-server (#4376) (a606282)
• toggle event ordering for workspace/destination (#4278) (3d43b69)

Bug Fixes

• empty customVal in rt tables (#4437) (5abe242)
• enable archiver for use rudder storage for dtaging file entries (#4433) (ea78ee5)
• send throttling rate limit per second (#4419) (3501578)
• wrong processor out of order stats (#4426) (00b43d7)

Miscellaneous

• deps: bump github.com/aws/aws-sdk-go from 1.50.13 to 1.50.23 (#4412) (019b128)
• deps: bump github.com/minio/minio-go/v7 from 7.0.66 to 7.0.67 (#4415) (b569f78)
• deps: bump golang.org/x/oauth2 from 0.16.0 to 0.17.0 (#4386) (2f5c7ae)
• deps: bump golangci/golangci-lint-action from 3 to 4 (#4393) (c9928f0)
• fast http client in processor transformer (#4432) (1bc759b)
• fix snyk reported security issues with benchmark k8s deployment (#4400) (ba93342)
• merge release 1.20.0 in main branch (#4391) (99db4e2)
• processor transformer uses parent ctx to create new request (#4431) (8dde92c)
• set 1000 as default max limit (#4315) (02fbd08)
• ununsed code (#4408) (d8c413e)

v1.20.1

1.20.1 (2024-02-29)

Bug Fixes

• always look for list item error for bingads audience (#4430) (8462215)

v1.20.0

1.20.0 (2024-02-12)

Features

• add 'config' field to proxy request for v0 (#4352) (09b9f71)
• adding sourceId and destinationId in pipeline info metrics (#4332) (c2d7a42)
• update error table with new columns (#4356) (9e8ebc6)

Bug Fixes

• batchrouter async dest pending event counts aren't being decreased (#4346) (10c653c)
• handle consent management configuration fallback for gcm (#4355) (a418e03)
• ignore gwJobs' destinationID in processor rsources.statCollector (#4321) (ec91612)
• jobs not draining as fast as we'd like because of rate-limiting etc. (#4327) (ed301a3)
• marketo bulk upload's upload url preparation fix (#4358) (c58b486)
• nil load statistics for bigquery (#4328) (ec91612)

Miscellaneous

• add tests for aiokafka consumer (#4372) (dba6d31)
• deps: bump arduino/setup-protoc from 2 to 3 (#4363) (14b84bf)
• deps: bump cloud.google.com/go/bigquery from 1.58.0 to 1.59.0 (#4374) (0b88164)
• deps: bump cloud.google.com/go/pubsub from 1.36.0 to 1.36.1 (#4369) (6d26af0)
• deps: bump codecov/codecov-action from 3 to 4 (#4362) (1cb7af1)
• deps: bump github.com/aws/aws-sdk-go from 1.49.21 to 1.50.0 (#4341) (08aa4ae)
• deps: bump github.com/aws/aws-sdk-go from 1.50.10 to 1.50.13 (#4378) (bb321c8)
• deps: bump github.com/aws/aws-sdk-go from 1.50.6 to 1.50.10 (#4365) (95ba15b)
• deps: bump github.com/golang-migrate/migrate/v4 from 4.16.2 to 4.17.0 (#4302) (a086bfa)
• deps: bump github.com/grpc-ecosystem/grpc-gateway/v2 from 2.18.1 to 2.19.0 (#4336) (3c63569)
• deps: bump github.com/onsi/ginkgo/v2 from 2.13.2 to 2.15.0 (#4345) (592fea7)
• deps: bump github.com/onsi/gomega from 1.30.0 to 1.31.1 (#4348) (5d23637)
• deps: bump github.com/rudderlabs/bing-ads-go-sdk from 0.2.0 to 0.2.1 (#4339) (c23c6c3)
• deps: bump github.com/rudderlabs/rudder-go-kit from 0.19.0 to 0.19.1 (#4338) (abae730)
• deps: bump github.com/samber/lo from 1.38.1 to 1.39.0 (#4320) (a46cf47)
• deps: bump github.com/segmentio/kafka-go from 0.4.44 to 0.4.47 (#4343) (03e6be9)
• deps: bump github.com/urfave/cli/v2 from 2.25.7 to 2.27.1 (#4318) (5a0493f)
• deps: bump go.etcd.io/etcd/api/v3 from 3.5.11 to 3.5.12 (#4367) (ea66769)
• deps: bump go.etcd.io/etcd/client/v3 from 3.5.11 to 3.5.12 (#4368) (3acd5e6)
• deps: bump golang.org/x/oauth2 from 0.15.0 to 0.16.0 (#4319) (cbf1b0f)
• deps: bump google.golang.org/api from 0.156.0 to 0.157.0 (#4342) (3e448f9)
• deps: bump google.golang.org/api from 0.160.0 to 0.161.0 (#4366) (b917316)
• deps: bump peter-evans/repository-dispatch from 2 to 3 (#4354) (166de8a)
• fix code cov breaking change (#4379) (888a354)
• integration test for rETL flow (#4324) (8c92520)
• reduce cardinality of warehouse metrics (#4364) (2cd917c)
• revert update error table with new columns (#4380) (8119fe3)
• set container and account name for load file does not exist test for databricks (#4361) (59ecda8)
• using new kit kafka client and docker resources (#4350) (4fa88cb)

v1.20.0-rc.1

1.20.0-rc.1 (2024-02-09)

Features

• add 'config' field to proxy request (#4264) (1c3fb01)
• add 'config' field to proxy request for v0 (#4352) (4fdd81c)
• add destinationID to rETL endpoint (#4234) (2c02dc2)
• add support for regulation from features.json (#4304) (3c2fcf6)
• add version deprecation error-code identification logic (#3995) (866393d)
• added sprig in supportedDestionations for user deletion (#4285) (e3b8018)
• adding sourceId and destinationId in pipeline info metrics (#4332) (6c1f1c4)
• filter destinations for events from rETL in processor (#4247) (2b82920)
• lower retry limits(fail-fast) for sources jobs in batchrouter (#4310) (d7cbc8c)
• support for adaptive rate limiting [PIPE-481] (#4160) (40586e5)
• tracing support for gateway, processor and router (#4248) (7dc7747)
• update error table with new columns (#4356) (b8b5527)
• warehouse append vs merge (#4139) (40586e5)

Bug Fixes

• adapt connection timeout for sql for redshift (#4253) (1ff6f90)
• adaptiveWindow default value should be more than 0 (#4312) (5108d45)
• add wait for get supported destinations in regulation worker (#4311) (cfed04a)
• batchrouter async dest pending event counts aren't being decreased (#4346) (5d78ab6)
• bigquery job statistics for rate limit (#4272) (9842f64)
• changing eventNames longer than configured max length to ":max-length-exceeded:" before sending to reporting (#4244) (719396f)
• ci: fix distpatch event action typo (#4252) (1057ee1)
• exhaust error index jobs when work is called (#4295) (b7b75ad)
• gateway stat tags when source is disabled (#4215) (85235bb)
• handle consent management configuration fallback for gcm (#4355) (7e47ee9)
• ignore destinationID in gateway rsources.statCollector (#4299) (eece12b)
• ignore gwJobs' destinationID in processor rsources.statCollector (#4321) (ec91612)
• ignore gwJobs' destinationID in processor rsources.statCollector (#4321) (5276978)
• jobs not draining as fast as we'd like because of rate-limiting etc. (#4327) (bc755cf)
• marketo bulk upload's upload url preparation fix (#4358) (f6396f9)
• nil load statistics for bigquery (#4328) (ec91612)
• processor: duplicate rsources out stats can be recorded in case of a retry due to an operation timeout (#4223) (a7c373a)
• pubsub channel not closing during close if no value has been published (#4269) (ab0e0d9)
• return only the latest namespace entry when fetching tables from warehouse (#4287) (8f1e6b1)
• server panics during shutdown with reporting metrics: failed to store jobs: context canceled (#4228) (68e52d5)

Miscellaneous

• adapt rudder-go-kit v0.19.0 changes (#4227) (08c0864)
• add env to enable throttlerV2 (#4313) (139d46e)
• add tests for aiokafka consumer (#4372) (db9b6d9)
• additional error mappings for deltalake (#4265) (35cc8e9)
• autofix corrupted job-status stats (#4224) (781f24f)
• backend config calls metric (#4306) (b03aaba)
• backend config response size metric (#4309) (2fbf4c5)
• change the max limit to take multiplier of the existing limits (#4263) (7c4cc03)
• ci: automated deployment (875cc54)
• custom buckets for gw request size (#4275) (6466a9b)
• deps: bump actions/download-artifact from 3 to 4 (#4240) ([d8d980d](d8d980d...