v1.37.2

1.37.2 (2024-11-01)

Bug Fixes

• parse error due incrorrect csv response from marketo-n (#5252) (76beb84)

v1.37.1

1.37.1 (2024-10-30)

Bug Fixes

• add error logs for handle async for visibility of error (#5248) (03d2472)

v1.37.0

1.37.0 (2024-10-28)

Features

• introduce batch read for scylla (#5212) (ab62155)
• onboard initial marketo builk upload implementation (#5114) (ad598b0)

Bug Fixes

• common db pool config wasn't reloadable (#5210) (ace1447)
• dedup - use writeBatch to put keys in badger (#5204) (9683021)

Miscellaneous

• deps: bump cloud.google.com/go/storage from 1.44.0 to 1.45.0 in the frequent group (#5208) (da9f8c8)
• deps: bump google.golang.org/api from 0.200.0 to 0.201.0 in the frequent group (#5203) (bf2b4c6)
• deps: bump the frequent group across 1 directory with 2 updates (#5221) (f7a04a3)
• deps: bump the go-deps group across 1 directory with 5 updates (#5201) (6edd75f)
• deps: bump the go-deps group with 3 updates (#5209) (12cc5e8)
• reduce metrics cardinality (#5222) (18c102f)
• remove git submodule (b3535cd)
• remove old replay code (#5198) (59454eb)
• remove unused rudder cli code (#5199) (4494209)
• webhook v0 deprecation while defaulting to v1 (#5187) (9d27a0f)

v1.37.0-rc.1

1.37.0-rc.1 (2024-10-28)

Features

• introduce batch read for scylla (#5212) (ab62155)
• onboard initial marketo builk upload implementation (#5114) (ad598b0)

Bug Fixes

• common db pool config wasn't reloadable (#5210) (ace1447)
• dedup - use writeBatch to put keys in badger (#5204) (9683021)

Miscellaneous

• deps: bump cloud.google.com/go/storage from 1.44.0 to 1.45.0 in the frequent group (#5208) (da9f8c8)
• deps: bump google.golang.org/api from 0.200.0 to 0.201.0 in the frequent group (#5203) (bf2b4c6)
• deps: bump the frequent group across 1 directory with 2 updates (#5221) (f7a04a3)
• deps: bump the go-deps group across 1 directory with 5 updates (#5201) (6edd75f)
• deps: bump the go-deps group with 3 updates (#5209) (12cc5e8)
• reduce metrics cardinality (#5222) (18c102f)
• remove git submodule (b3535cd)
• remove old replay code (#5198) (59454eb)
• remove unused rudder cli code (#5199) (4494209)
• webhook v0 deprecation while defaulting to v1 (#5187) (9d27a0f)

v1.36.0

1.36.0 (2024-10-14)

Features

• introduce merge window for snowflake ingestion (#5160) (0e44f18)

Bug Fixes

• bigquery validations for partition column and type (#5168) (72443b2)
• change retl check to source category (#5167) (72443b2)
• clickhouse temporary files deletion happening twice (#5182) (9f52106)
• set hosted secret as auth instead of workspace token (#5181) (519f3c6)
• sourceID and originalSourceID not flipped before transformation (#5177) (72443b2)

Miscellaneous

• add metrics and logs for source webhooks (#5078) (e7cccae)
• add stats to dedup module (#5190) (f305282)
• cleanup old jobs(beyond maxAge) at startup (#5188) (3dff5e6)
• cleanup warehouse (#5150) (7818610)
• deps: bump cloud.google.com/go/bigquery from 1.63.0 to 1.63.1 in the frequent group (#5161) (3d4ebf8)
• deps: bump cloud.google.com/go/storage from 1.43.0 to 1.44.0 in the frequent group (#5173) (a136618)
• deps: bump github.com/snowflakedb/gosnowflake from 1.11.1 to 1.11.2 in the go-deps group (#5174) (bf45d23)
• deps: bump rudderlabs/pr-description-enforcer from 1.0.0 to 1.1.0 (#5162) (a52a071)
• deps: bump the go-deps group across 1 directory with 8 updates (#5189) (0561ee2)
• deps: bump the go-deps group across 1 directory with 9 updates (#5158) (6171604)
• fix jobsdb flaky test (#5197) (192025a)
• fix stuck runUploadJobAllocator (#5191) (ae9d984)
• one (*sql.DB) pool for all jobsdb (#5170) (261aa60)
• sync release v1.35.2 to main branch (#5172) (2fa0fa0)
• trim eventNames sent to reporting if length exceeds 50 characters (#5171) (87283c4)
• update event_delivery_time histogram buckets (#5186) (68b1ad5)

v1.36.0-rc.1

1.36.0-rc.1 (2024-10-14)

Features

• introduce merge window for snowflake ingestion (#5160) (0e44f18)

Bug Fixes

• bigquery validations for partition column and type (#5168) (72443b2)
• change retl check to source category (#5167) (72443b2)
• clickhouse temporary files deletion happening twice (#5182) (9f52106)
• set hosted secret as auth instead of workspace token (#5181) (519f3c6)
• sourceID and originalSourceID not flipped before transformation (#5177) (72443b2)

Miscellaneous

• add metrics and logs for source webhooks (#5078) (e7cccae)
• add stats to dedup module (#5190) (f305282)
• cleanup old jobs(beyond maxAge) at startup (#5188) (3dff5e6)
• cleanup warehouse (#5150) (7818610)
• deps: bump cloud.google.com/go/bigquery from 1.63.0 to 1.63.1 in the frequent group (#5161) (3d4ebf8)
• deps: bump cloud.google.com/go/storage from 1.43.0 to 1.44.0 in the frequent group (#5173) (a136618)
• deps: bump github.com/snowflakedb/gosnowflake from 1.11.1 to 1.11.2 in the go-deps group (#5174) (bf45d23)
• deps: bump rudderlabs/pr-description-enforcer from 1.0.0 to 1.1.0 (#5162) (a52a071)
• deps: bump the go-deps group across 1 directory with 8 updates (#5189) (0561ee2)
• deps: bump the go-deps group across 1 directory with 9 updates (#5158) (6171604)
• fix stuck runUploadJobAllocator (#5191) (ae9d984)
• one (*sql.DB) pool for all jobsdb (#5170) (261aa60)
• sync release v1.35.2 to main branch (#5172) (2fa0fa0)
• trim eventNames sent to reporting if length exceeds 50 characters (#5171) (87283c4)
• update event_delivery_time histogram buckets (#5186) (68b1ad5)

v1.35.3

1.35.3 (2024-10-08)

Bug Fixes

• sourceID and originalSourceID not flipped before transformation (#5177) (7b60b67)

v1.35.2

1.35.2 (2024-10-04)

Bug Fixes

• bigquery validations for partition column and type (#5168) (a2af47a)
• change retl check to source category (#5167) (3ed1302)

v1.35.1

1.35.1 (2024-10-03)

Miscellaneous

• remove panic on NewDatabaseSQLStats Register from various reports (#5163) (af83259)

v1.35.0

1.35.0 (2024-10-01)

Features

• add reason for discards [PIPE-1473] (#5088) (f835aa7)
• bq configurable partitions (#5133) (9544374)
• redshift serverless (#5144) (e37b0e9)

Bug Fixes

• add messageId, rudderId and type based on new schema (#5140) (f6f6dfa)
• remove legacy hosted code which changes connectionToken (#5126) (100b3d9)
• wrong filtering while killing dangling connections (#5142) (0536285)

Miscellaneous

• add db.sql stat collector (#5146) (61e947c)
• add gitleaks scan (#5036) (5bda381)
• change scylla strategy to single table (#5115) (7e56e43)
• emit event_delivery_time metric at staging file level (#5136) (23f943e)
• jit secrets (#4995) (615833e)
• no full vacuum for various reports tables (#5120) (6e8b03e)
• optimise config backend revisionId calls (#5139) (62143dc)
• revert "chore: trim eventNames sent to reporting if length exceeds 50 characters" (#5155) (17c5ad7)
• revert setting max idle connections for jobsdb (#5151) (ef57540)
• schema and record assertions in warehouse integration test (#5091) (336b876)
• sync release v1.34.0 to main branch (#5113) (336b876)
• trim eventNames sent to reporting if length exceeds 50 characters (#5138) (33b5f63)
• users context traits and populate users fields (#5135) (243a4a7)