v1.2.0

1.2.0 (2022-10-12)

Features

• add support for role based auth flag (#2519) (810bb5d)
• add support iam role support for warehouse destinations (#2496) (867123a)
• addition of Azure SAS Tokens for Azure Object storage destinations (#2358) (cf5afe1)
• changes to support variadic keys for deletion from API dest. (#2457) (1950713)
• core: logical replication monitoring query routine (#2436) (8271aab)
• destination: add new tags to router-aborted-count alert definition (#2514) (60bc1be)
• introduce features/settings client (#2377) (711f266)
• updating supportedDestinations in api.go (#2468) (3a2e75c)
• warehouse_jobs support for async warehouse jobs (#2319) (73cc48a)
• warehouse: added warehouse features (#2545) (8ea8be5)
• warehouse: introduce workspace id in warehouse (#2523) (2c5fa3d)
• warehouse: skipping scanning the entire table for duplicates in redshift (#2518) (104410a)
• warehouse: timeout during warehouse table count (#2543) (b2b1c08)

Bug Fixes

• core: cache backend config and block processor (#2225) (40fe19d)
• json out of bounds in batchrouter (#2465) (2bf0f6a)
• only report features on master / standalone warehouse (#2483) (33ba5ef)
• remove custom credentials chain to use default (#2485) (de0fe36)
• router: preserve event order while draining a previously failed job (#2546) (f0654b0)
• silent backup ds drop (#2550) (4fe3038)
• to prevent migration of tables every loop after maxdsretention is passed (#2554) (af27add)
• use workspace id as aws iam role external id (#2386) (bced8d5)
• warehouse: omit view tables while fetching schema (#2482) (74f268c)
• warehouse: typo with fetch schema for bigquery (#2556) (ce69ae3)

Documentation

• docker fails to parse quotes in env value (#2345) (67584f7)
• remove unnecessary bold style in README (#2509) (1392de1)
• v1.0 announcement and event link (#2400) (44f3786)

Miscellaneous

• add object storage support to replay (#2277) (e9e15b9)
• add reason tag in failed requests and failed events stats (#2430) (a6137a9)
• add replay support for all object storage (e9e15b9)
• add resource tags in metrics (#2462) (2f73704)
• added pre_drop_table count metrics (#2441) (869d694)
• added rudder-server config metrics with version and other details as tag (#2445) (da55a86)
• applying 1.1.1 hotfixes to main branch (#2449) (ac9afbd)
• applying 1.1.2 hotfixes to main branch (#2474) (575c9e4)
• change base image to alpine for build and prod (#2480) (4593f65)
• clean up pathfinder which is related to old migrator code. (#2479) (3230fc6)
• config package (#2439) (2ce9210)
• dataset index calculation (#2512) (bfba9cf)
• deps: bump github.com/mitchellh/mapstructure from 1.4.1 to 1.5.0 (#2442) (79c63e5)
• deps: bump github.com/segmentio/kafka-go from 0.4.32 to 0.4.35 (#2455) (3441862)
• deps: bump github.com/snowflakedb/gosnowflake from 1.6.3 to 1.6.13 (#2432) (7ae6421)
• deps: bump go.etcd.io/etcd/client/v3 from 3.5.2 to 3.5.5 (#2499) (6ece30e)
• disable deepsource transformer (0466ec6)
• disable semantic PR single commit validation (#2487) (261345e)
• drop old migrator (#2417) ([870bccf](870...

v1.1.2

1.1.2 (2022-09-23)

Bug Fixes

• snowflake identifier issue (#2471) (d4b2583)

v1.1.1

1.1.1 (2022-09-15)

Bug Fixes

• close http response body only if there is no error (#2447) (ef72aee)

v1.1.0

1.1.0 (2022-09-12)

Features

• add support for sending custom payload to webhook source (#2315) (8c0d811)
• cpRouter Multitenant Support (#2233) (3c86dab)
• honour anonId only from header (#2323) (cbe74b6)
• improvements in rudder-sources integration (#2366) (54133d1)
• introduce context, timeout and retries in jobsDB queries (#2217) (32b2f40)
• isolate destID in router (#2369) (0708615)
• jobsdb: thread safe addNewDSLoop (#2356) (8ef6c39)
• perform ADD_DS operation in a single transaction (#2324) (7ee2d11)
• thread safe Job Storage (#2403) (a123b10)

Bug Fixes

• add trailing slash for licensing link (ca00c32)
• add www and trailing slash to RS links (7574509)
• safe webhook concurrent map access (#2389) (b72f6be)
• use jsoniter when unmarshaling to avoid perfromance issues (#2381) (35ad8e4)

Miscellaneous

• add token type for success message (#2408) (92600fd)
• added metrics to track failed DS backup (#2370) (1d3cd42)
• change proto message names (#2394) (689edd6)
• disable parallel test execution and refactor jobsdb tests (#2410) (3bd27ee)
• fix cache bug (#2412) (4f83ba7)
• fix for TestNewForDeployment test (#2425) (1c4a36d)
• log improvements (#2365) (95a24ca)
• migrate small tables (#2327) (1ca1faa)
• modified regulation-worker response code handling from 404 to 204, when no job is available (#2422) (44e8553)
• router: include original client creation error when circuit breaker is open (#2373) (4d8a9bc)
• router: new event ordering algorithm with proper aborted job limiting (#2344) (097c61b)
• skip double mutex unlock (#2415) (366e1b9)
• upgrade golangci and linting fixes (#2347) (6348406)
• use generics for contains function (#2396) (2134c54)
• use right id to allocate worker (#2399) (312a301)
• using go test (#2411) (7eb62d9)
• warehouse: remove tokens from logs for redshift and snowflake (#2359) (7409c56)
• warehouse: skip warehouse snowflake test (#2404) (09bc408)
• warehouse: unnecessary join in fetch schema for postgres and snowflake (#2360) (2de0d68)

v1.0.2

1.0.2 (2022-08-25)

Bug Fixes

• jobsdb: report correct table count metrics from gateway writer (#2333) (bb445a5)
• release-please behaviour (33d1dec)
• remove anti pattern issues (#2335) (7468709)
• router: event ordering algorithm with proper aborted job limiting support (#2329) (c6f8173)
• router: trying to stop the router before the generatorLoop is started causes router to hang (#2321) (cbaef78)
• warehouse: added initialization for datalake (#2332) (8fe1bf9)
• warehouse: upload validations should happen when validator is set (#2348) (f0a6416)

Miscellaneous

• fix lint errors in test (#2352) (d67ef3a)
• fix misspell (c5d5060)
• include all supported pr types in changelog (#2339) (c074298)
• introduce go report card (#2320) (578de21)
• remove build tag from test (#2350) (cf6d629)
• remove build tags from tests (#2346) (16cc643)
• skip v1.0.1 release (d65658d)
• upgrade actions runner to ubuntu 20.04 (#2326) (8c970f6)
• upgrade GO version to 1.18 (#2328) (edde758)
• warehouse: update errorMap for deltalake partition query (#2334) (e011726)

v1.0.0

1.0.0 (2022-08-19)

Features

• backend config namespace support (#2232) (30da9ec)
• core: secure customer s3 bucket access for backups using cross-account role (#2250) (964c2d9)
• destination: onboarding Lambda destination (#2229) (581aef4)
• introduce retention for datasets (#2214) (beb7be8)
• minor changes for namespace config endpoint (#2307) (8c5c2bc)
• processor: filter unsupported messages (type & event fields) (#2211) (e701950)
• update namespace endpoint according to the latest changes (#2269) (eb67dca)
• use different http client timeouts for different components (#2300) (9dc3d48)
• warehouse: handle bucket config change (#2084) (7f83f0b)

Bug Fixes

• awsutils to support secretAccessKey (#2306) (801355e)
• backend config auth (#2259) (4c014a0)
• backend config refactoring (#2200) (e242c7d)
• core: configSubscriber lock, router_status_events count (#2181) (3c89b96)
• core: order inserts(updates) to avoid deadlocks (#2167) (28c8872)
• destination: oauth expired secret type change to json.RawMessage from string (#2236) (b001747)
• destination: transformer proxy respond with timeout for slow or unresponsive dests. (#2258) (c592462)
• dockerfile issues related to scripts (#2298) (7348cb2)
• fetch filemanagers timeout from config instead of registering (#2213) (b764798)
• gateway: make gateway user logic synonymous to proxy logic (#2205) (8c889ae)
• group errors swallowed + honouring ctx (#2309) (ae53e6e)
• jobsdb: fix ANALYSE for Negative Indices during internal migration (#2192) (69ae857)
• multi_tenant_test.go improvements (#2247) (b644468)
• only tag images with :latest if they are part of a release (#2174) (b8c5353)
• parse JSON error field as a string (#2246) (fbb9b62)
• reinstate bugsnag notifications (#2265) (781862c)
• restore / endpoint (#2237) (2316604)
• router: handle transformer in/out inconsistencies (#2276) (ecca8ec)
• stream manager logging format string (#2263) (5aea319)
• warehouse: marshall pg_notifier_queue payload during the time of inserting the data (#2243) (a3d1632)
• warehouse: reset priority if earlier upload is already in progress (b9e2674)
• warehouse: support skipping escaping of reserved keywords (#2115) (2b4425a)
• warehouse: use correct config for destination name (#2221) (666654e)
• warehouse: use global config for parquet patallel writers (#2184) (54091ed)

Miscellaneous Chores

• prepare v1 release (040b734)

v0.2.2: chore(warehouse): revert schemaExist changes to follow statement exec

chore(warehouse): revert schemaExist changes to follow statement exec…

v0.2.1

fix(core): order inserts(updates) to avoid deadlocks (#2167)

v0.2.0

0.2.0 (2022-07-06)

Features

• core: add support for managing failed records in rsources.JobService (#2087) (c22541c)
• core: introduce new failed-records endpoint (#2120) (70cbdcd)
• destination: putting support for AVRO in Kafka. (#2042) (b9677a8)
• expose robots.txt to disable crawling (#2090) (506e9aa)
• warehouse: enable postgres query execution (#2106) (66a8846)

Bug Fixes

• calculate consistent tagStr cache keys in stats (#2108) (fea8e30)
• kafka multiple hosts (#2103) (30ee189)
• make sure jobsdb is started when using the replay feature (#2071) (b64a37f)
• multi-tenant: removed unused mock calls (#2073) (7e33ede)
• processor: include test for sources fields in transform event metadata (#2143) (5a0f854)
• properly start a new badgerdb transaction on ErrTxnTooBig (#2061) (ea839f4)
• removed the output of goRoutine count from the HTTP GET / of the server (#2079) (ca6450b)
• update failedJobIDMap after draining a job in router (#2065) (19d1e3d)
• use a writer jobsdb for writing to gw tables during replay (#2086) (bad7dea)
• warehouse: close connections after validation steps (#2122) (6491d65)

Miscellaneous Chores

• change release to 0.2.0 (3cd36f4)

Release hotfix: v0.1.10-hotfix1

fix: properly start a new badgerdb transaction on ErrTxnTooBig (#2061)