-
Notifications
You must be signed in to change notification settings - Fork 177
/
ChangeLog
360 lines (215 loc) · 9.96 KB
/
ChangeLog
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
Release 0.19.3 - 2024/08/02
* out_rdkafka2: Add `unrecoverable_error_codes` parameter to handle
specific error code as unrecoverable errors. `topic_authorization_failed`
and `msg_size_too_large` are treated as such unrecoverable error by default. (#510)
* out_rdkafka2: Add missing closing timeout feature to keep compatibility with
rdkafka-ruby 0.12.x or later. (#505)
* out_rdkafka2: Add `idempotent` parameter to enable idempotence in Kafka producer. (#501)
* out_kafka2: Fix errors while sending data to EventHub by adding
broker pool to take care of fetching metadata (#503)
Release 0.19.2 - 2023/10/13
* out_rdkafka2: Add `discard_kafka_delivery_failed_regex`
Release 0.19.1 - 2023/09/20
* out_rdkafka2: Add `use_default_for_unknown_topic` & `use_default_for_unknown_partition_error`
Release 0.19.0 - 2023/04/26
* out_kafka2: Add support for AWS IAM authentication
* in_kafka, in_kafka_group, out_kafka2: Add support for ssl client cert key password
* out_rdkafka2: Mask `ssl_client_cert_key_password` on dumping it to log
* out_rdkafka2: Support rdkafka-ruby 0.12
Release 0.18.1 - 2022/08/17
* out_kafka2: Fix a bug that it doesn't respect `chunk_limit_records` and `chunk_limit_size`
Release 0.18.0 - 2022/07/21
* out_kafka2: Keep alive Kafka connections between flushes
* out_rdkafka2: Enable to set SASL credentials via `username` and `password` parameters
* out_kafka2/out_rdkafka2: Add `record_key` parameter
Release 0.17.5 - 2022/03/18
* out_kafka2: Add `resolve_seed_brokers` parameter
Release 0.17.4 - 2022/01/25
* in_kafka_group: Add `refresh_topic_interval` parameter
Release 0.17.3 - 2021/11/26
* output: Suppress large warning logs for events skipped by `max_send_limit_bytes`
Release 0.17.2 - 2021/10/14
* out_rdkafka2: Add `max_enqueue_bytes_per_second` parameter
* out_rdkafka2: Support `use_event_time` parameter
* out_rdkafka2: Fix a potential bug that the plugin might exit without receiving responses from Kafka.
Release 0.17.1 - 2021/09/24
* out_rdkafka/out_rdkafka2: Support rdkafka 0.9.0 or later
* out_rdkafka/out_rdkafka2: Add `exclude_fields` parameter
* out_kafka2.rb: Fix one more Ruby 3.0 keyword arguments issue
Release 0.17.0 - 2021/08/30
* out_kafka/out_kafka_buffered/out_kafka2: Provide murmur2 partitioner hash function choice
* in_kafka/in_kafka_group/out_kafka/out_kafka_buffered/out_kafka2: Use Ruby Kafka's ssl_ca_cert_file_path parameter to feed the CA certs
* out_kafka/out_kafka2: fix description for `exclude_message_key` option
Release 0.16.3 - 2021/05/17
* in_kafka_group: Fix one more Ruby 3.0 keyword arguments issue
Release 0.16.2 - 2021/05/17
* in_kafka, in_kafka_group: Support Ruby 3.0 keyword arguments interop
Release 0.16.1 - 2021/04/14
* out_kafka/out_kafka_buffered: Support Ruby 3.0.0 keyword arguments interop
* kafka_plugin_util: Treat empty string in read_ssl_file as nil
Release 0.16.0 - 2021/01/25
* input: Add `tag_source` and `record_tag_key` parameters for using record field as tag
* in_kafka_group: Use NumericParser for floating point
Release 0.15.3 - 2020/12/08
* in_kafka: Fix `record_time_key` parameter not working
Release 0.15.2 - 2020/09/30
* input: Support 3rd party parser
Release 0.15.1 - 2020/09/17
* out_kafka2: Fix wrong class name for configuration error
Release 0.15.0 - 2020/09/14
* Add experimental `in_rdkafka_group`
* in_kafka: Expose `ssl_verify_hostname` parameter
Release 0.14.2 - 2020/08/26
* in_kafka_group: Add `add_headers` parameter
* out_kafka2/out_rdkafka2: Support `discard_kafka_delivery_failed` parameter
Release 0.14.1 - 2020/08/11
* kafka_producer_ext: Fix regression by v0.14.0 changes
Release 0.14.0 - 2020/08/07
* Update ruby-kafka dependency to v1.2.0 or later. Check https://github.com/zendesk/ruby-kafka#compatibility
* kafka_producer_ext: Follow Paritioner API change
Release 0.13.1 - 2020/07/17
* in_kafka_group: Support ssl_verify_hostname parameter
* in_kafka_group: Support regex based topics
* out_kafka2/out_rdkafka2: Support topic parameter with placeholders
Release 0.13.0 - 2020/03/09
* Accept ruby-kafka v1 or later
Release 0.12.4 - 2020/03/03
* output: Follow rdkafka log level
Release 0.12.3 - 2020/02/06
* output: Show warning message for v0.12 plugins
Release 0.12.2 - 2020/01/07
* input: Refer sasl_over_ssl parameter in plain SASL
Release 0.12.1 - 2019/10/14
* input: Add time_source parameter to replace use_record_time
Release 0.12.0 - 2019/09/27
* Support rdkafka-ruby v0.7. Drop v0.6 support.
Release 0.11.2 - 2019/09/27
* out_rdkafka2: Add share_producer parameter
Release 0.11.1 - 2019/08/22
* out_kafka2: Fix mutating issue of headers
Release 0.11.0 - 2019/07/17
* out_kafka2: Add connect_timeout / socket_timeout parameters
* out_kafka2/out_rdkafka2: Add headers / headers_from_record parameters
* output: Add use_event_time parameter to use fluentd event time for CreateTime
* input: Add get_kafka_client_log parameter. Default is `false`
Release 0.10.0 - 2019/07/03
* output: Fixed max_send_limit_bytes parameter to be in all kafka outputs
* output: Add ssl_verify_hostname parameter
* rdkafka output: Fix exceptiona handling
* Update ruby-kafka version to v0.7.8 or later
Release 0.9.6 - 2019/05/28
* out_kafka2: Add metadata nil check
Release 0.9.5 - 2019/05/23
* output: Support sasl_over_ssl parameter to not use SSL with SASL/GSSAPI
Release 0.9.4 - 2019/05/13
* out_rdkafka2: Add metadata nil check
Release 0.9.3 - 2019/05/04
* in_kafka_group: Add connect_timeout and socket_timeout parameters
Release 0.9.2 - 2019/03/26
* out_kafka_buffered: Fix typo of partition_key usage
Release 0.9.1 - 2019/03/25
* output: Support sasl_over_ssl parameter
* Support ruby-kafka 0.7.6
Release 0.9.0 - 2019/02/22
* Add v1 API based rdkafka2 output plugin
* out_kafka2: Add use_default_for_unknown_topic parameter
Release 0.8.4 - 2019/01/18
* in_kafka_group: Support integer/float time field with time_format
Release 0.8.3 - 2018/12/16
* output: Add ssl_client_cert_chain parameter
Release 0.8.2 - 2018/12/07
* output: Add idempotent parameter
* out_kafka2: Fix DeliveryFailed signature mismatch
Release 0.8.1 - 2018/11/20
* input: Support SASL without SSL
Release 0.8.0 - 2018/10/18
* output: Support SASL without SSL
* output: Add rdkafka based output
* Update ruby-kafka dependency to v0.7 or later
Release 0.7.9 - 2018/09/11
* in_kafka_group: Add fetcher_max_queue_size parameter
Release 0.7.8 - 2018/08/29
* input: Fix regression of kafka initialization
Release 0.7.7 - 2018/08/27
* in_kafka_group: Add retry_limit and disable_retry_limit parameters
* input: Support SSL parameters
* Add ssl_ca_certs_from_system parameter
* Make password parameter secret
Release 0.7.6 - 2018/08/15
* out_kafka2: Add ignore_exceptions and exception_backup parameters
Release 0.7.5 - 2018/08/14
* out_kafka2: Fix `message_key_key` parameter handling
* Limit ruby-kafka version('< 0.7.0') to avoid runtime error
Release 0.7.4 - 2018/07/11
* out_kafka2: Need event_emitter helper for notification
Release 0.7.3 - 2018/05/30
* output: Use SSL endpoint when ssl_client_cert is true
Release 0.7.2 - 2018/03/12
* output: Fix the regression of get_kafka_client_log parameter
Release 0.7.1 - 2018/03/05
* out_kafka2: Fix the regression of kafka client initialization
Release 0.7.0 - 2018/02/27
* output: SASL PLAIN/SCRAM support
* input: Fix TimeParser location bug in v1
* out_kafka2: Fix warning condition for tag chunk key
Release 0.6.6 - 2017/12/25
* output: Make topic/partition/partition_key/message_key configurable
Release 0.6.5 - 2017/12/14
* in_kafka_group: Add client_id parameter
Release 0.6.4 - 2017/11/23
* Multi worker support for v0.14
* Add kafka_message_key parameter to input plugins
* Relax ruby-kafka version for 0.5 or later
* Use oj for json when it is installed
Release 0.6.3 - 2017/11/14
* in_kafka_group: re-create consumer when error happens during event fetch
Release 0.6.2 - 2017/11/1
* Fix ltsv parsing issue which generates symbol keys
Release 0.6.1 - 2017/08/30
* Add stats and datadog monitoring support
* ssl_ca_certs now accepts multiple paths
* Fix bug by ruby-kafka 0.4.1 changes
* Update ruby-kafka dependency to v0.4.1
Release 0.6.0 - 2017/07/25
* Add principal and keytab parameters for SASL support
Release 0.5.7 - 2017/07/13
* out_kafka_buffered: Add kafka_agg_max_messages parameter
Release 0.5.6 - 2017/07/10
* output: Add ActiveSupport notification support
Release 0.5.5 - 2017/04/19
* output: Some trace log level changed to debug
* out_kafka_buffered: Add discard_kafka_delivery_failed parameter
Release 0.5.4 - 2017/04/12
* out_kafka_buffered: Add max_send_limit_bytes parameter
* out_kafka: Improve buffer overflow handling of ruby-kafka
Release 0.5.3 - 2017/02/13
* Relax ruby-kafka dependency
Release 0.5.2 - 2017/02/13
* in_kafka_group: Add max_bytes parameter
Release 0.5.1 - 2017/02/06
* in_kafka_group: Fix uninitialized constant error
Release 0.5.0 - 2017/01/17
* output: Add out_kafka2 plugin with v0.14 API
Release 0.4.2 - 2016/12/10
* input: Add use_record_time and time_format parameters
* Update ruby-kafka dependency to 0.3.16.beta2
Release 0.4.1 - 2016/12/01
* output: Support specifying partition
Release 0.4.0 - 2016/11/08
* Remove zookeeper dependency
Release 0.3.5 - 2016/10/21
* output: Support message key and related parameters. #91
Release 0.3.4 - 2016/10/20
* output: Add exclude_topic_key and exclude_partition_key. #89
Release 0.3.3 - 2016/10/17
* out_kafka_buffered: Add get_kafka_client_log parameter. #83
* out_kafka_buffered: Skip and log invalid record to avoid buffer stuck. #86
* in_kafka_group: Add retry_emit_limit to handle BufferQueueLimitError. #87
Release 0.3.2 - 2016/10/06
* in_kafka_group: Re-fetch events after consumer error. #79
Release 0.3.1 - 2016/08/28
* output: Change default required_acks to -1. #70
* Support ruby version changed to 2.1.0 or later
Release 0.3.0 - 2016/08/24
* Fully replace poseidon ruby library with ruby-kafka to support latest kafka versions
See git commits for older changes