{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":698247765,"defaultBranch":"main","name":"flink-connector-kafka","ownerLogin":"davidradl","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2023-09-29T13:42:28.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/39792797?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1723651425.0","currentOid":""},"activityList":{"items":[{"before":"86f796a01cba0d7b3adeb95f413e412c30e466f1","after":"10fa5896c647d65286c9723c6db53a0fdefb417b","ref":"refs/heads/FLINK-35311-3","pushedAt":"2024-08-14T16:07:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"FLINK-35311 for review\n\nSigned-off-by: davidradl <david_radley@uk.ibm.com>","shortMessageHtmlLink":"FLINK-35311 for review"}},{"before":null,"after":"86f796a01cba0d7b3adeb95f413e412c30e466f1","ref":"refs/heads/FLINK-35311-3","pushedAt":"2024-08-14T16:03:45.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"[FLINK-35808] Let `ConsumerConfig.(KEY|VALUE)_DESERIALIZER_CLASS_CONFIG` be overridable by user in `KafkaSourceBuilder` (#108)\n\n## What is the purpose of the change\r\n\r\nLet `ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG` and `ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG` be overridable by user in `KafkaSourceBuilder`, in order to enable the Large Message use-case discussed in this [mailing list discussion](https://lists.apache.org/thread/spl88o63sjm2dv4l5no0ym632d2yt2o6). \r\n\r\nThis allows users to easily implement the [`claim check` large message pattern](https://developer.confluent.io/patterns/event-processing/claim-check/) without bringing any concerns into the Flink codebase otherwise, by specifying a `value.deserializer` that handles it, but otherwise passes through the bytes.\r\n\r\nNote: [overriding `value.serializer` is already supported on the Producer side. ](https://github.com/apache/flink-connector-kafka/blob/15d3fbd4e65dae6c334e2386dd337d2bf423c216/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/KafkaSinkBuilder.java#L82-L83)\r\n\r\nOther Reading:\r\nhttps://www.kai-waehner.de/blog/2020/08/07/apache-kafka-handling-large-messages-and-files-for-image-video-audio-processing/\r\nhttps://www.conduktor.io/kafka/how-to-send-large-messages-in-apache-kafka/#Option-1:-using-an-external-store-(GB-size-messages)-0\r\n\r\n## Brief change log\r\n- Updates key and value deserializers to be overridable by users in `KafkaSourceBuilder`\r\n\r\n## Verifying this change\r\n- [x] Test that both key and value  deserializers can be overridden\r\n- [x] Tests to ensure that the user-supplied deserializer(s) returns bytes (byte[])\r\n\r\n## Does this pull request potentially affect one of the following parts:\r\n\r\n- Dependencies (does it add or upgrade a dependency): no\r\n- The public API, i.e., is any changed class annotated with `@Public(Evolving)`: no\r\n- The serializers: yes\r\n- The runtime per-record code paths (performance sensitive): no\r\n- Anything that affects deployment or recovery: no\r\n- The S3 file system connector: no\r\n\r\n## Documentation\r\n\r\n- Does this pull request introduce a new feature? no\r\n- If yes, how is the feature documented? not applicable","shortMessageHtmlLink":"[FLINK-35808] Let `ConsumerConfig.(KEY|VALUE)_DESERIALIZER_CLASS_CONF…"}},{"before":"e25f1f112912d91d2af92b95e32d7f5941ab4d25","after":"6a8b7da3d72918812d1d1a5592dff6adc790fe5b","ref":"refs/heads/main","pushedAt":"2024-08-13T09:47:34.000Z","pushType":"push","commitsCount":10,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"Merge branch 'main' of https://github.com/davidradl/flink-connector-kafka","shortMessageHtmlLink":"Merge branch 'main' of <a href=\"https://github.com/davidradl/flink-connector-kafka\">https://github.com/davidradl/flink-connector-k…</a>"}},{"before":"f5ab34382462fc5c6025bb842b478a6636af02c8","after":"4c339fa74dbec0f91a035cb2bc31b227a0b71f7c","ref":"refs/heads/apicuriotls","pushedAt":"2024-04-26T11:49:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"merge\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"merge"}},{"before":"90a05660de749a54a65ec3895b8a803f6217d6c7","after":"f5ab34382462fc5c6025bb842b478a6636af02c8","ref":"refs/heads/apicuriotls","pushedAt":"2024-04-26T10:44:21.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"merge changes\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"merge changes"}},{"before":"c675bbaba10eaf72948bab03e0f6c389d9c955d7","after":"90a05660de749a54a65ec3895b8a803f6217d6c7","ref":"refs/heads/apicuriotls","pushedAt":"2024-04-26T10:33:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"amending to match ltest Flink interface\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"amending to match ltest Flink interface"}},{"before":"a2cf5ea8a37d4fb51a1d1e103cffbfd48c82314f","after":"e25f1f112912d91d2af92b95e32d7f5941ab4d25","ref":"refs/heads/main","pushedAt":"2024-04-24T16:17:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"remove extra files\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"remove extra files"}},{"before":"15f2662eccf461d9d539ed87a78c9851cd17fa43","after":"a2cf5ea8a37d4fb51a1d1e103cffbfd48c82314f","ref":"refs/heads/main","pushedAt":"2024-04-24T16:06:10.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"first draft for review\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"first draft for review"}},{"before":"6a602e5a1db668a51c99ee033c6759f663019f73","after":"c675bbaba10eaf72948bab03e0f6c389d9c955d7","ref":"refs/heads/apicuriotls","pushedAt":"2024-04-23T15:21:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"working Apiurio kafka\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"working Apiurio kafka"}},{"before":"2a2423865a25e08b5ab6e2502d22c6a8f9d5db84","after":"6a602e5a1db668a51c99ee033c6759f663019f73","ref":"refs/heads/apicuriotls","pushedAt":"2024-04-19T09:23:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"Apicurio mvp1\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"Apicurio mvp1"}},{"before":null,"after":"2a2423865a25e08b5ab6e2502d22c6a8f9d5db84","ref":"refs/heads/apicuriotls","pushedAt":"2024-03-05T14:36:57.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"early apicurio code\n\nSigned-off-by: David Radley <david_radley@uk.ibm.com>","shortMessageHtmlLink":"early apicurio code"}},{"before":"4c03d60e0fcbaf4ff0d659f39a132fae93191c71","after":"15f2662eccf461d9d539ed87a78c9851cd17fa43","ref":"refs/heads/main","pushedAt":"2024-02-22T16:16:31.000Z","pushType":"push","commitsCount":36,"pusher":{"login":"davidradl","name":"David Radley","path":"/davidradl","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39792797?s=80&v=4"},"commit":{"message":"[hotfix] Add JDK21 for 1.19-SNAPSHOT","shortMessageHtmlLink":"[hotfix] Add JDK21 for 1.19-SNAPSHOT"}}],"hasNextPage":false,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOC0xNFQxNjowNzo1NS4wMDAwMDBazwAAAASacv_w","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOC0xNFQxNjowNzo1NS4wMDAwMDBazwAAAASacv_w","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wMi0yMlQxNjoxNjozMS4wMDAwMDBazwAAAAQCNCNf"}},"title":"Activity · davidradl/flink-connector-kafka"}