forked from streamnative/kop
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[fix][transaction] Use pulsar format when write marker to __consumer_…
…offsets topic (streamnative#1994) ### Motivation We should use pulsar format to encode the marker when writing into the `__consumer_offsets` topic, otherwise it will have the following errors: ``` 2023-08-09T09:17:18,398+0000 [pulsar-client-io-69-3] ERROR org.apache.pulsar.client.impl.ConsumerImpl - [public/__kafka/__consumer_offsets-partition-42][reader-ca0ccccd79] Discarding corrupted message at 6:5 2023-08-09T09:17:18,402+0000 [pulsar-client-io-69-3] WARN org.apache.pulsar.client.impl.ConsumerImpl - [reader-ca0ccccd79] [98942] unable to obtain message in batch java.lang.IllegalStateException: java.lang.IllegalStateException: Some required fields are missing ``` ### Modifications Use pulsar format when write marker to __consumer_offsets topic (cherry picked from commit 5193592)
- Loading branch information
1 parent
34599a9
commit 0f4a99e
Showing
4 changed files
with
14 additions
and
7 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters