[
https://issues.apache.org/jira/browse/FLINK-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17078507#comment-17078507
]
Aljoscha Krettek commented on FLINK-15362:
------------------------------------------
I did the easy fixing of the reflective code but I'm afraid this doesn't work
anymore with Kafka versions > 2.3.x. I spent a day debugging this and what I
found in the end is this change:
https://github.com/apache/kafka/pull/5971/files.
The {{Sender}} thread of the {{Producer}} will now actively abort incomplete
transactions on shutdown, see {{"Aborting incomplete transaction due to
shutdown"}}. Our Kafka Producer will get an {{InvalidTxnStateException}}, that
it swallows, but in this case it's a valid exception because upon recovery we
try to finalize a transaction that was already aborted in the
{{TransactionCoordinator}}. Aborting the transaction can be seen in the DEBUG
logs of the {{TransactionCoordinator}}.
[~pnowojski] Could you confirm this?
> Bump Kafka client version to 2.4.0 for universal Kafka connector
> ----------------------------------------------------------------
>
> Key: FLINK-15362
> URL: https://issues.apache.org/jira/browse/FLINK-15362
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Kafka
> Reporter: vinoyang
> Assignee: Aljoscha Krettek
> Priority: Major
>
> Kafka 2.4 has been released recently. There are many features are involved in
> this version. More details:
> https://blogs.apache.org/kafka/entry/what-s-new-in-apache1
> IMO, it would be better to bump the Kafka client version to 2.4.0.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
