[
https://issues.apache.org/jira/browse/KAFKA-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Gustafson resolved KAFKA-10702.
-------------------------------------
Fix Version/s: 2.8.0
Resolution: Fixed
> Slow replication of empty transactions
> --------------------------------------
>
> Key: KAFKA-10702
> URL: https://issues.apache.org/jira/browse/KAFKA-10702
> Project: Kafka
> Issue Type: Improvement
> Reporter: Jason Gustafson
> Assignee: Jason Gustafson
> Priority: Major
> Fix For: 2.8.0
>
>
> We hit a case in which we had to re-replicate a compacted topic from the
> beginning of the log. Some portions of the log consisted mostly of
> transaction markers, which were extremely slow to replicate. The problem is
> that `ProducerStateManager` adds all of these empty transactions to its
> internal collection of `ongoingTxns` before immediately removing them. There
> could be tens of thousands of empty transactions in the worst case from a
> single `Fetch` response, so this can create a huge amount of pressure on the
> broker.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
