[
https://issues.apache.org/jira/browse/KAFKA-20491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bill Bejeck resolved KAFKA-20491.
---------------------------------
Resolution: Fixed
> Enforce transaction buffer memory limitstatestore.uncommitted.max.bytes
> -----------------------------------------------------------------------
>
> Key: KAFKA-20491
> URL: https://issues.apache.org/jira/browse/KAFKA-20491
> Project: Kafka
> Issue Type: Sub-task
> Components: streams
> Reporter: Nicholas Telford
> Assignee: Nicholas Telford
> Priority: Major
>
> We will introduce a new {{statestore.uncommitted.max.bytes}} config, which
> controls the total memory permitted for buffering uncommitted writes in store
> transaction buffers.
> When {{enable.transactional.statestore}} is {{{}true{}}}, this memory limit
> will be divided between all {{{}StreamThread{}}}s (and the
> {{{}GlobalStreamThread{}}}, if the topology has global state) and enforced
> per-thread: whenever the limit is likely to be exceeded, the thread will
> trigger a premature commit of all its Tasks.
> This limit will be dynamic, since it must adjust if new {{{}StreamThread{}}}s
> are added/removed from the instance.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
