[
https://issues.apache.org/jira/browse/KAFKA-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias J. Sax updated KAFKA-20665:
------------------------------------
Description:
In the "classic" protocol, the HA assignor first computes a "final target"
assignment, and second refines it with an incremental "intermediate target"
assignment, keeping currently assigned tasks on their previous owner, and only
assigning (some) warmup tasks to prepare the actually migration.
With KIP-1071, we can use the reconciler though to take care of warmup tasks
(if configures). Ie, an assignor just compute the "final target" assignment,
and the reconciler applies it, using warmup tasks (if enabled).
This setup not only make the actual assignor simpler, but also decouples warmup
tasks from the assignor, and thus any assignor can benefit from warmup tasks.
was:
In the "classic" protocol, the HA assignor first computes a "final target"
assignment, and second refines it with an incremental "intermediate target"
assignment, keeping currently assigned tasks on their previous owner, and only
assigning (some) warmup tasks to prepare the actually migration.
With KIP-1071, we can use the reconciler though to take care of warmup tasks
(if configures). Ie, an assignor just compute the "final target" assignment,
and the reconciler applies it, using warmup tasks (if enabled).
This setup not only make the actual assignor simpler, but also decouples warmup
tasks from the assignor, and thus any assignor can not benefit from warmup
tasks.
> Add warmup task support to reconciler
> --------------------------------------
>
> Key: KAFKA-20665
> URL: https://issues.apache.org/jira/browse/KAFKA-20665
> Project: Kafka
> Issue Type: Sub-task
> Components: group-coordinator, streams
> Reporter: Matthias J. Sax
> Assignee: Matthias J. Sax
> Priority: Major
>
> In the "classic" protocol, the HA assignor first computes a "final target"
> assignment, and second refines it with an incremental "intermediate target"
> assignment, keeping currently assigned tasks on their previous owner, and
> only assigning (some) warmup tasks to prepare the actually migration.
> With KIP-1071, we can use the reconciler though to take care of warmup tasks
> (if configures). Ie, an assignor just compute the "final target" assignment,
> and the reconciler applies it, using warmup tasks (if enabled).
> This setup not only make the actual assignor simpler, but also decouples
> warmup tasks from the assignor, and thus any assignor can benefit from warmup
> tasks.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
