[
https://issues.apache.org/jira/browse/KAFKA-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17745620#comment-17745620
]
Jorge Esteban Quilcate Otoya commented on KAFKA-15231:
------------------------------------------------------
Thanks [~divijvaidya]. Of course if remote tier becomes unavailable, pausing
won't be of much help.
I'm thinking more of scenarios where uploading wants to be paused, but fetching
should continue. For instance: network/storage saturation where reads want to
be prioritized over writes, or storage migration where writing wants to be
paused until new storage is provided.
I may be jumping to far ahead here, but seems like a potentially useful feature
to consider.
> Add ability to pause/resume Remote Log Manager tasks
> -----------------------------------------------------
>
> Key: KAFKA-15231
> URL: https://issues.apache.org/jira/browse/KAFKA-15231
> Project: Kafka
> Issue Type: Improvement
> Components: core
> Reporter: Jorge Esteban Quilcate Otoya
> Priority: Major
> Labels: tiered-storage
>
> Once Tiered Storage is enabled, there may be situations where needed to pause
> uploading tasks to a remote-tier. e.g. remote storage maintenance,
> troubleshooting, etc.
> An RSM implementation may not be able to do this by itself without throwing
> exceptions, polluting the logs, etc.
> Could we consider adding this ability to the Tiered Storage framework? Remote
> Log Manager seems like a good candidate place for this; though I'm wondering
> on how to expose it.
> Would be interested to hear if this sounds like a good idea, and what options
> we have to include these.
> We have been considering extending RLM tasks with a pause flag, and having an
> MBean to switch them on demand. Another option may be to extend the Kafka
> protocol to expose this – but seems much moved involved.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
