[
https://issues.apache.org/jira/browse/KAFKA-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Divij Vaidya updated KAFKA-15158:
---------------------------------
Description:
Add the following metrics for better observability into the RemoteLog related
activities inside the broker.
1. RemoteWriteRequestsPerSec
2. RemoteDeleteRequestsPerSec
3. BuildRemoteLogAuxStateRequestsPerSec
These metrics will be calculated at topic level (we can add them at
brokerTopicStats)
-*RemoteWriteRequestsPerSec* will be marked on every call to RemoteLogManager#-
-copyLogSegmentsToRemote()- already covered by KAFKA-14953
*RemoteDeleteRequestsPerSec* will be marked on every call to
RemoteLogManager#cleanupExpiredRemoteLogSegments(). This method is introduced
in [https://github.com/apache/kafka/pull/13561]
*BuildRemoteLogAuxStateRequestsPerSec* will be marked on every call to
ReplicaFetcherTierStateMachine#buildRemoteLogAuxState()
(Note: For all the above, add Error metrics as well such as
RemoteDeleteErrorPerSec)
(Note: This requires a change in KIP-405 and hence, must be approved by KIP
author [~satishd] )
was:
Add the following metrics for better observability into the RemoteLog related
activities inside the broker.
1. RemoteWriteRequestsPerSec
2. RemoteDeleteRequestsPerSec
3. BuildRemoteLogAuxStateRequestsPerSec
These metrics will be calculated at topic level (we can add them at
brokerTopicStats)
-*RemoteWriteRequestsPerSec* will be marked on every call to RemoteLogManager#-
-copyLogSegmentsToRemote()- already covered by KAFKA-14953
*RemoteDeleteRequestsPerSec* will be marked on every call to
RemoteLogManager#cleanupExpiredRemoteLogSegments(). This method is introduced
in [https://github.com/apache/kafka/pull/13561]
*BuildRemoteLogAuxStateRequestsPerSec* will be marked on every call to
ReplicaFetcherTierStateMachine#buildRemoteLogAuxState()
(Note that this requires a change in KIP-405 and hence, must be approved by KIP
author [~satishd] )
> Add metrics for RemoteRequestsPerSec
> ------------------------------------
>
> Key: KAFKA-15158
> URL: https://issues.apache.org/jira/browse/KAFKA-15158
> Project: Kafka
> Issue Type: Sub-task
> Reporter: Divij Vaidya
> Priority: Major
> Fix For: 3.6.0
>
>
> Add the following metrics for better observability into the RemoteLog related
> activities inside the broker.
> 1. RemoteWriteRequestsPerSec
> 2. RemoteDeleteRequestsPerSec
> 3. BuildRemoteLogAuxStateRequestsPerSec
>
> These metrics will be calculated at topic level (we can add them at
> brokerTopicStats)
> -*RemoteWriteRequestsPerSec* will be marked on every call to
> RemoteLogManager#-
> -copyLogSegmentsToRemote()- already covered by KAFKA-14953
>
> *RemoteDeleteRequestsPerSec* will be marked on every call to
> RemoteLogManager#cleanupExpiredRemoteLogSegments(). This method is introduced
> in [https://github.com/apache/kafka/pull/13561]
> *BuildRemoteLogAuxStateRequestsPerSec* will be marked on every call to
> ReplicaFetcherTierStateMachine#buildRemoteLogAuxState()
>
> (Note: For all the above, add Error metrics as well such as
> RemoteDeleteErrorPerSec)
> (Note: This requires a change in KIP-405 and hence, must be approved by KIP
> author [~satishd] )
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
