[jira] [Commented] (HDDS-11345) Add metrics specific to reconciliation tasks

2025-01-21 Thread Aswin Shakil (Jira)


[ 
https://issues.apache.org/jira/browse/HDDS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17915830#comment-17915830
 ] 

Aswin Shakil commented on HDDS-11345:
-

The metrics for reconciliation tasks are already available as a part of 
*ReplicationSupervisor* class which includes:
* Number of reconciliation tasks
* Number of queued tasks
* Number of timed-out tasks
* Number of Success
* Number of Failures
* Number of Skipped Tasks
* Latency metrics for the tasks

Other container reconciliation-related tasks are encapsulated in the following 
classes,
*ContainerMerkleTreeMetrics*:
*  Number of Merkle tree write failure
* Number of Merkle tree read failure
* Number of Merkle tree diff failure
* Number of container diff that doesn't require repair
* Number of container diff that require repair
* Merkle tree write latency
* Merkle tree read latency
* Merkle tree creation latency
* Merkle tree diff latency

This task can be reduced to testing the reconciliation task metrics in 
Replication Supervisor.

> Add metrics specific to reconciliation tasks
> 
>
> Key: HDDS-11345
> URL: https://issues.apache.org/jira/browse/HDDS-11345
> Project: Apache Ozone
>  Issue Type: Sub-task
>Reporter: Ethan Rose
>Assignee: Aswin Shakil
>Priority: Major
>
> HDDS-10373 added metrics specific to merkle tree generation and HDDS-11254 
> made reconciliation count towards the replication supervisor's metrics. 
> However we still need metrics specific to full reconciliation tasks.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.org
For additional commands, e-mail: issues-h...@ozone.apache.org



[jira] [Commented] (HDDS-11345) Add metrics specific to reconciliation tasks

2024-08-20 Thread Ethan Rose (Jira)


[ 
https://issues.apache.org/jira/browse/HDDS-11345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875279#comment-17875279
 ] 

Ethan Rose commented on HDDS-11345:
---

Here are some ideas of metrics we can include:
- Number of currently queued tasks
- Number of currently executing tasks
- Average task time
- Total succeeded
- Total failed

> Add metrics specific to reconciliation tasks
> 
>
> Key: HDDS-11345
> URL: https://issues.apache.org/jira/browse/HDDS-11345
> Project: Apache Ozone
>  Issue Type: Sub-task
>Reporter: Ethan Rose
>Priority: Major
>
> HDDS-10373 added metrics specific to merkle tree generation and HDDS-11254 
> made reconciliation count towards the replication supervisor's metrics. 
> However we still need metrics specific to full reconciliation tasks.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.org
For additional commands, e-mail: issues-h...@ozone.apache.org