aierate opened a new pull request, #6070: URL: https://github.com/apache/ozone/pull/6070
## What changes were proposed in this pull request? - Use the AggregatedMetrics replica the MutableRate XceiverClient Metrics of XceiverClientMetrics for Client and S3G. - The AggregatedMetrics including MutableQuantiles and MutableMinMax and MutableStat Metrics, the MutableStat is same with original MutableRate Metrics. - Replacing MutableRate with AggregatedMetrics ensures that the original MutableRate remains unchanged, and adds configurable MutableQuantiles and MutableMinMax metrics. - Reference from the following linkļ¼ https://github.com/apache/ozone/pull/5627 ### Before http://ozone:9878/jmx?qry=Hadoop:service=S3Gateway,name=XceiverClientMetrics ``` { "name" : "Hadoop:service=S3Gateway,name=XceiverClientMetrics", "modelerType" : "XceiverClientMetrics", "tag.Context" : "dfs", "tag.Hostname" : "conway-hadoop3", "numPendingCreateContainer" : 0, "opCountCreateContainer" : 0, "CreateContainerLatencyNumOps" : 0, "CreateContainerLatencyAvgTime" : 0.0, . . . "opCountWriteChunk" : 0, "WriteChunkLatencyNumOps" : 0, "WriteChunkLatencyAvgTime" : 0, . . . "numPendingStreamWrite" : 0, "opCountStreamWrite" : 0, "StreamWriteLatencyNumOps" : 0, "StreamWriteLatencyAvgTime" : 0.0, "EcReconstructionFailsTotal" : 0, "EcReconstructionTotal" : 0, "PendingOps" : 0, "TotalOps" : 0 }, ``` ### After http://ozone:9878/jmx?qry=Hadoop:service=S3Gateway,name=XceiverClientMetrics Default (Add MutableMinMax Metrics): ``` { "name" : "Hadoop:service=S3Gateway,name=XceiverClientMetrics", "modelerType" : "XceiverClientMetrics", "tag.Context" : "dfs", "tag.Hostname" : "conway-hadoop3", "numPendingCreateContainer" : 0, "opCountCreateContainer" : 0, "CreateContainerLatencyNumOps" : 0, "CreateContainerLatencyAvgTime" : 0.0, "CreateContainerLatencyIMinTime" : 0, "CreateContainerLatencyIMaxTime" : 0, . . . "opCountWriteChunk" : 1, "WriteChunkLatencyNumOps" : 1, "WriteChunkLatencyAvgTime" : 701.0, "WriteChunkLatencyIMinTime" : 0, "WriteChunkLatencyIMaxTime" : 0, . . . "numPendingStreamWrite" : 0, "opCountStreamWrite" : 0, "StreamWriteLatencyNumOps" : 0, "StreamWriteLatencyAvgTime" : 0.0, "StreamWriteLatencyIMinTime" : 0, "StreamWriteLatencyIMaxTime" : 0, "EcReconstructionFailsTotal" : 0, "EcReconstructionTotal" : 0, "PendingOps" : 0, "TotalOps" : 2 }, ``` Enable quantiles Metrics: ``` <property> <name>ozone.xceiver.metrics.percentiles.intervals.seconds</name> <value>60,300</value> </property> ``` http://ozone:9878/jmx?qry=Hadoop:service=S3Gateway,name=XceiverClientMetrics ``` { "name" : "Hadoop:service=S3Gateway,name=XceiverClientMetrics", "modelerType" : "XceiverClientMetrics", "tag.Context" : "dfs", "tag.Hostname" : "conway-hadoop3", "numPendingCreateContainer" : 0, "opCountCreateContainer" : 0, "CreateContainerLatencyNumOps" : 0, "CreateContainerLatencyAvgTime" : 0.0, "CreateContainerLatency60sNumOps" : 0, "CreateContainerLatency60s50thPercentileTime" : 0, "CreateContainerLatency60s75thPercentileTime" : 0, "CreateContainerLatency60s90thPercentileTime" : 0, "CreateContainerLatency60s95thPercentileTime" : 0, "CreateContainerLatency60s99thPercentileTime" : 0, "CreateContainerLatency300sNumOps" : 0, "CreateContainerLatency300s50thPercentileTime" : 0, "CreateContainerLatency300s75thPercentileTime" : 0, "CreateContainerLatency300s90thPercentileTime" : 0, "CreateContainerLatency300s95thPercentileTime" : 0, "CreateContainerLatency300s99thPercentileTime" : 0, . . . "numPendingWriteChunk" : 0, "opCountWriteChunk" : 1, "WriteChunkLatencyNumOps" : 1, "WriteChunkLatencyAvgTime" : 722.0, "WriteChunkLatency60sNumOps" : 1, "WriteChunkLatency60s50thPercentileTime" : 722, "WriteChunkLatency60s75thPercentileTime" : 722, "WriteChunkLatency60s90thPercentileTime" : 722, "WriteChunkLatency60s95thPercentileTime" : 722, "WriteChunkLatency60s99thPercentileTime" : 722, "WriteChunkLatency300sNumOps" : 0, "WriteChunkLatency300s50thPercentileTime" : 0, "WriteChunkLatency300s75thPercentileTime" : 0, "WriteChunkLatency300s90thPercentileTime" : 0, "WriteChunkLatency300s95thPercentileTime" : 0, "WriteChunkLatency300s99thPercentileTime" : 0, "WriteChunkLatencyIMinTime" : 0, "WriteChunkLatencyIMaxTime" : 0, . . . "numPendingStreamWrite" : 0, "opCountStreamWrite" : 0, "StreamWriteLatencyNumOps" : 0, "StreamWriteLatencyAvgTime" : 0.0, "StreamWriteLatency60sNumOps" : 0, "StreamWriteLatency60s50thPercentileTime" : 0, "StreamWriteLatency60s75thPercentileTime" : 0, "StreamWriteLatency60s90thPercentileTime" : 0, "StreamWriteLatency60s95thPercentileTime" : 0, "StreamWriteLatency60s99thPercentileTime" : 0, "StreamWriteLatency300sNumOps" : 0, "StreamWriteLatency300s50thPercentileTime" : 0, "StreamWriteLatency300s75thPercentileTime" : 0, "StreamWriteLatency300s90thPercentileTime" : 0, "StreamWriteLatency300s95thPercentileTime" : 0, "StreamWriteLatency300s99thPercentileTime" : 0, "StreamWriteLatencyIMinTime" : 0, "StreamWriteLatencyIMaxTime" : 0, "EcReconstructionFailsTotal" : 0, "EcReconstructionTotal" : 0, "PendingOps" : 0, "TotalOps" : 2 } ``` ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-10182 ## How was this patch tested? Manually Test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
