Mark Wagner created HADOOP-13521:
------------------------------------

             Summary: SampleQuantile does not perform well under load
                 Key: HADOOP-13521
                 URL: https://issues.apache.org/jira/browse/HADOOP-13521
             Project: Hadoop Common
          Issue Type: Bug
          Components: metrics
    Affects Versions: 2.3.0
            Reporter: Mark Wagner


After adding quantile collection to one of our clusters we saw much higher 
latency for RPCs. This was traced down to the quantile collection. Samples are 
being buffered and inserted in groups of 500. After the buffered samples are 
inserted, the entire set of samples for this time period (600 seconds at the 
longest for us) is "compressed".

All operations for RPC metrics are synchronized. Usually this isn't an issue 
but it seems that this compression operation is taking a significant amount of 
time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to