[
https://issues.apache.org/jira/browse/HIVE-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-20999:
---------------------------
Labels: performance (was: )
> LLAP IO: MutableQuantiles is contended heavily
> ----------------------------------------------
>
> Key: HIVE-20999
> URL: https://issues.apache.org/jira/browse/HIVE-20999
> Project: Hive
> Issue Type: Bug
> Components: llap
> Affects Versions: 3.1.1
> Reporter: Gopal V
> Priority: Major
> Labels: performance
>
> MutableQuantiles::add() is synchronized across all threads.
> {code}
> IO-Elevator-Thread-0 [DAEMON] State: BLOCKED CPU usage on sample: 316ms
> org.apache.hadoop.metrics2.lib.MutableQuantiles.add(long)
> MutableQuantiles.java:133
> org.apache.hadoop.hive.llap.metrics.LlapDaemonIOMetrics.addDecodeBatchTime(long)
> LlapDaemonIOMetrics.java:98
> org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer.consumeData(EncodedColumnBatch)
> EncodedDataConsumer.java:89
> org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer.consumeData(Object)
> EncodedDataConsumer.java:34
> org.apache.hadoop.hive.ql.io.orc.encoded.EncodedReaderImpl.readEncodedColumns(int,
> StripeInformation, OrcProto$RowIndex[], List, List, boolean[], boolean[],
> Consumer) EncodedReaderImpl.java:530
> org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.performDataRead()
> OrcEncodedDataReader.java:407
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
