Rajesh Balamohan created HIVE-24075: ---------------------------------------
Summary: Optimise KeyValuesInputMerger
Key: HIVE-24075
URL: https://issues.apache.org/jira/browse/HIVE-24075
Project: Hive
Issue Type: Improvement
Reporter: Rajesh Balamohan
Comparisons in KeyValueInputMerger can be reduced.
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/tools/KeyValuesInputMerger.java#L165|https://github.infra.cloudera.com/CDH/hive/blob/cdpd-master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/tools/KeyValuesInputMerger.java#L165]
[https://github.infra.cloudera.com/CDH/hive/blob/cdpd-master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/tools/KeyValuesInputMerger.java#L150|https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/tools/KeyValuesInputMerger.java#L150]
If the reader comparisons in the queue are same, we could reuse
"{{nextKVReaders}}" in next subsequent iteration instead of doing the
comparison all over again.
[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/tools/KeyValuesInputMerger.java#L178]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
