----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37347/ -----------------------------------------------------------
Review request for hive. Bugs: HIVE-11518 https://issues.apache.org/jira/browse/HIVE-11518 Repository: hive-git Description ------- Resource requirements for each tasks are varied but currently it's fixed to one value(via hive.tez.container.size). It would be good to customize resource requirements appropriate to expected work. Suggested interface is quite simple. {code} public interface ResourceCalculator { Resource adjust(Resource resource, MapWork mapWork); Resource adjust(Resource resource, ReduceWork reduceWork); } {code} Diffs ----- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 9cc7987 common/src/java/org/apache/hive/common/util/ReflectionUtil.java 05aebc2 ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java f773cb9 ql/src/java/org/apache/hadoop/hive/ql/exec/tez/ResourceCalculator.java PRE-CREATION ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SimpleCalculator.java PRE-CREATION Diff: https://reviews.apache.org/r/37347/diff/ Testing ------- Thanks, Navis Ryu