-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37347/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-11518
    https://issues.apache.org/jira/browse/HIVE-11518


Repository: hive-git


Description
-------

Resource requirements for each tasks are varied but currently it's fixed to one 
value(via hive.tez.container.size). It would be good to customize resource 
requirements appropriate to expected work.

Suggested interface is quite simple.
{code}
public interface ResourceCalculator {

  Resource adjust(Resource resource, MapWork mapWork);

  Resource adjust(Resource resource, ReduceWork reduceWork);
}
{code}


Diffs
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 9cc7987 
  common/src/java/org/apache/hive/common/util/ReflectionUtil.java 05aebc2 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java f773cb9 
  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/ResourceCalculator.java 
PRE-CREATION 
  ql/src/test/org/apache/hadoop/hive/ql/exec/tez/SimpleCalculator.java 
PRE-CREATION 

Diff: https://reviews.apache.org/r/37347/diff/


Testing
-------


Thanks,

Navis Ryu

Reply via email to