Srimanth Gunturi created AMBARI-5455:
----------------------------------------
Summary: Ambari configuration for map join conversion and tez
container size seems wrong
Key: AMBARI-5455
URL: https://issues.apache.org/jira/browse/AMBARI-5455
Project: Ambari
Issue Type: Bug
Components: client
Affects Versions: 1.5.1
Reporter: Srimanth Gunturi
Assignee: Srimanth Gunturi
Priority: Critical
Fix For: 1.5.1
For hive:
hive.auto.convert.join.noconditionaltask.size is set to 1000000000
- This should be a fraction (1/3) of the container size.
hive.tez.java.opts has "-Xmx1024m"
This is different from both map and reduce sizes. Desired values are:
- map size if map size > 2g else reduce size
map size is set on the same cluster to ~500mb
The settings as the are will lead to many failed queries because the mapjoin
conversion is to aggressive. If we don't change the container sizes based on
cluster configs we will see wide spread problems with containers being killed
or perf problems.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
