Re: Review Request 46194: HDP 2.3.2.0: Changing hive tez container size (via ambari) should change tez.runtime.io.sort.mb as well

2016-04-14 Thread Srimanth Gunturi

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46194/#review128918
---


Ship it!




Ship It!

- Srimanth Gunturi


On April 14, 2016, 11:27 a.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/46194/
> ---
> 
> (Updated April 14, 2016, 11:27 a.m.)
> 
> 
> Review request for Ambari and Srimanth Gunturi.
> 
> 
> Bugs: AMBARI-15879
> https://issues.apache.org/jira/browse/AMBARI-15879
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> Observed this in HDP 2.3.2
> 
> Original hive tez container size: 24576  
> Original tez.runtime.io.sort.mb: 14950 or around this value
> 
> Changed hive tez container size to 16384. But tez.runtime.io.sort.mb remained
> at 14 GB. Hive queries starts failing due to mem issue.
> 
> Ideally, when hive tez container size is adjusted, tez.runtime.io.sort.mb
> should also be auto-adjusted in ambari (or a warning would be useful).
> 
> 
> Diffs
> -
> 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/stack_advisor.py 
> 3a65541 
> 
> Diff: https://reviews.apache.org/r/46194/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>



Review Request 46194: HDP 2.3.2.0: Changing hive tez container size (via ambari) should change tez.runtime.io.sort.mb as well

2016-04-14 Thread Andrew Onischuk

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46194/
---

Review request for Ambari and Srimanth Gunturi.


Bugs: AMBARI-15879
https://issues.apache.org/jira/browse/AMBARI-15879


Repository: ambari


Description
---

Observed this in HDP 2.3.2

Original hive tez container size: 24576  
Original tez.runtime.io.sort.mb: 14950 or around this value

Changed hive tez container size to 16384. But tez.runtime.io.sort.mb remained
at 14 GB. Hive queries starts failing due to mem issue.

Ideally, when hive tez container size is adjusted, tez.runtime.io.sort.mb
should also be auto-adjusted in ambari (or a warning would be useful).


Diffs
-

  ambari-server/src/main/resources/stacks/HDP/2.3/services/stack_advisor.py 
3a65541 

Diff: https://reviews.apache.org/r/46194/diff/


Testing
---

mvn clean test


Thanks,

Andrew Onischuk