Vitaly Brodetskyi created AMBARI-11837:
------------------------------------------

             Summary: Simple insert takes up 6 slots with tez: 
mapreduce.input.fileinputformat.split.minsize=1 should be changed
                 Key: AMBARI-11837
                 URL: https://issues.apache.org/jira/browse/AMBARI-11837
             Project: Ambari
          Issue Type: Bug
          Components: ambari-server
            Reporter: Vitaly Brodetskyi
            Assignee: Vitaly Brodetskyi
            Priority: Critical
             Fix For: 2.1.0


{noformat}
create table test (f1 int, f2 int);
insert into table test values (10,10);
{noformat}

This ends up creating 6 containers (HiveInput creates 6 splits) in hive1 queue 
in cn041 cluster.  Accidentally one could use couple of JDBC programs to use up 
all available slots with simple inserts.

Appears that "mapreduce.input.fileinputformat.split.minsize" is set to 1. 
Setting it to a higher value 
"mapreduce.input.fileinputformat.split.minsize=1000000" fixes the problem and 
launches 1 container. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to