[
https://issues.apache.org/jira/browse/AMBARI-11837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vitaly Brodetskyi updated AMBARI-11837:
---------------------------------------
Attachment: AMBARI-11837.patch
> Simple insert takes up 6 slots with tez:
> mapreduce.input.fileinputformat.split.minsize=1 should be changed
> ----------------------------------------------------------------------------------------------------------
>
> Key: AMBARI-11837
> URL: https://issues.apache.org/jira/browse/AMBARI-11837
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Reporter: Vitaly Brodetskyi
> Assignee: Vitaly Brodetskyi
> Priority: Critical
> Fix For: 2.1.0
>
> Attachments: AMBARI-11837.patch
>
>
> {noformat}
> create table test (f1 int, f2 int);
> insert into table test values (10,10);
> {noformat}
> This ends up creating 6 containers (HiveInput creates 6 splits) in hive1
> queue in cn041 cluster. Accidentally one could use couple of JDBC programs
> to use up all available slots with simple inserts.
> Appears that "mapreduce.input.fileinputformat.split.minsize" is set to 1.
> Setting it to a higher value
> "mapreduce.input.fileinputformat.split.minsize=1000000" fixes the problem and
> launches 1 container.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)