[
https://issues.apache.org/jira/browse/IMPALA-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17302159#comment-17302159
]
ASF subversion and git services commented on IMPALA-10503:
----------------------------------------------------------
Commit c60a626ac66cc7cf24080b7ea84166c70bad9b22 in impala's branch
refs/heads/master from Kurt Deschler
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=c60a626 ]
IMPALA-10503: testdata load hits hive memory limit errors during hive inserts
Changed the following hive settings to avoid hitting Hive container
limit errors:
hive.tez.container.size: 2048
hive.tez.java.opts: -Xmx1700m
With these settings, testdata load completes without errors on a
32GB host.
Reviewed-by: Fang-Yu Rao <[email protected]>
Change-Id: Idac5f054e814070b983f7f57aef4ea9d54252bb2
Reviewed-on: http://gerrit.cloudera.org:8080/17061
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Aman Sinha <[email protected]>
> testdata load hits hive memory limit errors during hive inserts
> ---------------------------------------------------------------
>
> Key: IMPALA-10503
> URL: https://issues.apache.org/jira/browse/IMPALA-10503
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.4.0
> Reporter: Kurt Deschler
> Assignee: Kurt Deschler
> Priority: Major
>
> Hit these memory errors running the following on a 32GB host:
> {{buildall.sh-format -testdata }}{{[2020-09-15 13:24:08.751]Container killed
> on request. Exit code is 143}}
> {{[2020-09-15 13:24:08.751]Container exited with a non-zero exit code 143.}}
> {{]], TaskAttempt 1 failed, info=[Container
> container_1600192631322_0036_01_000006 finished with diagnostics set to
> [Container failed, exitCode=-104. [2020-09-15 13:24:20.868]Container
> [pid=24715,containerID=container_1600192631322_0036_01_000006] is running
> 14176256B beyond the 'PHYSICAL' memory limit. Current usage: 1.0 GB of 1 GB
> physical memory used; 2.9 GB of 2.1 GB virtual memory used. Killing
> container.}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
