[
https://issues.apache.org/jira/browse/IMPALA-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-7820:
----------------------------------
Description:
The embedded JVM by default uses 1/4 of system memory, which means potentially
up to 3/4 of system memory on a 3 node minicluster. IMPALA-6070 addresses this
for the docker case, but in general it would be good to solve this for all
miniclusters and ensure that all tests work with a smaller heap size so that
memory is not overcommitted in our test environments.
I tried running end-to-end tests with a 1Gb heap and ran into out-of-memory for
test_insert_large_string.
was:The embedded JVM by default uses 1/4 of system memory, which means
potentially up to 3/4 of system memory on a 3 node minicluster. IMPALA-6070
addresses this for the docker case, but in general it would be good to solve
this for all miniclusters and ensure that all tests work with a smaller heap
size so that memory is not overcommitted in our test environments.
> Limit JVM heap size in minicluster
> ----------------------------------
>
> Key: IMPALA-7820
> URL: https://issues.apache.org/jira/browse/IMPALA-7820
> Project: IMPALA
> Issue Type: Sub-task
> Components: Infrastructure
> Affects Versions: Impala 3.0, Impala 2.12.0, Impala 3.1.0
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Major
> Labels: resource-management
>
> The embedded JVM by default uses 1/4 of system memory, which means
> potentially up to 3/4 of system memory on a 3 node minicluster. IMPALA-6070
> addresses this for the docker case, but in general it would be good to solve
> this for all miniclusters and ensure that all tests work with a smaller heap
> size so that memory is not overcommitted in our test environments.
> I tried running end-to-end tests with a 1Gb heap and ran into out-of-memory
> for test_insert_large_string.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
