Repository: incubator-impala
Updated Branches:
  refs/heads/master 955b257cf -> 9a29dfc91


IMPALA-5080: OutOfMemory PermGen space

The problem is that over time our usage of PermGen space has
gradually gone up, recently hitting a point where we may run
out during testing. The fix is to increase the allowed max
perm gen space.

The default is 64mb on 32bit systems and 82mb on 64bit systems.
After bumping it up to 128mb, I haven't seen any failures on my
machine.

I also verified that this is not a leak by running the test,
test_java_udfs, 10 times, checking the perm gen usage with jmap,
running it a further 300 times, and checking that the perm gen
usage remained the same.

Change-Id: Iccfb69cdf7958e053890089db6a82ad491fb5b9d
Reviewed-on: http://gerrit.cloudera.org:8080/6642
Tested-by: Impala Public Jenkins
Reviewed-by: Matthew Jacobs <[email protected]>


Project: http://git-wip-us.apache.org/repos/asf/incubator-impala/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-impala/commit/1fa33153
Tree: http://git-wip-us.apache.org/repos/asf/incubator-impala/tree/1fa33153
Diff: http://git-wip-us.apache.org/repos/asf/incubator-impala/diff/1fa33153

Branch: refs/heads/master
Commit: 1fa331537acf4c2460f3787ba81a5a64cac89c99
Parents: 955b257
Author: Thomas Tauber-Marshall <[email protected]>
Authored: Fri Apr 14 13:28:52 2017 -0700
Committer: Matthew Jacobs <[email protected]>
Committed: Tue Apr 18 20:02:44 2017 +0000

----------------------------------------------------------------------
 bin/impala-config.sh | 3 +++
 1 file changed, 3 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-impala/blob/1fa33153/bin/impala-config.sh
----------------------------------------------------------------------
diff --git a/bin/impala-config.sh b/bin/impala-config.sh
index 3ee12ad..91d9106 100755
--- a/bin/impala-config.sh
+++ b/bin/impala-config.sh
@@ -432,6 +432,9 @@ export LIBHDFS_OPTS="${LIBHDFS_OPTS:-} 
-Djava.library.path=${HADOOP_LIB_DIR}/nat
 # TODO: Consider having cmake scripts change this value depending on
 # the build type.
 LIBHDFS_OPTS="${LIBHDFS_OPTS}:${IMPALA_HOME}/be/build/debug/service"
+# IMPALA-5080: Our use of PermGen space sometimes exceeds the default maximum 
while
+# running tests that load UDF jars.
+LIBHDFS_OPTS="${LIBHDFS_OPTS} -XX:MaxPermSize=128mb"
 
 export ARTISTIC_STYLE_OPTIONS="$IMPALA_BE_DIR/.astylerc"
 

Reply via email to