[
https://issues.apache.org/jira/browse/HADOOP-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644835#comment-14644835
]
Colin Patrick McCabe commented on HADOOP-12261:
-----------------------------------------------
Oh, I wasn't suggesting making Docker a prerequisite for anything. I was just
suggesting that using Docker would help ensure a repeatable test environment on
Jenkins (and perhaps elsewhere). For example, in the past we had problems with
unit tests creating directories with the executable bit not set. "Maven clean"
does not remove those directories, so they could linger and cause all
subsequent unit tests run on a particular slave to fail. We've also had
problems with people using unsupported versions of Java (I forget the names,
but there are some pretty esoteric JVMs out there, and they don't really work
100% with Hadoop.) Docker would help avoid both of these problems and give
people running the tests at home a better experience.
bq. The change is simply to edit hadoop-project/pom.xml and change the
-Xmx4096m value, but I'm not convinced the tests will work with less memory -
I've seen at least one OOM.
Can you post the patch so that we can find out? :) Also, I can't +1 my own
patch, so I really do need you (as opposed to me) to post it. It's a
procedural thing...
bq. The biggest problem I have is the unpredictability of the tests - I get
different results on every run, even on Linux, which makes it impossible to
know if any particular failure is due to a change you've made or just part of
the general random brokenness of the tests.
Yeah, it's frustrating that this happens... I have observed it as well. I
wonder why local test runs are flaky, but Jenkins seems to be relatively
predictable? Perhaps some tests can't run on smaller machines?
> Surefire needs to make sure the JVMs it fires up fit within the memory
> available
> --------------------------------------------------------------------------------
>
> Key: HADOOP-12261
> URL: https://issues.apache.org/jira/browse/HADOOP-12261
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: test
> Affects Versions: 2.7.1
> Reporter: Alan Burlison
> Assignee: Alan Burlison
>
> hadoop-project/pom.xml sets maven-surefire-plugin.argLine to include
> -Xmx4096m. Allocating that amount of memory requires a 64-bit JVM, but on
> platforms with both 32 and 64-bit JVMs surefire runs the 32 bit version by
> default and tests fail to start as a result. "-d64" should be added to the
> command-line arguments to ensure a 64-bit JVM is always used.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
