Steve Loughran commented on MAPREDUCE-4980:

If its going through configs & is splnning up a new MR app for each one, so 
that bit does need to be isolated. And it does its best with static HDFS & YARN 

Looking at the code, the job it is starting is "SleepJob", which does as it 
says: sleeps a long time. Which is why the tests take so long. It is a series 
of tests which sleep(). That's also why they set such a big test timeout of 
their own.

It does go into the integration test category in terms of processes & work, 
except then there's a risk of it not being run on Yetus tests of MAPREDUCE 
patches, isn't it? And that could miss things.

FWIW, in hadoop-aws & soon hadoop-azure, we have a "scale" profile which runs 
the slower tests: more files, bigger files. Maybe we could have a standard 
-Dscale profile, and put this in. So if you don't run with scale, this test 
gets skipped.

thx for doing this work BTW. Welcome to the QA team

> Parallel test execution of hadoop-mapreduce-client-core
> -------------------------------------------------------
>                 Key: MAPREDUCE-4980
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4980
>             Project: Hadoop Map/Reduce
>          Issue Type: Test
>          Components: test
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Tsuyoshi Ozawa
>            Assignee: Andrey Klochkov
>         Attachments: MAPREDUCE-4980.010.patch, MAPREDUCE-4980.1.patch, 
> MAPREDUCE-4980--n3.patch, MAPREDUCE-4980--n4.patch, MAPREDUCE-4980--n5.patch, 
> MAPREDUCE-4980--n6.patch, MAPREDUCE-4980--n7.patch, MAPREDUCE-4980--n7.patch, 
> MAPREDUCE-4980--n8.patch, MAPREDUCE-4980.patch
> The maven surefire plugin supports parallel testing feature. By using it, the 
> tests can be run more faster.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org

Reply via email to