[ 
https://issues.apache.org/jira/browse/HADOOP-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615499#action_12615499
 ] 

Hadoop QA commented on HADOOP-9:
--------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12386584/hadoop9.patch
  against trunk revision 678593.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2920/testReport/
Findbugs warnings: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2920/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2920/artifact/trunk/build/test/checkstyle-errors.html
Console output: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2920/console

This message is automatically generated.

> mapred.local.dir  temp dir. space allocation limited by smallest area
> ---------------------------------------------------------------------
>
>                 Key: HADOOP-9
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>         Environment: all
>            Reporter: Paul Baclace
>            Assignee: Ari Rabkin
>            Priority: Minor
>         Attachments: hadoop9.patch
>
>
> When mapred.local.dir is used to specify multiple  temp dir. areas, space 
> allocation limited by smallest area because the temp dir. selection algorithm 
> is "round robin starting from a randomish point".   When round robin is used 
> with approximately constant sized chunks, the smallest area runs out of space 
> first, and this is a fatal error. 
> Workaround: only list local fs dirs in mapred.local.dir with similarly-sized 
> available areas.
> I wrote a patch to JobConf (currenly being tested) which uses df to check 
> available space (once a minute or less often) and then uses an efficient 
> roulette selection to do allocation weighted by magnitude of available space. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to