[ 
https://issues.apache.org/jira/browse/MAPREDUCE-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tom White updated MAPREDUCE-3607:
---------------------------------

    Attachment: MAPREDUCE-3607.patch

Here's a new patch which adds FieldSelectionMapper/Reducer, NLineInputFormat, 
SequenceFile input/output formats, JobControl, and partition classes, along 
with tests for all of the classes.

The results of test-patch:

{noformat}
     [exec] -1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 100 new or 
modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning 
messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number 
of javac compiler warnings.
     [exec] 
     [exec]     -1 findbugs.  The patch appears to introduce 5 new Findbugs 
(version 1.3.9) warnings.
{noformat}

Note the findbugs warnings are present in trunk too, since this is a backport. 
Tests pass.

I would like this to be considered for inclusion in 1.1.0.
                
> Port missing new API mapreduce lib classes to 1.x
> -------------------------------------------------
>
>                 Key: MAPREDUCE-3607
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3607
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: client
>    Affects Versions: 1.0.0
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: MAPREDUCE-3607.patch, MAPREDUCE-3607.patch
>
>
> There are a number of classes under mapreduce.lib that are not present in the 
> 1.x series. Including these would help users and downstream projects using 
> the new MapReduce API migrate to later versions of Hadoop in the future.
> A few examples of where this would help:
> * Sqoop uses mapreduce.lib.db.DBWritable and 
> mapreduce.lib.input.CombineFileInputFormat (SQOOP-384).
> * Mahout uses mapreduce.lib.output.MultipleOutputs (MAHOUT-822).
> * HBase has a backport of mapreduce.lib.partition.InputSampler and 
> TotalOrderPartitioner (in org.apache.hadoop.hbase.mapreduce.hadoopbackport) - 
> it would be better if it used the ones in Hadoop.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to