[ 
https://issues.apache.org/jira/browse/HADOOP-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617729#action_12617729
 ] 

Hadoop QA commented on HADOOP-3646:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  
http://issues.apache.org/jira/secure/attachment/12387075/HADOOP-3646-version5.patch
  against trunk revision 680577.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 6 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac 
compiler warnings.

    -1 findbugs.  The patch appears to introduce 1 new Findbugs warnings.

    +1 release audit.  The applied patch does not increase the total number of 
release audit warnings.

    +1 core tests.  The patch passed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2967/testReport/
Findbugs warnings: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2967/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2967/artifact/trunk/build/test/checkstyle-errors.html
Console output: 
http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2967/console

This message is automatically generated.

> Providing bzip2 as codec
> ------------------------
>
>                 Key: HADOOP-3646
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3646
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: conf, io
>    Affects Versions: 0.19.0
>            Reporter: Abdul Qadeer
>            Assignee: Abdul Qadeer
>             Fix For: 0.19.0
>
>         Attachments: HADOOP-3646-version4.patch, HADOOP-3646-version5.patch, 
> HADOOP-3646.patch, HADOOP-3646.patch, HADOOP-3646version3.patch
>
>   Original Estimate: 1008h
>  Remaining Estimate: 1008h
>
> Hadoop recognizes gzip compressed input and automatically decompresses the 
> data before providing it to the mapper. But Hadoop can not split a gzip 
> stream due to the very nature of the gzip compression. Consequently one gzip 
> stream (e.g a whole file) can go to only one mapper.  On the contrary Bzip2 
> compressed stream can be split across its block delimiters.
> We are interested in extending Hadoop to support splittable bzip2 with a 
> codec.  (https://issues.apache.org/jira/browse/HADOOP-1823  uses input reader 
> to split the bzip2 files, which must be provided by the user and can handle 
> FileInputFormat.  If a user wants to use some other input format or wants to 
> do custom record handling, he must write a new input reader!)
> We have a patch now that provides a basic bzip2 codec equivalent to the 
> current gzip codec.  We are in the process of extending that to support 
> splitting.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to