[
https://issues.apache.org/jira/browse/HADOOP-11445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14257412#comment-14257412
]
Hadoop QA commented on HADOOP-11445:
------------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12688889/HADOOP-11445.001.patch
against trunk revision 5caebba.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:red}-1 findbugs{color}. The patch appears to introduce 16 new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.
Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5335//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5335//artifact/patchprocess/newPatchFindbugsWarningshadoop-mapreduce-client-core.html
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5335//artifact/patchprocess/newPatchFindbugsWarningshadoop-common.html
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/5335//console
This message is automatically generated.
> Bzip2Codec: Data block is skipped when position of newly created stream is
> equal to start of split
> --------------------------------------------------------------------------------------------------
>
> Key: HADOOP-11445
> URL: https://issues.apache.org/jira/browse/HADOOP-11445
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 2.4.0
> Reporter: Ankit Kamboj
> Attachments: HADOOP-11445.001.patch
>
>
> bz2 input files are handled by FileInputFormat+LineRecordReader. In
> LineRecordReader, bz2 specific compressed input stream is created to iterate
> over records. After every new creation, the stream points to the beginning of
> next data block. The logic to find the beginning of next block depends on
> start of the split. The search begins at 10 bytes behind the start of split.
> If the first search creates input stream whose position is before or at start
> of split, next block beginning is sought (assuming that the record reader for
> previous split would have already iterated over the the data block in which
> current start of split lies). If the split start is just at the byte where a
> newly created stream is positioned (start of data block), attempt is made to
> find beginning of next data block. This doesn't seem correct because this
> will result in jumping a whole block and will result in missing records.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
