[
https://issues.apache.org/jira/browse/MAPREDUCE-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766178#comment-16766178
]
Steve Loughran commented on MAPREDUCE-7184:
-------------------------------------------
Update: I understand the issue now, have tests to replicate the problem and a
fix for this and the same issue which affects the createFileBuilder of
HADOOP-14394
Essentially: the create/open file builders need to refer back to the checksum
FS create/open methods to ensure that the checksumming on create and read are
taking place.
this little test found the problem. Thank you :)
> TestJobCounters byte counters omitting crc file bytes read
> ----------------------------------------------------------
>
> Key: MAPREDUCE-7184
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7184
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Prabhu Joseph
> Priority: Major
> Attachments: MAPREDUCE-7184-001.patch, MAPREDUCE-7184-002.patch,
> MAPREDUCE-7184-003.patch
>
>
> TestJobCounters test cases are failing in trunk while validating the input
> files size with BYTES_READ by the job. The crc files are considered in
> getFileSize whereas the job FileInputFormat ignores them.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
