[
https://issues.apache.org/jira/browse/HADOOP-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sharad Agarwal updated HADOOP-3829:
-----------------------------------
Attachment: 3829_v4.patch
Fixed an issue in ReduceTask#SkippingReduceValuesIterator.
Added more documentation to SkipBadRecords.
Made writing of skip records optional.
Incorporated Devaraj's offline comment to remove the SkipBadRecords.ENABLED
flag as it is now redundant after the addition of
MAPPER_MAX_SKIP_RECORDS/REDUCER_MAX_SKIP_GROUPS.
> Narrown down skipped records based on user acceptable value
> -----------------------------------------------------------
>
> Key: HADOOP-3829
> URL: https://issues.apache.org/jira/browse/HADOOP-3829
> Project: Hadoop Core
> Issue Type: New Feature
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Sharad Agarwal
> Assignee: Sharad Agarwal
> Fix For: 0.19.0
>
> Attachments: 3829_v1.153_7.patch, 3829_v1.patch, 3829_v2.patch,
> 3829_v3.patch, 3829_v4.patch
>
>
> This is an incremental step over HADOOP-153.
> If the number of skipped records in the neighborhood of a bad record are not
> acceptable to the user, then narrow down the skipped range to the user
> acceptable value.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
