[
https://issues.apache.org/jira/browse/HADOOP-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HADOOP-12924:
----------------------------
Attachment: HADOOP-12924.2.patch
Thanks guys for the suggestions!
The v2 patch implements the proposed changes. Now different codecs map to
different policies. Each codec has its own config key for raw coders. When
creating RS raw coder, we need to specify a codec to use, otherwise
{{CodecUtil}} creates raw coders within {{rs-default}}.
Two things I'd like to mention.
# We should create raw coders according to codec in {{RSErasureEncoder}} and
{{RSErasureDecoder}}. But currently the coders don't carry codec with them. So
we just use the rs-default codec. It's OK for now because these coders are not
actually used.
# We don't validate the raw coder configured against the codec. Therefore if
user specifies an incompatible raw coder for a codec, the en/decoded data can
be different from expected.
Based on my discussion with Kai, I think we can leave these two as follow-on
tasks.
> Add default coder key for creating raw coders
> ---------------------------------------------
>
> Key: HADOOP-12924
> URL: https://issues.apache.org/jira/browse/HADOOP-12924
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Rui Li
> Assignee: Rui Li
> Priority: Minor
> Attachments: HADOOP-12924.1.patch, HADOOP-12924.2.patch
>
>
> As suggested
> [here|https://issues.apache.org/jira/browse/HADOOP-12826?focusedCommentId=15194402&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15194402].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
