[ 
https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12932662#action_12932662
 ] 

Doug Cutting commented on HADOOP-6685:
--------------------------------------

Owen> they aren't optional dependences.

Indeed they aren't optional dependencies in the patch you have posted.  But 
most are not Hadoop dependencies at all before this patch.   Tom seems to be 
suggesting that this patch could be reduced to only introduce a serialization 
framework, not to add a number of implementations of it, nor I would add, to 
extend existing container file formats to incorporate new serializations.  That 
would bring the patch more in line with the description of this issue.  Perhaps 
the serialization implementations and the extension of the containers could be 
moved to different issues and this issue could focus on the serialization API 
itself?


> Change the generic serialization framework API to use serialization-specific 
> bytes instead of Map<String,String> for configuration
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-6685
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6685
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>             Fix For: 0.22.0
>
>         Attachments: libthrift.jar, serial.patch, serial4.patch, 
> serial6.patch, SerializationAtSummit.pdf
>
>
> Currently, the generic serialization framework uses Map<String,String> for 
> the serialization specific configuration. Since this data is really internal 
> to the specific serialization, I think we should change it to be an opaque 
> binary blob. This will simplify the interface for defining specific 
> serializations for different contexts (MAPREDUCE-1462). It will also move us 
> toward having serialized objects for Mappers, Reducers, etc (MAPREDUCE-1183).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to