[
https://issues.apache.org/jira/browse/HADOOP-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934666#action_12934666
]
Owen O'Malley commented on HADOOP-6685:
---------------------------------------
{quote}
SequenceFile does not support indexes either. Indexes are provided by the
MapFile API, etc., which are implemented as a pair of SequenceFiles. The same
can be done with a pair of Avro data files.
{quote}
It _could_ be, but hasn't been done. If the user doesn't want to implement
their own, either the OFile implementation from HADOOP-6684 or MapFile from
this patch are the two choices.
{quote}
The declared topic of this issue is the representation of serialization
metadata, not data file formats.
{quote}
You vetoed the patch because it included changes to SequenceFile. Therefore the
limitations of the Avro file format are completely germane.
> Change the generic serialization framework API to use serialization-specific
> bytes instead of Map<String,String> for configuration
> ----------------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-6685
> URL: https://issues.apache.org/jira/browse/HADOOP-6685
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.22.0
>
> Attachments: libthrift.jar, serial.patch, serial4.patch,
> serial6.patch, serial7.patch, SerializationAtSummit.pdf
>
>
> Currently, the generic serialization framework uses Map<String,String> for
> the serialization specific configuration. Since this data is really internal
> to the specific serialization, I think we should change it to be an opaque
> binary blob. This will simplify the interface for defining specific
> serializations for different contexts (MAPREDUCE-1462). It will also move us
> toward having serialized objects for Mappers, Reducers, etc (MAPREDUCE-1183).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
