[
https://issues.apache.org/jira/browse/HADOOP-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12632319#action_12632319
]
Pete Wyckoff commented on HADOOP-3787:
--------------------------------------
bq. The simplest way to fix this is to always create a new object, but that's
won't work well until HADOOP-1230 is done.
You could also use a container object like in HADOOP-4065?? Or require that all
the thrift fields have the required attribue - at least a comment?
For this and RecordSerialization HADOOP-4199, there's also the issue that they
are both by default using Binary format whereas thrift, record io support
multiple formats. If thrift finally implements a compacted binary format, this
will be even more important since people will have both.
The other thing is Hive has something called TCTLSeparatedProtocol which
implements the Thrift Protocol interface and allows thrift to parse simple text
files with ctl separators. For us, we definitely have data in both Binary and
CTL seped, so would need a way to configure this.
But, I think those are add ons and you could submit this?
Also, can someone create a category for contrib/serialization?
> Add serialization for Thrift
> ----------------------------
>
> Key: HADOOP-3787
> URL: https://issues.apache.org/jira/browse/HADOOP-3787
> Project: Hadoop Core
> Issue Type: Wish
> Components: examples, mapred
> Reporter: Tom White
> Attachments: hadoop-3787.patch, libthrift.jar
>
>
> Thrift (http://incubator.apache.org/thrift/) is cross-language serialization
> and RPC framework. This issue is to write a ThriftSerialization to support
> using Thrift types in MapReduce programs, including an example program. This
> should probably go into contrib.
> (There is a prototype implementation in
> https://issues.apache.org/jira/secure/attachment/12370464/hadoop-serializer-v2.tar.gz)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
