[ 
https://issues.apache.org/jira/browse/HADOOP-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Todd Lipcon updated HADOOP-7379:
--------------------------------

    Attachment: hadoop-7379.txt

Here's a patch which does the following:
- protobufs can be serialized by ObjectWritable. They are length-prefixed with 
a varint and then written on the wire
- adds test for the writable format itself
- adds a call in TestIPC that uses a protobuf as a parameter and response

I see one spot for an optimization by removing a buffer copy on the read side, 
but I'd like to leave that for later.

> Add ability to include Protobufs in ObjectWritable
> --------------------------------------------------
>
>                 Key: HADOOP-7379
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7379
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: io, ipc
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: 0.23.0
>
>         Attachments: hadoop-7379.txt
>
>
> Per HDFS-2060, it would make it easier to piecemeal switch to protocol buffer 
> based data structures in the wire protocol if we could intermix the two. The 
> IPC framework currently provides the concept of "engines" for RPC, but that 
> doesn't easily allow mixed types within the same framework for ease of 
> transition.
> I'd like to add the cases to ObjectWritable to be handle subclasses of 
> {{Message}}, the superclass of codegenned protobufs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to