Mostly looks fine.
Note that a varint can be up to 5 bytes. You should probably just use
CodedOutputStream::Varint32Size() to compute the exact size so that you can
allocate a buffer that is exactly large enough.
Also note that if your message is large (say, 10k or more), allocating a
single large buffer may make the memory allocator unhappy. I'm not sure
what type m_Stream is, but you might consider wrapping it in a
ZeroCopyOutputStream and wrapping that in a CodedOutputStream, then writing
to that, so that it doesn't have to buffer the whole message all at once.
Note that CopyingOutputStreamAdaptor makes it pretty easy to adapt
traditional output streams to ZeroCopyOutputStream:
On Tue, Jun 16, 2009 at 8:48 PM, Alex Black <a...@alexblack.ca> wrote:
> Thanks, I got something working...how does this look? (ugly I'm sure...)
> On the C++ server side I am looping sending many messages (all of the same
> type), and on the Java side I am looping parsing them out.
> C++ Server:
> int size = message.ByteSize();
> EnsureBufferIsAtLeastSize(size + 4);
> char* pBuffer = (char*)
> (google::protobuf::uint8*) m_pBuffer);
> // Serialize the message
> bool result = message.SerializeToArray(pBuffer, size);
> // Calculate how many bytes the 'size' took
> int sizeSize = pBuffer - m_pBuffer;
> // Write the message to the stream
> m_Stream.Write(m_pBuffer,size + sizeSize);
> Java client:
> com.google.protobuf.CodedInputStream stream =
> while ( !stream.isAtEnd() )
> Foor.Bar.Builder builder = Foo.Bar.newBuilder();
> stream.readMessage(builder, null);
> Foo.Bar message = builder.build();
> *From:* Christopher Smith [mailto:cbsm...@gmail.com]
> *Sent:* Monday, June 15, 2009 2:58 PM
> *To:* Alex Black
> *Cc:* Protocol Buffers
> *Subject:* Re: 'Streaming' messages (say over a socket)
> The normal way to do it is to send each Entity as a separate message.
> CodedInput/OutputStream is handed for that kind of thing.
> On Sun, Jun 14, 2009 at 4:14 PM, Alex Black <a...@alexblack.ca> wrote:
>> Is there a way to start sending a message before its fully composed?
>> Say we have messages like this:
>> message Entity
>> required int32 id = 1;
>> required string name = 2;
>> message Entities
>> repeated Entity entity = 1;
>> If we're sending a message Entities with 1,000 Entity objects in it,
>> is there a way to avoid composing the entire message in memory,
>> serializing it, and then sending it out?
>> I'd like to avoid allocating RAM for the entire message, and just send
>> it out as I compose it...
>> - Alex
You received this message because you are subscribed to the Google Groups
"Protocol Buffers" group.
To post to this group, send email to firstname.lastname@example.org
To unsubscribe from this group, send email to
For more options, visit this group at