[protobuf] Re: Serialized Object as a value in Key-Value store.

2011-10-03 Thread Eyal Farago
according to my experience, not so much I'm afraid... since PB format is length prefixed, or actually tag+length prefixed, the compression rates are not as high as one might expect. I migrated from an in-house XML format to a PB based format, the performance gain was amazing (both serialize and u

[protobuf] Re: Serialized Object as a value in Key-Value store.

2011-09-22 Thread Benjamin Wright
Protocol buffers does nothing to reduce the size of strings and string data trends to compress very well. In my experience you can expect similar gains as if you had a simple text file (very good) On Sep 22, 3:05 pm, Suraj wrote: > Hi Marc, > > Thanks for the reply. > > Ours is basically a tex

[protobuf] Re: Serialized Object as a value in Key-Value store.

2011-09-22 Thread Suraj
Hi Marc, Thanks for the reply. Ours is basically a text data. The record size varies, it is in the range from around 300Bytes to 3kB. But most of them will be more than 1k. I serialized one record from the production, and found that, the 3kB object, when serialized, became 728Byte string. Our dat