RE: Hadoop Serialization mechanisms

2014-03-31 Thread Peter Marron
mechanisms Second try. Please find some time to answer some of my queries. Thanks, -RR From: radhe.krishna.ra...@live.commailto:radhe.krishna.ra...@live.com To: user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: Hadoop Serialization mechanisms Date: Thu

Re: Hadoop Serialization mechanisms

2014-03-31 Thread Jay Vyas
But I believe w.r.t. will we see performance gains when using avro/thrift/... over writables -- it depends on the writable implementation.For example, If I have a writable serialization which can use a bit map to store an enum, but then read that enum as a string: It will look the same to

Re: Hadoop Serialization mechanisms

2014-03-30 Thread Harsh J
Does Hadoop provides a pluggible feature for Serialization for both the above cases? - You can override the RPC serialisation module and engine with a custom class if you wish to, but it would not be trivial task. - You can easily use custom data serialisation modules for I/O. Is Writable