Hey Stack, The advantage: Doug is working hard to deprecate Writables in the Hadoop codebase in favor of Avro serialization. Avro serialization should be more compact, as you mention, but has many additional advantages. Once multiple language implementations are in place, building utilities to analyze and debug the WAL will be far easier with Avro.
Later, Jeff On Tue, Dec 15, 2009 at 8:32 PM, stack <st...@duboce.net> wrote: > What do you see as advantage Jeff? I suppose it'd be more compact that > current Writable-based serialization. Current HBase WAL is a > SequenceFile. > We'd have to move away from that? > Thanks, > St.Ack > > > On Tue, Dec 15, 2009 at 7:46 PM, Jeff Hammerbacher <ham...@cloudera.com > >wrote: > > > Hey, > > > > Inspired by Drizzle's use of Protobufs for their transaction log format > > (e.g. > > > > > http://jpipes.com/index.php?/archives/299-Drizzle-Replication-The-Transaction-Log.html > > ): > > how crazy would it be to try out Avro's binary format for the HBase WAL? > > > > Thanks, > > Jeff > > >
