I must be doing something wrong: I am writing out avro files with three
options:
a. no codec
b. deflate codec
c. snappy codec
I am measuring size of final avro file. In my observation, the snappy file
is larger than the original avro file? duh?
code snippet:
File fs = new File("$DATA/log_snappy.avro");
DatumWriter writer = new GenericDatumWriter(
schema);
dataFileWriter = new DataFileWriter(writer);
dataFileWriter.setCodec(CodecFactory.snappyCodec());
dataFileWriter.create(schema, fs);
while(...){
GenericRecord datum = //get datum from object
dataFileWriter.append(datum);
dataFileWriter.flush();
}
Thanks,
Nikhil
--
View this message in context:
http://apache-avro.679487.n3.nabble.com/avro-compression-using-snappy-and-deflate-tp3870167p3870167.html
Sent from the Avro - Users mailing list archive at Nabble.com.