hi,all:
        why i send a messageset of  872 bytes snappy-compressed data to 
kafka,and the messageSet stored in kafka was of 3940 payloadsize? 
        I used sarama AsyncProducer using snappy compression to send 
messageSet(5 messages per messageSet),I found that the origin data were 3940 
bytes, and the compressed data were 832 bytes.It indicated the snappy 
compression has worked..While I checked kafka log data??it showed "offset: 
1047825 position: 484851876 isvalid: true payloadsize: 3607 magic: 0 
compresscodec: SnappyCompressionCodec crc: 2412106187" and it seemed that the 
kafka broker had decode data and encode data again..
         How can I store compressed data in kafka which should be 832 bytes per 
messageSet in this case ? My kafka version is kafka_2.9.1-0.8.2.1.
                                                                                
                                                                                
                                                                           3ks!

Reply via email to