[ 
https://issues.apache.org/jira/browse/AVRO-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16426672#comment-16426672
 ] 

mukesh katariya edited comment on AVRO-2166 at 4/5/18 9:38 AM:
---------------------------------------------------------------

I try to rebuild the avro file using snappy codec, the sync header was appended 
correctly this time at the end of the file.

Need to understand why this strange behaviour.


was (Author: jmukesh):
I try to rebuild the avro file using snappy codec, the sync header was appended 
correctly this time at the end of the files.

Need to understand why this strange behaviour.

> Wrong Sync header appended to the file.
> ---------------------------------------
>
>                 Key: AVRO-2166
>                 URL: https://issues.apache.org/jira/browse/AVRO-2166
>             Project: Avro
>          Issue Type: Bug
>          Components: java
>    Affects Versions: 1.8.2
>            Reporter: mukesh katariya
>            Priority: Major
>         Attachments: corrected-manualy.PNG, original-snappy-file.PNG
>
>
> We are using the following code, pseudo code for representation.
>  
> {code:java}
>  File file1 = new File("/tmp/tmpdata/message-" + System.currentTimeMillis());
>  FileOutputStream out = new FileOutputStream(file1, false);
>  DatumWriter datumWriter = new GenericDatumWriter<>();
>  writer = new DataFileWriter(datumWriter);
>  writer.setCodec(CodecFactory.snappyCodec());
>  writer.create(avroSchema, out);
>  
> //Records are from sink connector of kafka.   
> //Iterator over the records and bundling them together.
>  for( set of records ... )
>     writer.append(value);
>  writer.close();
> {code}
> The issue which we are facing is the sync code is not matching.
>  Original file with sync code at the end is wrong. avro tool failed with 
> error invalid sync.
> Since the header.sync and sync bytes after the block didnot match.
> !original-snappy-file.PNG! manually -replaced the 16 byte with sync bytes 
> from the header section. the file i was able to read using avro tools.
> !corrected-manualy.PNG!
>  Thanks and Best Regards
> Mukesh
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to