Re: [Avro] TypeSerializer Example

2021-05-10 Thread Sandeep khanzode
Hello, Can someone please assist for this query? Thanks! Thanks, Sandeep > On 06-May-2021, at 10:30 AM, Sandeep khanzode wrote: > > Hi, > > Is there a working example somewhere that I can refer for writing Avro > entities in Flink state as well as Avro serializaition in >

[Avro] Re: TypeSerializer Example

2021-05-05 Thread Sandeep khanzode
Hi, Is there a working example somewhere that I can refer for writing Avro entities in Flink state as well as Avro serializaition in KafkaConsumer/Producer? I tried to use Avro entities directly but there is an issue beyond Apache Avro 1.7.7 in that the entities created have a

Re: TypeSerializer Example

2021-04-30 Thread Timo Walther
I also found these pages: https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/schema_evolution.html https://flink.apache.org/news/2020/04/15/flink-serialization-tuning-vol-1.html#avro I hope this helps. Regards, Timo On 30.04.21 13:20, Sandeep khanzode wrote: Hi Timo,

Re: TypeSerializer Example

2021-04-30 Thread Sandeep khanzode
Hi Timo, Thanks! I will take a look at the links. Can you please share if you have any simple (or complex) example of Avro state data structures? Thanks, Sandeep > On 30-Apr-2021, at 4:46 PM, Timo Walther wrote: > > Hi Sandeep, > > did you have a chance to look at this documentation page?

Re: TypeSerializer Example

2021-04-30 Thread Timo Walther
Hi Sandeep, did you have a chance to look at this documentation page? https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/custom_serialization.html The interfaces might not be easy to implement but are very powerful to address compatibility issues. You can also look into

TypeSerializer Example

2021-04-29 Thread Sandeep khanzode
Hello, Is there a working example of a TypeSerializer for a Java type stored in the State? My requirement is that I should be able to store the Java POJO entity in the MapState. The state is backed by RocksDBBackend. If I update the entity with a new member variable, I am unable to