Re: AvroRowDeserializationSchema

2022-04-28 Thread Dian Fu
Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows > > > > *From: *Dian Fu > *Sent: *Thursday, April 28, 2022 2:59 PM > *To: *lan tran > *Cc: *user@flink.apache.org > *Subject: *Re: AvroRowDeserializationSchema > > > > Yes, I think

RE: AvroRowDeserializationSchema

2022-04-28 Thread lan tran
Don’t expect that answer =))However, I am very appreciate everything you did Thanks again for helping me out.Best,Quynh. Sent from Mail for Windows From: Dian FuSent: Thursday, April 28, 2022 2:59 PMTo: lan tranCc: user@flink.apache.orgSubject: Re: AvroRowDeserializationSchema Yes, I think so

Re: AvroRowDeserializationSchema

2022-04-28 Thread Dian Fu
t; > > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows > > > > *From: *Dian Fu > *Sent: *Tuesday, April 26, 2022 7:54 AM > *To: *lan tran > *Cc: *user@flink.apache.org > *Subject: *Re: AvroRowDeserializationSchema > >

RE: AvroRowDeserializationSchema

2022-04-27 Thread lan tran
@flink.apache.orgSubject: Re: AvroRowDeserializationSchema Hi Quynh,The same code in my last reply showed how to set the UID for the source operator generated using Table API. I meant that you could firstly create a source using Table API, then convert it to a DataStream API and set uid

Re: AvroRowDeserializationSchema

2022-04-25 Thread Dian Fu
ull flow. > > Best, > Quynh > > > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows > > > > *From: *Dian Fu > *Sent: *Monday, April 25, 2022 7:46 PM > *To: *lan tran > *Cc: *user@flink.apache.org > *Subject: *Re: Avr

RE: AvroRowDeserializationSchema

2022-04-25 Thread lan tran
use DebeziumAvroRowDeserializationSchema and DebeziumJsonRowDeserializationSchema in the DataStream job to be able to use the Savepoint for the whole full flow.Best,Quynh Sent from Mail for Windows From: Dian FuSent: Monday, April 25, 2022 7:46 PMTo: lan tranCc: user@flink.apache.orgSubject: Re: AvroRowDeserializationSchema Hi Quynh,

Re: AvroRowDeserializationSchema

2022-04-25 Thread Dian Fu
y, April 25, 2022 11:04 AM > *To: *lan tran > *Cc: *user@flink.apache.org > *Subject: *Re: AvroRowDeserializationSchema > > > > DebeziumAvroRowDeserializationSchema and > DebeziumJsonRowDeserializationSchema are still not supported in > Python DataStream API. > >

RE: AvroRowDeserializationSchema

2022-04-24 Thread lan tran
: Dian FuSent: Monday, April 25, 2022 11:04 AMTo: lan tranCc: user@flink.apache.orgSubject: Re: AvroRowDeserializationSchema DebeziumAvroRowDeserializationSchema and DebeziumJsonRowDeserializationSchema are still not supported in Python DataStream API. Just take a further look at the Java

Re: AvroRowDeserializationSchema

2022-04-24 Thread Dian Fu
gt; project. You could refer to AvroRowDeserializationSchema[1] as an example. > It should not be complicated as it's simply a wrapper of the > Java implementation. > > Regards, > Dian > > [1] > https://github.com/apache/flink/blob/e11a5c52c613e121f7a7868cbbfd9e7c21551394/flin

Re: AvroRowDeserializationSchema

2022-04-24 Thread Dian Fu
Yes, we should support them. For now, if you want to use them, you could create ones in your own project. You could refer to AvroRowDeserializationSchema[1] as an example. It should not be complicated as it's simply a wrapper of the Java implementation. Regards, Dian [1] https://github.com

RE: AvroRowDeserializationSchema

2022-04-24 Thread lan tran
it is not supported yet.Best,QuynhSent from Mail for Windows From: Dian FuSent: Friday, April 22, 2022 9:36 PMTo: lan tranCc: user@flink.apache.orgSubject: Re: AvroRowDeserializationSchema Hi Quynh,I have added an example on how to use AvroRowDeserializationSchema in Python DataStream API in [1]. Please

Re: AvroRowDeserializationSchema

2022-04-22 Thread Dian Fu
Hi Quynh, I have added an example on how to use AvroRowDeserializationSchema in Python DataStream API in [1]. Please take a look at if that helps for you~ Regards, Dian [1] https://github.com/apache/flink/blob/release-1.15/flink-python/pyflink/examples/datastream/formats/avro_format.py On Fri

Re: AvroRowDeserializationSchema

2022-04-22 Thread Dian Fu
Hi Quynh, Could you show some sample code on how you use it? Regards, Dian On Fri, Apr 22, 2022 at 1:42 PM lan tran wrote: > Wonder if this is a bug or not but if I use > *AvroRowDeserializationSchema,* > > In PyFlink the error still occure ? > > py4j.protocol.Py4JError:

RE: AvroRowDeserializationSchema

2022-04-21 Thread lan tran
Wonder if this is a bug or not but if I use AvroRowDeserializationSchema,In PyFlink the error still occure ?py4j.protocol.Py4JError: An error occurred while calling None.org.apache.flink.formats.avro.AvroRowDeserializationSchema. Trace:org.apache.flink.api.python.shaded.py4j.Py4JException

AvroRowDeserializationSchema

2022-04-21 Thread lan tran
Hi team, I want to implement AvroRowDeserializationSchema when consume data from Kafka, however from the documentation, I did not understand what are avro_schema_string and record_class ? I would be great if you can give me the example on this (I only have the example on Java, however, I was doing