Re: Working with DataStreams of Java objects in Pyflink?

2021-03-15 Thread Kevin Lam
Hi Shuiqiang Chen, Thanks for the quick response. Oh I see, that's too bad POJO is not currently supported. I'd like to check if I understand your suggestion about RowType. You're suggesting something like: 1/ Define subclasses of RowType in Java/Scala to hold our java objects we want to

Re: Working with DataStreams of Java objects in Pyflink?

2021-03-15 Thread Shuiqiang Chen
Hi Kevin, Currently, POJO type is not supported in Python DataStream API because it is hard to deal with the conversion between Python Objects and Java Objects. Maybe you can use a RowType to represent the POJO class such as Types.ROW_NAME([id, created_at, updated_at], [Types.LONG(),

Working with DataStreams of Java objects in Pyflink?

2021-03-15 Thread Kevin Lam
Hi all, Looking to use Pyflink to work with some scala-defined objects being emitted from a custom source. When trying to manipulate the objects in a pyflink defined MapFunction