Hi De Xun, Unfortunately MAP, ARRAY and ROW types are supported by Flink Parquet format only since Flink 1.15 (see FLINK-17782 [1], not released yet). You may want to upgrade Flink version to 1.15 once it is released, or make your own implementation based on the latest code on master branch for now.
Also answered on your StackOverflow post. Hope this would be helpful! [1] https://issues.apache.org/jira/browse/FLINK-17782 Best Regards, Qingsheng > On Mar 7, 2022, at 18:48, De Xun Chia <dexun.c...@bytedance.com> wrote: > > Hi Qingsheng Ren, > > > Thank you for the help! It worked and I have updated the StackOverflow post > with the correct source code answer so other people can use it. > > > I am now faced with another issue though - I have created a new StackOverflow > post > for it. If it about writing out complex parquet data types. If you are able > to examine it please do, otherwise help me direct it to another dev who has > knowledge about it. > > > Have a great week ahead! > > > Best Regards, > > De Xun > > > On Mon, Mar 7, 2022, 3:19 PM <renqs...@gmail.com> wrote: > Hi De Xun, > > I created an answer in the StackOverflow and hope it would be helpful. I’d > like repost my answer here for the convenience of people in mailing lists. > > The first call of RowRowConverter::toInternal is an internal implementation > for making a deep copy of the StreamRecord emitted by table source, which is > independent from the converter in your map function. > > The reason of the NPE is that the RowRowConverter in the map function is not > initialized by calling RowRowConverter::open. You can use RichMapFunction > instead to invoke the RowRowConverter::open in RichMapFunction::open. > > Best regards, > > Qingsheng Ren > > > On Mar 7, 2022, at 09:16, Chia De Xun . wrote: > > > > Greetings, > > > > I'm facing a difficult issue/bug while working with Flink. Would definitely > > appreciate some official expert help on this issue. I have posted my > > problem on StackOverflow, but have no replies at the moment. > > > > Let me know if you have any questions/clarifications for me! It would be > > best appreciated. > > > > Best Regards, > > De Xun >
