jiangok2006 edited a comment on issue #2537: URL: https://github.com/apache/hudi/issues/2537#issuecomment-777808336
@nsivabalan It is not about the sql statement I think. If I use a simple dataframe, sql transformer works fine with my or Sudha's sql query. But my kafka data in production seems to cause deSer issue for sql transformer. I admit that my kafka data is special because each of them is big and has complex data type (e.g. logical type). Flink 1.11 cannot handle it after two bugs are fixed in Flink 1.12. https://issues.apache.org/jira/browse/FLINK-19491 https://issues.apache.org/jira/browse/FLINK-19339 I guess the easier way is to provide sample avro from my kafka for trouble shooting. If so, I may need to work with my team for exposing sample data. Thought? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
