getniz edited a comment on issue #2101: URL: https://github.com/apache/hudi/issues/2101#issuecomment-699798342
@n3nash Thanks for your inputs, while I'm experimenting this on the other side I saw there is another easy way to achieve this using ksql from Kafka receiving side which flattens the Kafka topics and post it to another topics by creating ksql streams. I can just plugin the Hudi source to the ksql stream topic which is flattened to my reqmts. Reference: https://www.confluent.io/stream-processing-cookbook/ksql-recipes/nested-json-data/ . I think this turns out to be the solution from Kafka side to interpret very nature of the kafka topics as they are always encapsulated with additional Kafka metadata like schema, offset, etc rather typical flattened files. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
