n3nash commented on issue #2101: URL: https://github.com/apache/hudi/issues/2101#issuecomment-697675730
@getniz Your JSON is a nested data type which will end up being inferred as a nested AVRO [record](http://avro.apache.org/docs/current/spec.html#schema_record) type. My understanding is this is expected behavior for nested data. There are 2 ways for you to flatten your data: 1) Transform your incoming data and flatten it 2) Flatten it using a transformer for the DeltaStreamer -> https://github.com/apache/hudi/blob/master/hudi-utilities/src/main/java/org/apache/hudi/utilities/transform/FlatteningTransformer.java 3) Flatten it during your query using [Lateral View](https://cloudera.ericlin.me/2017/08/hive-lateral-view-to-flatten-array-data/). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
