jkdll edited a comment on issue #3113: URL: https://github.com/apache/hudi/issues/3113#issuecomment-864336980
I have also tested with the latest version on the `master` branch. Same error. Moreover, without `--transformer-class org.apache.hudi.utilities.transform.FlatteningTransformer` I get this error within the application logs: ``` 21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39662 partitionPath=1616684167}, currentLocation='null', newLocation='null'} java.lang.ArrayIndexOutOfBoundsException 21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39576 partitionPath=1616419975}, currentLocation='null', newLocation='null'} java.lang.ArrayIndexOutOfBoundsException 21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39575 partitionPath=1616419975}, currentLocation='null', newLocation='null'} java.lang.ArrayIndexOutOfBoundsException 21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39589 partitionPath=1616426425}, currentLocation='null', newLocation='null'} java.lang.ArrayIndexOutOfBoundsException 21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=37234 partitionPath=1616426425}, currentLocation='null', newLocation='null'} ``` I believe is triggered due to UNION structs. I believe the flatten transformer "fixes" this by flattening the struct, however it is only a workaround. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org