jkdll edited a comment on issue #3113:
URL: https://github.com/apache/hudi/issues/3113#issuecomment-864336980
I have also tested with the latest version on the `master` branch. Same
error.
Moreover, without `--transformer-class
org.apache.hudi.utilities.transform.FlatteningTransformer` I get this error
within the application logs:
```
21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record
HoodieRecord{key=HoodieKey { recordKey=39662 partitionPath=1616684167},
currentLocation='null', newLocation='null'}
java.lang.ArrayIndexOutOfBoundsException
21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record
HoodieRecord{key=HoodieKey { recordKey=39576 partitionPath=1616419975},
currentLocation='null', newLocation='null'}
java.lang.ArrayIndexOutOfBoundsException
21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record
HoodieRecord{key=HoodieKey { recordKey=39575 partitionPath=1616419975},
currentLocation='null', newLocation='null'}
java.lang.ArrayIndexOutOfBoundsException
21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record
HoodieRecord{key=HoodieKey { recordKey=39589 partitionPath=1616426425},
currentLocation='null', newLocation='null'}
java.lang.ArrayIndexOutOfBoundsException
21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record
HoodieRecord{key=HoodieKey { recordKey=37234 partitionPath=1616426425},
currentLocation='null', newLocation='null'}
```
I believe is triggered due to UNION structs. I believe the flatten
transformer "fixes" this by flattening the struct, however it is only a
workaround.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
