n3nash commented on issue #591: Hudi write phase (final writing to parquet) fails if there is a large number of Spark partitions URL: https://github.com/apache/incubator-hudi/issues/591#issuecomment-473486516 This is an issue only during the write phase, other stages that have higher parallelism (for eg. BloomIndex) don't have issues. So although it may be a spark issue, we need to see why it manifests during the last write stage.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
