wecharyu commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2020686744
> Would the failure probability increasing? We did not notice this possible failure, it may not happen frequently because we have a pre-checked if this metadata file exists. OTOH, I think it's also OK to remove this throw exception. > could we move created hoodie_partition_metadata to driver or jobmaster instead of each task? This may cause the performance issue if there are too many partitions need to create in driver. We need think more on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
