Wechar created HUDI-7515:
----------------------------
Summary: Fix partition metadata write fail when speculation enabled
Key: HUDI-7515
URL: https://issues.apache.org/jira/browse/HUDI-7515
Project: Apache Hudi
Issue Type: Bug
Reporter: Wechar
Avoid failing to write partition metadata. When spark.speculation is enabled,
if the write metadata operation become slow for some reason, a speculative will
be started to write the same metadata file concurrently.
In HDFS, two tasks(like one is speculate task) writing to the same file could
both throw exception like so:
{code:bash}
File does not exist:
/path/to/table/a=3519/b=3520/c=3521/.hoodie_partition_metadata_112 (inode
48415575374) Holder DFSClient_NONMAPREDUCE_-2108606624_29 does not have any
open files.
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
