Prashant Wason created HUDI-6154:
------------------------------------
Summary: Race condition in case of multi-writers may cause
hoodie.properties to be unreadable
Key: HUDI-6154
URL: https://issues.apache.org/jira/browse/HUDI-6154
Project: Apache Hudi
Issue Type: Bug
Reporter: Prashant Wason
Assignee: Prashant Wason
When a process wants to update hoodie.properties, it follows these steps:
# Read hoodie.properties
# Create hoodie.properties.backup
# Write properties read in #1 into hoodie.properties.backup
# Delete hoodie.properties
# Create hoodie.properties
# Write updated properties into hoodie.properties
# Delete hoodie.properties.backup
The reader has this mechanism:
# Read hoodie.properties.
# If not found, read hoodie.properties.backup
In case of a race between reader and writer, reader may read hoodie.properties
after step #4 (hoodie.properties deleted by writer) and then try to read
hoodie.properties.backup after step #7 (hoodie.properties.backup deleted by
writer). The reader will assume that hoodie.properties does not exist and throw
an error.
To deal with this a retry is introduced.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
