[
https://issues.apache.org/jira/browse/HUDI-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jian Feng reassigned HUDI-4065:
-------------------------------
Assignee: Jian Feng
> Implement a self-releasing FileLock for multiple writers scenario
> -----------------------------------------------------------------
>
> Key: HUDI-4065
> URL: https://issues.apache.org/jira/browse/HUDI-4065
> Project: Apache Hudi
> Issue Type: Improvement
> Components: core
> Reporter: Jian Feng
> Assignee: Jian Feng
> Priority: Major
> Labels: multi-writer
>
> when using HiveMetastoreBasedLockProvider or ZookeeperBasedLockProvider, if
> the writer with locker crash before releasing the locker, no writers can
> obtain the locker anymore, hence no cleaning/expiring the lock after a failed
> write.
> Instead of those lockers depending on external components, FIleBaseLocker
> only relies on FileSystem's atomic file creation behavior. an instant will
> be written to the file, so it will clean the lock when failing writer
> rollback. also can set expire strategy on it.
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
