sivabalan narayanan created HUDI-2595:
-----------------------------------------
Summary: Guard all writes to metadata table even for tables where
locking is not enabled
Key: HUDI-2595
URL: https://issues.apache.org/jira/browse/HUDI-2595
Project: Apache Hudi
Issue Type: Improvement
Reporter: sivabalan narayanan
Guard all writes to metadata table even for tables where locking is not enabled.
As of now, we guard all writes to metadata table by taking a data table lock.
This might work well for tables where multi-writer is enabled and so locking
does take place. but for tables where multi-writer is not enabled, changes to
metadata table happens w/o any lock.
so, if async compaction is running, it could potentially overstep w/ just 1
writer. both could concurrently try to update metadata table.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
