Manoj Govindassamy created HUDI-2962:
----------------------------------------
Summary: Enable metadata table along with JVM local lock provider
Key: HUDI-2962
URL: https://issues.apache.org/jira/browse/HUDI-2962
Project: Apache Hudi
Issue Type: Task
Reporter: Manoj Govindassamy
Assignee: Manoj Govindassamy
Fix For: 0.11.0
Metadata table is disabled by default in master due to
https://issues.apache.org/jira/browse/HUDI-2961.
For the single writer + async table services deployment model, to protect
against races, we can have a fairly light weight JVM local lock provider. This
mean all the writes and the table services have to be running from the single
JVM, like in the case of DeltaStreamer. This doesn't cover the multi JVM
writes, async table services though and a full fix for the same will be covered
by HUDI-2961. For now to have the metadata table re-enabled at master, a JVM
local locl provider should be sufficient.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)