[
https://issues.apache.org/jira/browse/HUDI-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-8300:
------------------------------
Description:
Right now, NBCC is only supported with simple bucket index on MOR. We can
consider relaxing this for use cases like ingestion with concurrent GDPR
deletes to be supported by NBCC, using simple/global/RLI index on Spark.
{code:java}
if (writeConcurrencyMode ==
WriteConcurrencyMode.NON_BLOCKING_CONCURRENCY_CONTROL) {
checkArgument(
writeConfig.getTableType().equals(HoodieTableType.MERGE_ON_READ) &&
writeConfig.isSimpleBucketIndex(),
"Non-blocking concurrency control requires the MOR table with
simple bucket index");
} {code}
> Expand NBCC to support other index types on Spark
> -------------------------------------------------
>
> Key: HUDI-8300
> URL: https://issues.apache.org/jira/browse/HUDI-8300
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Y Ethan Guo
> Priority: Critical
> Fix For: 1.0.0
>
>
> Right now, NBCC is only supported with simple bucket index on MOR. We can
> consider relaxing this for use cases like ingestion with concurrent GDPR
> deletes to be supported by NBCC, using simple/global/RLI index on Spark.
> {code:java}
> if (writeConcurrencyMode ==
> WriteConcurrencyMode.NON_BLOCKING_CONCURRENCY_CONTROL) {
> checkArgument(
> writeConfig.getTableType().equals(HoodieTableType.MERGE_ON_READ)
> && writeConfig.isSimpleBucketIndex(),
> "Non-blocking concurrency control requires the MOR table with
> simple bucket index");
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)