[
https://issues.apache.org/jira/browse/HUDI-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-4348:
---------------------------------
Labels: pull-request-available (was: )
> merge into will cause data quality in concurrent scene
> ------------------------------------------------------
>
> Key: HUDI-4348
> URL: https://issues.apache.org/jira/browse/HUDI-4348
> Project: Apache Hudi
> Issue Type: Bug
> Components: spark-sql
> Reporter: KnightChess
> Assignee: KnightChess
> Priority: Major
> Labels: pull-request-available
>
> a hudi table with 15 billion pieces of data, the update records has 30
> million every day, the 1000 records is different with hive table.
>
> when I set `executor-cores 1` and `spark.task.cpus 1`, there is no problem,
> but when the parallelism over 1 in every executor, the data quality will
> appear.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
