AloneRevelry opened a new issue, #5762:
URL: https://github.com/apache/paimon/issues/5762

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Paimon version
   
   paimon 0.9
   
   ### Compute Engine
   
   Spark3.2.3 & Flink 1.18.1
   
   ### Minimal reproduce step
   
   
   **Goal:** Multiple Spark jobs (60+) write to the same Paimon table in 
parallel. The partial-update feature is enabled, with each job updating only 
its own dedicated columns. The table property 'write-only' = 'true' is set. A 
dedicated compaction job is started to compact this table.
   
   
   
   
   
   ### What doesn't meet your expectations?
   
   **Problem:** Two jobs finished simultaneously, causing a snapshot conflict. 
During the doCommit phase:
   
   Job A acquired the snapshot ID 9793. It generated a snapshot temp file and 
then attempted to rename it to snapshot-9794.
   
   Concurrently, Job B, also in its doCommit phase, acquired the same latest 
snapshot ID 9793. It similarly generated a snapshot temp file and attempted to 
rename it to snapshot-9794.
   
   **Result:** The job that successfully performed the rename operation first 
(creating snapshot-9794) caused all updates from the other job to be lost.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to