Caizhi Weng created FLINK-28582:
-----------------------------------
Summary: LSM tree structure may be incorrect when multiple jobs
are committing into the same bucket
Key: FLINK-28582
URL: https://issues.apache.org/jira/browse/FLINK-28582
Project: Flink
Issue Type: Bug
Components: Table Store
Affects Versions: table-store-0.2.0
Reporter: Caizhi Weng
Fix For: table-store-0.2.0
Currently `FileStoreCommitImpl` only checks for conflicts by checking the files
we're going to delete (due to compaction) are still there.
However, consider two jobs committing into the same LSM tree at the same time.
For their first compaction no conflict is detected because they'll only delete
their own level 0 files. But they will both produce level 1 files and the key
ranges of these files may overlap. This is not correct for our LSM tree
structure.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)