lilei1128 opened a new issue, #11216: URL: https://github.com/apache/paimon/issues/11216
### Search before asking - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar. ### Paimon version master/2.x ### Compute Engine core ### Minimal reproduce step In IncrementalClusterStrategyTest, create one LevelSortedRun at maxLevel containing two files - the first with the schemaId of a schema whose clustering.columns equals the strategy's cluster keys, the second with the schemaId of a schema with different clustering columns - then call pickFullCompaction(numLevels, runs). On the current master this returns Optional.empty() (full compaction is skipped) while it must return a CompactUnit. ### What doesn't meet your expectations? pickFullCompaction returns Optional.empty() and the run is NOT re-clustered by the current clustering.columns, even though it contains files clustered by a different key. Because the run is already at max level, normal incremental compaction will not select it either (runs.size() == 1), so the data can stay unclustered indefinitely. ### Anything else? _No response_ ### Are you willing to submit a PR? - [x] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
