lilei1128 opened a new issue, #11216:
URL: https://github.com/apache/paimon/issues/11216

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Paimon version
   
   master/2.x
   
   ### Compute Engine
   
   core
   
   ### Minimal reproduce step
   
   In IncrementalClusterStrategyTest, create one LevelSortedRun at maxLevel 
containing two files - the first with the schemaId of a schema whose 
clustering.columns equals the strategy's cluster keys, the second with the 
schemaId of a schema with different clustering columns -  then call 
pickFullCompaction(numLevels, runs). On the current master this returns 
Optional.empty()  (full compaction is skipped) while it must return a 
CompactUnit.
   
   ### What doesn't meet your expectations?
   
   pickFullCompaction returns Optional.empty() and the run is NOT re-clustered 
by the current clustering.columns,
   even though it contains files clustered by a different key. Because the run 
is already at max level, normal incremental compaction will not select it 
either (runs.size() == 1), so the data can stay unclustered indefinitely.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to