zhongqishang commented on issue #2807: URL: https://github.com/apache/amoro/issues/2807#issuecomment-2097235948
> still think that it would be useful for minor compaction to have a threshold based on pos delete files count (why eq deletes should be any different?). `minor` mainly does two things, 1. Merge files smaller than 16m 2. Convert eq delete file to position delete file So when a 128m data file is associated with an eq delete file, the eq delete file will be convert into a position delete through `minor`. If rewrite position in `minor`, the file will be read and written very frequently, which is also very expensive. In short, there is rewrite position file, which is in the `major` stage. In order to reduce the cost of reading and writing, a threshold is added (`self-optimizing.major.trigger.duplicate-ratio`). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
