carp84 commented on pull request #8751: URL: https://github.com/apache/flink/pull/8751#issuecomment-804999277
@StephanEwen It seems to me the current RocksDB incremental snapshots are time-based instead of size-based, so I'm not sure whether we could directly reuse it through wrapping in change-log backend. However, this is another topic and let's watch and discuss more when implementing the checkpointing part for change-log backend in FLINK-21356. It's true that if we could prevent generating small files then we don't need the solution here to handle the small file problem, and although I'm still not fully convinced we could get rid of the problem with FLIP-158, I agree we focus on implementing FLIP-158 first and revisit the issue here later if still in need. :-) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
