yuzhaojing commented on PR #12448: URL: https://github.com/apache/hudi/pull/12448#issuecomment-2527230012
This is a highly anticipated feature and a very important capability for improving the availability of Flink Hudi pipeline. I quite agree with @danny0405 proposal. I hope that the incremental capability can be applied to more scenarios instead of being limited to compaction only. I'm really looking forward to having an RFC to systematically solve these problems. Besides, here are some thoughts: 1. For NBCC, is it possible that some partitions may be missed in this implementation? 2. If the lastInstant has already been archived and there is no judgment made when initializing cache partitions (initCachePartitions), will there be a situation where some partitions are missed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
