JingsongLi commented on PR #6426: URL: https://github.com/apache/paimon/pull/6426#issuecomment-5748067837
I reviewed the current implementation and the discussion history. **Current implementation: UNSUPPORTED; closing this PR.** The optimization goal is potentially useful, but this branch cannot provide a correct end-to-end implementation. The author has already confirmed that the asynchronous refresh plus HASH-index design is fundamentally flawed and should not be merged. The unresolved issues are structural rather than polish: real compaction does not shrink the HASH index, reconciliation can double-count, empty/vanished candidates are not reliably reset, and asynchronous refresh introduces backpressure and recovery hazards. Keeping this implementation open would suggest a viable merge path when the required replacement design has not been coded. A fresh PR would be welcome for the proposed live-key/in-memory direction once it has a durable recovery story and end-to-end tests covering compaction, bucket disappearance, restart, and concurrent refresh. Closing this obsolete implementation so the new design can start from a clear baseline. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
