deepakpanda93 commented on issue #14776: URL: https://github.com/apache/hudi/issues/14776#issuecomment-5290162503
This issue was reviewed as part of the JIRA-migrated backlog triage. Findings: this was fixed by #3946 - *"[HUDI-2711] Fallback to fulltable scan for IncrementalRelation if underlying files have been cleared or moved by cleaner"* - merged 2022-02-01 (merge commit `7ce0f4522b54`, +205/-26 across 5 files). The failure reported here happens when the deltastreamer pipeline runs infrequently and the cleaner has already removed the files `HoodieIncrSource` needs. The PR makes `IncrementalRelation` fall back to a full table scan in that situation. Containment was verified against the release tags rather than inferred from the merge date. Available in **0.11.0** and later. If you're still hitting this on a recent version, please reopen with repro steps. Closing as fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
