n3nash commented on issue #2818: URL: https://github.com/apache/hudi/issues/2818#issuecomment-820146127
@ssdong Thanks for the detailed description of the problem and how to reproduce this. First, it looks like there is an issue in `MergeOnReadIncrementalRelation` that is resulting in `NoSuchElementException`. @garyli1019 Can you take a look at this one ? Second, yes, if the commit is archived before you could `incrementally pull` the changes, you will not be able to pull the changes happening between that specific range in it. However, this should not mean you will have data loss. In this case, you will miss the intermediate changes that might have happened between few commits, but if your checkpoint has not changed, incremental pull will provide you the "latest" changes that are present after your current checkpoint. I do need to confirm what happens if the commit time provided is way in the past and not in the hudi timeline. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
