stym06 commented on issue #3890: URL: https://github.com/apache/hudi/issues/3890#issuecomment-997343328
@nsivabalan I don't have the hoodie folder right now, but what I saw was that when hive sync ran with last_commit_time as 26, it searches all the commit files after 26 and gets the partitions that were written in those particular commits. However, the commits from 27 and 28 were not there in the hoodie folder but 29th day commit file was there. And. in the code, it is written to get all commits after the sync time and find partitions to add. As a workaround, I had to add some code change to list wasb folder structure and add the missing partitions that seems to work. Commits from 28 and 29 were archived most probably. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
