nsivabalan commented on issue #6866: URL: https://github.com/apache/hudi/issues/6866#issuecomment-1283462233
let me first try to answer your original question. you may find the data under s3://data/region=TEST/year=2022/month=09/day=24 for eg. but if you do snapshot query for hudi table, you may not find any data from the deleted partitions. Physical deletion is lazy which cleaner will take up later and hence if you directly do fs.list, you will find data under deleted partitions. So, this behavior is expected. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
