ad1happy2go commented on issue #9736: URL: https://github.com/apache/hudi/issues/9736#issuecomment-1722774995
@njalan Yes, Your understanding is correct, While doing the metadata sync it needs to list the partitions. For that it can just use the metadata table instead of file listing. When we have a large number of partitions, this can reduce the S3 file list by great instant. During writes, as metadata table is enable by default it should use metadata table only for most of the file listing operations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
