yihua opened a new issue, #20076: URL: https://github.com/apache/hudi/issues/20076
When partitions are listed from the file system (metadata table disabled), `FileSystemBackedTableMetadata` checks each directory under the base path for a partition metafile. It probes `.hoodie` too before excluding it, which costs extra file system calls (requests on cloud storage) per listing, and if `.hoodie` holds a stray partition metafile it is returned as a partition. Proposal: skip the meta folder before probing for partition metadata. part of #20064 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
