RussellSpitzer commented on issue #1422: URL: https://github.com/apache/iceberg/issues/1422#issuecomment-687215018
@yiguolei In the use cases we are thinking about the > If it costs a lot of time to read manifest file, why not merge the data files or merge manifests under a manifest list file? The issue is that that approach also does not scale with very large amounts of metadata. We would I really like a solution that allows us to do TableScan style queries even when the underlying table has hundreds of megs if not gigabytes of metadata. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
