rshdhere commented on PR #18529: URL: https://github.com/apache/iceberg/pull/18529#issuecomment-6657402018
@pvary thanks, I went through #16859. Both PRs read every retained metadata file in `MetadataLogEntriesTable.task`, that one in a parallel prefetch for `properties` and this one row by row for `latest_*`, so merging them separately would make `SELECT *` read each file twice. Since #16859 is further along, I suggest it lands first, and I rebase this PR onto its prefetch so a single pass fills both `properties` and the `latest_*` columns. That would also pick up any `file`/`timestamp` pruning from the open review there. @tomtongue does that work for you, or would you prefer a different order? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
