etseidl commented on issue #15812: URL: https://github.com/apache/datafusion/issues/15812#issuecomment-2822027266
> Where is `ColumnOrder` available? In theory we have access to the full metadata of the parquet file when building the pruning predicate batches / predicate. It's an array in the `FileMetaData`, so defined once for the entire file. I've been trying to trace where the plans get built from, and it seems like there are two paths...one from `ParquetSource::with_predicate`, which seems to happen before the file is opened, and then the path from `ParquetOpener::open` where we do have access to the file metadata. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
