adriangb commented on issue #21399: URL: https://github.com/apache/datafusion/issues/21399#issuecomment-4193497605
Why do we need the new arrow APIs? My thought was that we'd pass a the desired RG order into the opener and once it loads row group statistics and does pruning it uses those same row group statistics to re-order the row group selection by updating `ParquetAccessPlan` to store `Vec<(usize, RowGroupAccess)>` or something like that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
