Dandandan opened a new pull request, #21357: URL: https://github.com/apache/datafusion/pull/21357
## Which issue does this PR close? - Closes #20856. ## Rationale for this change Replace pull-based `ParquetMetaDataReader` with push-based `ParquetMetaDataPushDecoder`, which decouples IO from decoding. This uses `ObjectStore::get_ranges` directly instead of the `MetadataFetch` trait, and supports encryption via `with_file_decryption_properties`. ## What changes are included in this PR? - Replace `ParquetMetaDataReader` with `ParquetMetaDataPushDecoder` in `DFParquetMetadata::fetch_metadata` - Use `ObjectStore::get_ranges` directly for IO, driven by the decoder's `NeedsData` / `Data` / `Finished` state machine - Support prefetching via `metadata_size_hint` by pushing bytes before the decode loop - Wire up `with_file_decryption_properties` for encrypted Parquet support - Remove unused `ObjectStoreFetch` import from metadata module ## Are these changes tested? Covered by existing tests — this is a behavioral-equivalent replacement of the metadata reading path. ## Are there any user-facing changes? No user-facing API changes. 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
