etseidl opened a new pull request, #8714: URL: https://github.com/apache/arrow-rs/pull/8714
# Which issue does this PR close? - Part of #5853 - Closes #8713. # Rationale for this change This is a proof of concept implementation of an index into the Parquet metadata. The hope is this will greatly speed up acquiring only the needed bits of the Parquet footer when not all the metadata is needed (such as when projecting a few columns out of an extremely large table). # What changes are included in this PR? Modifications are made to the Thrift footer encoding to allow for noting the start and end positions of each `RowGroup` and `ColumnMetaData`, as well as the location and size of the schema. # Are these changes tested? Tests will be added as this progresses. # Are there any user-facing changes? No, this should only impact private APIs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
