sundy-li commented on PR #4299: URL: https://github.com/apache/arrow-rs/pull/4299#issuecomment-1566325254
Because we don't need the high-level api to read the metadata. The metadata is stored outside parquet files in our database system. Once the metadata and rowgroup index are reader, rowgroups are pruned and we only need to read the data by row-group with Bytes of each column. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
