seddonm1 commented on a change in pull request #8860:
URL: https://github.com/apache/arrow/pull/8860#discussion_r539672718
##########
File path: rust/datafusion/src/physical_plan/parquet.rs
##########
@@ -99,6 +100,38 @@ impl ParquetExec {
batch_size,
}
}
+
+ /// Get the statistics from parquet file format
+ pub fn statistics(&self) -> Option<Statistics> {
Review comment:
Sorry, for clarity, the ParquetReader already performs this code. You
could expose the metadata produced in the first pass and then you don't need to
reimplement this logic (which has to read all the files again).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
