2010YOUY01 commented on issue #8067: URL: https://github.com/apache/arrow-datafusion/issues/8067#issuecomment-1797870588
Was that because this counting operation is possible to be done during scanning? Looks like it's a case of aggregate pushdown. For `min()/max()/count()` aggregate functions on Parquet, it's possible to get the result on whole column only use metadata, without full scan. To do that i think `update_record_batch()` is needed, possibly also allow `RecordBatch` to carry more flexible payloads -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
