baumgold commented on issue #353: URL: https://github.com/apache/arrow-julia/issues/353#issuecomment-1309333061
> Ah, you're correct; we do all the message processing in the `Arrow.Stream` iterate method. Ok, yeah, we should provide an alternative here. This would be a great improvement as it would also allow predicate-pushdown at the RecordBatch level based on Message-level or Column-level metatdata, thus opening up the ability to operate on a single RecordBatch without uncompressing all RecordBatches in a file. This is an important feature for me so I'll try to spend some time building this without breaking too much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
