alamb commented on issue #1605: URL: https://github.com/apache/arrow-rs/issues/1605#issuecomment-1107846848
> As for SerializedRowGroupReader the challenge is the RowGroupReader trait exposes APIs for column projection, re 👍 makes sense > I am somewhat apprehensive about providing an async version, as the whole intent is to let users handle what level of buffering/pre-fetch makes sense for their use case, but I guess with sufficient disclaimers... Yeah I am thinking about the "I want to try out reading parquet from s3 just to see if it works" rather than "I am set on using parquet library and I am now trying to squeeze the most pefroamcne" > W.r.t to users constructing per-row group, entirely up to their use-case, if they want to they can, if they don't want to, they don't need to. It was more me trying to demonstrate the flexibility afforded, than prescribing anything Right -- I agree -- I was just confirming my understanding of what would be possible with the API -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
