wgtmac commented on PR #50158: URL: https://github.com/apache/arrow/pull/50158#issuecomment-4829657356
Thanks for the investigation. I agree this is a real issue, and it is not easy to fix correctly. Making the Parquet reader “truly async” would be a much larger design and engineering effort without breaking existing API. I don't think that is something we should try to solve opportunistically in this PR. For now, I think we should keep the existing async implementation as-is and avoid changing the current scheduling model in `StructReader`. So my suggestion is to abandon this PR, unfortunately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
