scott-routledge2 commented on PR #43661: URL: https://github.com/apache/arrow/pull/43661#issuecomment-3329056349
cc @bkietz , @pitrou Hello! I was interested in picking up this PR from Sahil since the use case still seems relevant to us. I tested locally with the latest changes on main and it looked like this PR can improve performance of the Scanner quite a bit, although there were some concerns about the robustness of setting the batch size to INT_MAX in `ScanBatchesAsync`. Was wondering if I could get some feedback on whether this is headed in the right direction. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
