lidavidm commented on PR #13033: URL: https://github.com/apache/arrow/pull/13033#issuecomment-1116012291
Basically: the main thread in Python would call Inspect() without releasing the GIL; the Parquet Inspect() implementation would kick off a file read in a background thread and block, waiting for the future to complete. The background thread would try to call into Python to complete the read but would get stuck acquiring the GIL since the main thread was still holding it. Short term we can release the GIL, longer term it might be nice if we could avoid a background thread for synchronous situations like this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
