lidavidm commented on pull request #12099: URL: https://github.com/apache/arrow/pull/12099#issuecomment-1007654362
Ah, there's _another_ deadlock: finishing a FileWriter closes the underlying file. This is done as a continuation that runs on the I/O thread pool (I think). (On a side note, would anyone complain if I #ifdef'd in the pthread calls to name threads on Linux to make debugging easier?) On S3, closing a file blocks on a condition variable until all background writes are finished…and of course, those background writes are on the I/O thread pool, like everything else, so we hang. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org