westonpace commented on issue #34539: URL: https://github.com/apache/arrow/issues/34539#issuecomment-1480325157
@snizovtsev This stack trace is very useful. I have a few hunches and this is probably enough to go on. I will try and get some time to look at this further. I'll need to find some time when I can dig in for a few hours. I think the scheduler is expecting a "task" to actually correspond to a new thread task getting launched and there are a few places where we don't do that in the dataset writer. If you are able to reproduce this again and maybe attach the first 300-400 or so frames so I can see the actual loop a bit more clearly that would be helpful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
