westonpace commented on issue #33627: URL: https://github.com/apache/arrow/issues/33627#issuecomment-1399093386
No, I don't think you are wrong. You should be seeing more parallelism. I am not sure when I will get a chance to fully investigate this however. I don't see anything in here that would lead threads to share HDFS connections but I don't know anything about how HDFS works. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
