HyukjinKwon edited a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-529162132 > why isn't that just the default approach recommended by py4j One thing I suspect is, the default multi-threading mode creates less threads and reuse whereas single threading mode always creates a new thread. But yes, I agree that we need some more investigation. But yes, I agree that we should investigate deeper in general. Partially due to that, I was thinking exposing this mode as an experimental mode. I currently have no intention to push and insist this approach without discussions or checking other alternatives. Please also feel free to create another PR with another approach @squito if you have an idea :D. I don't mind.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
