pratyush-prateek commented on PR #32429: URL: https://github.com/apache/spark/pull/32429#issuecomment-1935386241
@HyukjinKwon So pinned thread mode is enabled by default in spark 3.2.0 onwards? The only thing users need to do if they need to spawn threads, is use `InheritableThread` API, can we say that? > Okay, if the users are using a `ThreadPool`, they won't get affected a lot by this change since the threads are reused. With this change, it could only affect the users who lunches Spark jobs in a plain thread a lot, which is discouraged in practice anyway. > > Let me merge this and try it out. The change here is correct in principle. Also, how using a `ThreadPool` wont' affect? I am guessing you are talking about `multiprocessing.pool.Threadpool` module. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
