Zeyiii edited a comment on issue #26801: [SPARK-29553][ML][MLLIB]Add options to disable multi-threading of native BLAS on the executors URL: https://github.com/apache/spark/pull/26801#issuecomment-563887875 > I tried it just now, executing `sbin/start-slave.sh`, after copying `spark-env.sh.template` to `spark-env.sh` and uncommenting the two MKL variables at the end (and removing the trailing content on the line). It works fine in that I see the env populated with these variables, and they are passed to the child script that starts the executor. Are you sure you did all that? > > While this is usually appropriate to set cluster wide, I can also see setting it per executor / app, so I think this could be useful to note in the docs at https://spark.apache.org/docs/latest/tuning.html There we would to mention both approaches. Sure,I did the same as you.,But the option works on driver instead of executors. The call stack of the driver is different from the executors, which means the executors doesn't use single thread.   How can I contribute to the docs, I think some other people meet the same problem.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
