srowen commented on issue #26801: [SPARK-29553][ML][MLLIB]Add options to disable multi-threading of native BLAS on the executors URL: https://github.com/apache/spark/pull/26801#issuecomment-563306208 I tried it just now, executing `sbin/start-slave.sh`, after copying `spark-env.sh.template` to `spark-env.sh` and uncommenting the two MKL variables at the end (and removing the trailing content on the line). It works fine in that I see the env populated with these variables, and they are passed to the child script that starts the executor. Are you sure you did all that? While this is usually appropriate to set cluster wide, I can also see setting it per executor / app, so I think this could be useful to note in the docs at https://spark.apache.org/docs/latest/tuning.html There we would to mention both approaches.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
