WuZeyi created SPARK-29553: ------------------------------ Summary: This problemis about using native BLAS to improvement ML/MLLIB performance Key: SPARK-29553 URL: https://issues.apache.org/jira/browse/SPARK-29553 Project: Spark Issue Type: Improvement Components: ML, MLlib Affects Versions: 2.4.4, 2.3.0 Reporter: WuZeyi
I use {color:#FF0000}native BLAS{color} to improvement ML/MLLIB performance on Yarn. The file {color:#FF0000}spark-env.sh{color} which is modified by [SPARK-21305] said that I should set {color:#FF0000}OPENBLAS_NUM_THREADS=1{color} to disable multi-threading of OpenBLAS, but it does not take effect. I modify {color:#FF0000}spark.conf{color} to set OPENBLAS_NUM_THREADS=1,and the performance improve. I think MKL_NUM_THREADS is the same. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org