Following are the configuration changes I made to spark-env.sh: export SPARK_EXECUTOR_INSTANCES=1 export SPARK_EXECUTOR_CORES=1 export SPARK_WORKER_CORES=1 export SPARK_WORKER_INSTANCES=1
And yes, I mean to execute only one task per node at a time. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Restricting-number-of-cores-not-resulting-in-reduction-in-parallelism-tp26319p26332.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org