Did you try --executor-cores param? While you submit the job, do a ps aux | grep spark-submit and see the exact command parameters.
Thanks Best Regards On Sat, May 16, 2015 at 12:31 PM, xiaohe lan <zombiexco...@gmail.com> wrote: > Hi, > > I have a 5 nodes yarn cluster, I used spark-submit to submit a simple app. > > spark-submit --master yarn target/scala-2.10/simple-project_2.10-1.0.jar > --class scala.SimpleApp --num-executors 5 > > I have set the number of executor to 5, but from sparkui I could see only > two executors and it ran very slow. What did I miss ? > > Thanks, > Xiaohe >
