Are you actually running anything that requires all those slots? e.g., locally, I get this with "local[16]", but only after I run something that actually uses those 16 slots:
"Executor task launch worker-15" daemon prio=10 tid=0x00007f4c80029800 nid=0x8ce waiting on condition [0x00007f4c62493000] "Executor task launch worker-14" daemon prio=10 tid=0x00007f4c80027800 nid=0x8cd waiting on condition [0x00007f4c62594000] "Executor task launch worker-13" daemon prio=10 tid=0x00007f4c80025800 nid=0x8cc waiting on condition [0x00007f4c62695000] "Executor task launch worker-12" daemon prio=10 tid=0x00007f4c80023800 nid=0x8cb waiting on condition [0x00007f4c62796000] "Executor task launch worker-11" daemon prio=10 tid=0x00007f4c80021800 nid=0x8ca waiting on condition [0x00007f4c62897000] "Executor task launch worker-10" daemon prio=10 tid=0x00007f4c8001f800 nid=0x8c9 waiting on condition [0x00007f4c62998000] "Executor task launch worker-9" daemon prio=10 tid=0x00007f4c8001d800 nid=0x8c8 waiting on condition [0x00007f4c62a99000] "Executor task launch worker-8" daemon prio=10 tid=0x00007f4c8001b800 nid=0x8c7 waiting on condition [0x00007f4c62b9a000] "Executor task launch worker-7" daemon prio=10 tid=0x00007f4c80019800 nid=0x8c6 waiting on condition [0x00007f4c62c9b000] "Executor task launch worker-6" daemon prio=10 tid=0x00007f4c80018000 nid=0x8c5 waiting on condition [0x00007f4c62d9c000] "Executor task launch worker-5" daemon prio=10 tid=0x00007f4c80011000 nid=0x8c4 waiting on condition [0x00007f4c62e9d000] "Executor task launch worker-4" daemon prio=10 tid=0x00007f4c8000f800 nid=0x8c3 waiting on condition [0x00007f4c62f9e000] "Executor task launch worker-3" daemon prio=10 tid=0x00007f4c8000e000 nid=0x8c2 waiting on condition [0x00007f4c6309f000] "Executor task launch worker-2" daemon prio=10 tid=0x00007f4c8000c800 nid=0x8c1 waiting on condition [0x00007f4c631a0000] "Executor task launch worker-1" daemon prio=10 tid=0x00007f4c80007800 nid=0x8c0 waiting on condition [0x00007f4c632a1000] "Executor task launch worker-0" daemon prio=10 tid=0x00007f4c80015800 nid=0x8bf waiting on condition [0x00007f4c635f4000] On Mon, May 11, 2015 at 1:52 PM, dgoldenberg <dgoldenberg...@gmail.com> wrote: > Hi, > > Is there anything special one must do, running locally and submitting a job > like so: > > spark-submit \ > --class "com.myco.Driver" \ > --master local[*] \ > ./lib/myco.jar > > In my logs, I'm only seeing log messages with the thread identifier of > "Executor task launch worker-0". > > There are 4 cores on the machine so I expected 4 threads to be at play. > Running with local[32] did not yield 32 worker threads. > > Any recommendations? Thanks. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Running-Spark-in-local-mode-seems-to-ignore-local-N-tp22851.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Marcelo
