What is the motivation behind this ?

You can start with master as local[NO_OF_THREADS]. Reducing the threads at
all other places can have unexpected results. Take a look at this.
http://spark.apache.org/docs/latest/configuration.html.

Prashant Sharma



On Tue, Oct 28, 2014 at 2:08 PM, Wanda Hawk <[email protected]>
wrote:

> Hello
>
> I am trying to reduce the number of java threads (about 80 on my system)
> to as few as there can be.
> What settings can be done in spark-1.1.0/conf/spark-env.sh ? (or other
> places as well)
> I am also using hadoop for storing data on hdfs
>
> Thank you,
> Wanda
>

Reply via email to