What is the motivation behind this ? You can start with master as local[NO_OF_THREADS]. Reducing the threads at all other places can have unexpected results. Take a look at this. http://spark.apache.org/docs/latest/configuration.html.
Prashant Sharma On Tue, Oct 28, 2014 at 2:08 PM, Wanda Hawk <[email protected]> wrote: > Hello > > I am trying to reduce the number of java threads (about 80 on my system) > to as few as there can be. > What settings can be done in spark-1.1.0/conf/spark-env.sh ? (or other > places as well) > I am also using hadoop for storing data on hdfs > > Thank you, > Wanda >
