Hello
I am trying to reduce the number of java threads (about 80 on my system) to as
few as there can be.
What settings can be done in spark-1.1.0/conf/spark-env.sh ? (or other places
as well)
I am also using hadoop for storing data on hdfs
Thank you,
Wanda
What is the motivation behind this ?
You can start with master as local[NO_OF_THREADS]. Reducing the threads at
all other places can have unexpected results. Take a look at this.
http://spark.apache.org/docs/latest/configuration.html.
Prashant Sharma
On Tue, Oct 28, 2014 at 2:08 PM, Wanda
user@spark.apache.org
Sent: Tuesday, October 28, 2014 11:17 AM
Subject: Re: Spark SQL reduce number of java threads
What is the motivation behind this ?
You can start with master as local[NO_OF_THREADS]. Reducing the threads at all
other places can have unexpected results. Take a look
