Re: Spark submit OutOfMemory Error in local mode
Are you getting OutOfMemory on the driver or on the executor? Typical cause of OOM in Spark can be due to fewer number of tasks for a job. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29117.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Re: Spark submit OutOfMemory Error in local mode
Increase the cores, as you're trying to run multiple threads Sent from Naga iPad > On Aug 22, 2017, at 3:26 PM, "u...@moosheimer.com" <u...@moosheimer.com> > wrote: > > Since you didn't post any concrete information it's hard to give you an > advice. > > Try to increase the executor memory (spark.executor.memory). > If that doesn't help give all the experts in the community a chance to help > you by adding more details like version, logfile, source etc > > Mit freundlichen Grüßen / best regards > Kay-Uwe Moosheimer > >> Am 22.08.2017 um 20:16 schrieb shitijkuls <kulshreshth...@gmail.com>: >> >> Any help here will be appreciated. >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29096.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> > > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Re: Spark submit OutOfMemory Error in local mode
Since you didn't post any concrete information it's hard to give you an advice. Try to increase the executor memory (spark.executor.memory). If that doesn't help give all the experts in the community a chance to help you by adding more details like version, logfile, source etc Mit freundlichen Grüßen / best regards Kay-Uwe Moosheimer > Am 22.08.2017 um 20:16 schrieb shitijkuls <kulshreshth...@gmail.com>: > > Any help here will be appreciated. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29096.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Re: Spark submit OutOfMemory Error in local mode
Any help here will be appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-OutOfMemory-Error-in-local-mode-tp29081p29096.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
