Re: Spark jobs failing due to java.lang.OutOfMemoryError: PermGen space

2016-08-04 Thread $iddhe$h Divekar
t; executors in the cluster of 8 executor. > > Thanks > Deepak > > On 4 Aug 2016 8:04 pm, "$iddhe$h Divekar" <siddhesh.dive...@gmail.com> > wrote: > >> Hi, >> >> I am running spark jobs using apache oozie in yarn-client mode. >> My job

Spark jobs failing due to java.lang.OutOfMemoryError: PermGen space

2016-08-04 Thread $iddhe$h Divekar
Hi, I am running spark jobs using apache oozie in yarn-client mode. My job.properties has sparkConf which gets used in workflow.xml. I have tried increasing MaxPermSize using sparkConf in job.properties but that is not resolving the issue. *sparkConf*=--verbose --driver-java-options

Re: PermGen space Error

2016-08-03 Thread $iddhe$h Divekar
I am running the spark job in yarn-client mode. On Wed, Aug 3, 2016 at 8:14 PM, $iddhe$h Divekar <siddhesh.dive...@gmail.com > wrote: > Hi, > > I am running spark jobs using apache oozie. > My job.properties has sparkConf which gets used in workflow.xml. > > I have trie

PermGen space Error

2016-08-03 Thread $iddhe$h Divekar
Hi, I am running spark jobs using apache oozie. My job.properties has sparkConf which gets used in workflow.xml. I have tried increasing MaxPermSize using sparkConf in job.properties but that is not resolving the issue. *sparkConf*=--verbose --driver-java-options '-XX:MaxPermSize=8192M' --conf