subject:"OOM in spark driver"

Re: OOM in spark driver

2015-09-04 Thread Akhil Das

; Hence Now i am saving result on hdfs and with the help > > of JavaSparkListener, copying file from hdfs to s3 with hadoop fileUtil > > in onApplicationEnd method. But my job is getting failed with OOM in > spark > > driver. > > > > *5/09/02 04:17:57 INFO cluster.

Re: OOM in spark driver

2015-09-02 Thread Mike Hynes

e > saving data to s3. > > Hence Now i am saving result on hdfs and with the help > of JavaSparkListener, copying file from hdfs to s3 with hadoop fileUtil > in onApplicationEnd method. But my job is getting failed with OOM in spark > driver. > > *5/09/02 04:17:57 INFO clu