Can ypu increase number of partitions and try... Also, i dont think you
need to cache dfs before saving them... U can do away with that as well...
Raghav
On Oct 23, 2015 7:45 AM, "Ram VISWANADHA"
wrote:
> Hi ,
> I am trying to load 931MB file into an RDD, then create a DataFrame and
> store the
Hi ,
I am trying to load 931MB file into an RDD, then create a DataFrame and store
the data in a Parquet file. The save method of Parquet file is hanging. I have
set the timeout to 1800 but still the system fails to respond and hangs. I
can’t spot any errors in my code. Can someone help me? Than
