I have tried with G1 GC .Please if anyone can provide their setting for GC. At code level I am : 1.reading orc table usind dataframe 2.map df to rdd of my case class 3. changed that rdd to paired rdd 4.Applied combineByKey 5. saving the result to orc file
Please suggest Regards, Renu Yadav On Fri, Nov 13, 2015 at 8:01 PM, Renu Yadav <yren...@gmail.com> wrote: > am using spark 1.4 and my application is taking much time in GC around > 60-70% of time for each task > > I am using parallel GC. > please help somebody as soon as possible. > > Thanks, > Renu >
