Re: G1GC vs ParallelGC

2018-06-20 Thread vaquar khan
https://databricks.com/blog/2015/05/28/tuning-java-garbage-collection-for-spark-applications.html Regards, Vaquar khan On Wed, Jun 20, 2018, 1:18 AM Aakash Basu wrote: > Hi guys, > > I just wanted to know, why my ParallelGC (*--conf > "spark.executor.extraJavaOptions=-XX:+UseParallelGC"*) in a

G1GC vs ParallelGC

2018-06-19 Thread Aakash Basu
Hi guys, I just wanted to know, why my ParallelGC (*--conf "spark.executor.extraJavaOptions=-XX:+UseParallelGC"*) in a very long Spark ML Pipeline works faster than when I set G1GC (*--conf "spark.executor.extraJavaOptions=-XX:+UseG1GC"*), even though the Spark community suggests G1GC to be much b