You'll have to use "spark.executor.extraJavaOptions" configuration parameter: See documentation link <https://spark.apache.org/docs/latest/configuration.html#runtime-environment> .
--conf "spark.executor.extraJavaOptions=-XX:+UseG1GC" Regards, Srinath. On Thu, Jun 14, 2018 at 4:44 PM Aakash Basu <aakash.spark....@gmail.com> wrote: > Hi, > > I am trying to spark submit with G1GC for garbage collection, but it isn't > working. > > What is the way to deploy a spark job with G1GC? > > Tried - > > *spark-submit --master spark://192.168.60.20:7077 > <http://192.168.60.20:7077> --conf -XX:+UseG1GC > /appdata/bblite-codebase/test.py* > > Didn't work. > > Tried - > > *spark-submit --master spark://192.168.60.20:7077 > <http://192.168.60.20:7077> -XX:+UseG1GC /appdata/bblite-codebase/test.py* > > Still didn't work. Would appreciate a help on this. > > Thanks, > Aakash. >
