Hi, I am running toree using the command "dist/toree/bin/run.sh". This starts the spark-kernel in default configuration mode. However, I want to specify the parameters for spark-kernel. I want to run spark-kernel using following parameters:
--num-executors 25 --executor-cores 4 --executor-memory 10g --driver-memory 10g --conf spark.yarn.executor.memoryOverhead=2048 --conf spark.driver.maxResultSize=10g --conf spark.serializer=org.apache.spark.serializer.KryoSerializer If possible, please help me. Regards, Harmeet
