WARN Use an existing SparkContext, some configuration may not take effect. I wanted to restart the spark streaming app, so stopped the running and issued a new spark submit. Why and how it will use a existing SparkContext?
WARN Spark is not running in local mode, therefore the checkpoint directory must not be on the local filesystem. Directory 'file:/efs/checkpoint' appears to be on the local filesystem. WARN overriding enable.auto.commit to false for executor WARN overriding auto.offset.reset to none for executor WARN overriding executor group.id to spark-executor-mygroupid WARN overriding receive.buffer.bytes to 65536 see KAFKA-3135 WARN overriding enable.auto.commit to false for executor WARN overriding auto.offset.reset to none for executor