Hi, I am able to do logging for driver but not for executor. I am running spark streaming under mesos. Want to do log4j logging separately for driver and executor.
Used the below option in spark-submit command : --driver-java-options "-Dlog4j.configuration=file:/usr/local/spark-1.5.1-bin-hadoop2.6/conf/log4j_RequestLogDriver.properties" --conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=file: /usr/local/spark-1.5.1-bin-hadoop2.6/conf/log4j_RequestLogExecutor.properties " Logging for driver at path mentioned as in log4j_RequestLogDriver.properties(/tmp/requestLogDriver.log) is happening fine. But for executor, there is no logging happening (shud be at /tmp/requestLogExecutor.log as mentioned in log4j_RequestLogExecutor.properties on executor machines) *Any suggestions how to get logging enabled for executor ?* TIA, Chandan -- Chandan Prakash
