Hi,
I have enabled log4j.debug=true in the log4j.properties and as I use
the zeepelin notebook I see the following
log4j: Setting property [file] to [/path/to/my/zeppelin/logfile] and the
other logfiles are also fine.
further I am required to specify a variable "correlation-config.path" for
my application to work so I used the
export SPARK_SUBMIT_OPTIONS="--conf
spark.executor.extraJavaOptions=$SPARK_EXECUTOR_EXTRAJAVAOPTIONS --conf
spark.driver.extraJavaOptions=$SPARK_DRIVER_EXTRAJAVAOPTIONS"
Now when I re-start zeppelin I get the following
log4j: Setting property [file] to [].
log4j: setFile called: , true
log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: (No such file or directory)
at java.io.FileOutputStream.open0(Native Method)
at java.io.FileOutputStream.open(FileOutputStream.java:270)
at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
at java.io.FileOutputStream.<init>(FileOutputStream.java:133)
So I believe the config parameter "zeppelin.log.file" in the
log4j.properties file is being overwritten to "" when I set the
SPARK_SUBMIT_OPTIONS
I am not sure about my conclusion it will be great if someone can confirm
this. For now I will try to hardcode the path in log4j.properties
Regards
-Ravi
