coming from a yarn background; log files can be found after job finishes...

with spark master/workers how to configure to get logs after job finishes?

we have setup our spark history server and spark-defaults include:

spark.eventLog.enabled         true
spark.eventLog.dir             file:///shared_mount/spark/events/
spark.history.fs.logDirectory  file:///shared_mount/spark/events/

the events are there; but no log files anways
what am i missing?

Reply via email to