Hi All, Yesterday I restarted my cluster, which had the effect of clearing /tmp. When I brought Spark back up and ran my first job, /tmp/spark-events was re-created and the job ran fine. I later learned that other users were receiving errors when trying to create a spark context. It turned out the reason was that only my user was able to create subdirectories within /tmp/spark-events.
I believe /tmp/spark-events originally had ownership "bmiller1:bmiller1" (where "bmiller1" is my username) with permissions 770. Once I modified the permission to allow other users to create subdirectories other users were again able to launch jobs. Note that I think this may be related to some problems I am having viewing application history (see link). http://apache-spark-user-list.1001560.n3.nabble.com/Spark-webUI-application-details-page-td3490.html#a13130 Has anybody else experienced a problem with permissions on the "spark.eventLog.dir" directory? best, -Brad
