Re: PySpark 2.1.1 Can't Save Model - Permission Denied

2017-06-28 Thread Yanbo Liang
It looks like your Spark job was running under user root, but you file system operation was running under user jomernik. Since Spark will call corresponding file system(such as HDFS, S3) to commit job(rename temporary file to persistent one), it should have correct authorization for both Spark and

PySpark 2.1.1 Can't Save Model - Permission Denied

2017-06-27 Thread John Omernik
Hello all, I am running PySpark 2.1.1 as a user, jomernik. I am working through some documentation here: https://spark.apache.org/docs/latest/mllib-ensembles.html#random-forests And was working on the Random Forest Classification, and found it to be working! That said, when I try to save the