I'm working with spark 0.9.0 on cdh5.
I'm running a spark application written in java in yarn-client mode.
Cause of the OP installed on the cluster I need to run the application using
the hdfs user, otherwise I have a permission problem and getting the following
error:
Yeah actually it's hdfs that has superuser privileges on HDFS, not
root. It looks like you're trying to access a nonexistent user
directory like /user/foo, and it fails because root can't create it,
and you inherit privileges for root since that is what your app runs
as.
I don't think you want to
