Github user Astralidea commented on the pull request:
https://github.com/apache/spark/pull/10770#issuecomment-179576898
@dragos Because in our system the calculation and storage are
separatedãwe manage the calculation.
There are many calculation task in my cluster, and HDFS is another cluster.
we previous use mesos running spark set must be run with root. otherwise it can
not be deploy.but HDFS storage manager say if you want to read HDFS file, you
must set HADOOP_USER_NAME to another userãSo I set this env to spark but
SparkUser change by HADOOP_USER_NAME user.thus driver could be deploy but no
executor because SparkUser is not root.but if I change root. I can not read
HDFS....
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
