GitHub user kwmonroe opened a pull request:
https://github.com/apache/bigtop/pull/163
BIGTOP-2603: NN/RM charm should include a spark user/group
When NN/RM are not colocated with spark, they do not know about the spark
user/group. When in `yarn-client` mode, the spark charm will create hdfs dirs
with `spark` ACLs. This leads to errors like this on the namenode:
`WARN org.apache.hadoop.security.UserGroupInformation: No groups available
for user spark`
Always create the spark user/group on NN and RM. This also works if
spark/NN/RM are all colocated.
Note that `hadoop` should be a secondary group (not primary) for extra
users created by these charms, so this PR ensures that as well.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/juju-solutions/bigtop
bug/BIGTOP-2603/add-spark-user
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/bigtop/pull/163.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #163
----
commit 74b427eccaafd0fd44f5d5aba2289d166388cdd3
Author: Kevin W Monroe <[email protected]>
Date: 2016-11-22T23:38:58Z
add spark user/group so they always exist on NN and RM (prevents warnings
when NN/RM are not colocated with spark)
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
