[
https://issues.apache.org/jira/browse/SLIDER-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134375#comment-14134375
]
Srimanth Gunturi commented on SLIDER-429:
-----------------------------------------
[[email protected]], the RM and NMs are running as root. Using debugger I have
verified that it does set HADOOP_USER_NAME to "yarn"
Below is the _ApplicationSubmissionContext_ information inside
_org.apache.slider.core.launch.AppMasterLauncher.submitApplication()_
{code}
application_id {
id: 3
cluster_timestamp: 1410807292710
}
application_name: "b1"
queue: "default"
priority {
priority: 1
}
am_container_spec {
localResources {
key: "lib/metrics-core.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/metrics-core.jar"
}
size: 85449
timestamp: 1410809407988
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "lib/curator-client.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/curator-client.jar"
}
size: 68552
timestamp: 1410809407771
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "lib/jcommander.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/jcommander.jar"
}
size: 60376
timestamp: 1410809407541
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "lib/curator-x-discovery-service.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/curator-x-discovery-service.jar"
}
size: 34364
timestamp: 1410809407927
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "expandedarchive"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file: "/user/yarn/agent/slider-agent.tar.gz"
}
size: 480985
timestamp: 1410807949156
type: ARCHIVE
visibility: APPLICATION
}
}
localResources {
key: "lib/curator-x-discovery.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/curator-x-discovery.jar"
}
size: 54256
timestamp: 1410809407852
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "lib/curator-framework.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/curator-framework.jar"
}
size: 179725
timestamp: 1410809407690
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "lib/jetty-sslengine.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/jetty-sslengine.jar"
}
size: 18891
timestamp: 1410809407635
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "lib/gson.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/gson.jar"
}
size: 189285
timestamp: 1410809407588
type: FILE
visibility: APPLICATION
}
}
localResources {
key: "lib/slider.jar"
value {
resource {
scheme: "hdfs"
host: "c6401.ambari.apache.org"
port: 8020
file:
"/user/yarn/.slider/cluster/b1/tmp/application_1410807292710_0003/am/lib/slider.jar"
}
size: 1144236
timestamp: 1410809407319
type: FILE
visibility: APPLICATION
}
}
tokens: "HDTS\000\000\000"
environment {
key: "HADOOP_USER_NAME"
value: "yarn"
}
environment {
key: "CLASSPATH"
value:
"lib/*<CPS>{{CLASSPATH}}<CPS>/etc/hadoop/conf<CPS>/usr/lib/hadoop/*<CPS>/usr/lib/hadoop/lib/*<CPS>/usr/lib/hadoop-hdfs/*<CPS>/usr/lib/hadoop-hdfs/lib/*<CPS>/usr/lib/hadoop-yarn/*<CPS>/usr/lib/hadoop-yarn/lib/*<CPS>/usr/lib/hadoop-mapreduce/*<CPS>/usr/lib/hadoop-mapreduce/lib/*"
}
command: "{{JAVA_HOME}}/bin/java -Djava.net.preferIPv4Stack=true
-Djava.awt.headless=true -Xmx256M -ea -esa
org.apache.slider.server.appmaster.SliderAppMaster create b1 -cluster-uri
hdfs://c6401.ambari.apache.org:8020/user/yarn/.slider/cluster/b1 --rm
c6402.ambari.apache.org:8030 -D slider.registry.path=/registry -D
slider.zookeeper.quorum=c6401.ambari.apache.org:2181,c6402.ambari.apache.org:2181
1><LOG_DIR>/slider-out.txt 2><LOG_DIR>/slider-err.txt "
}
resource {
memory: 256
virtual_cores: 1
}
applicationType: "org-apache-slider"
keep_containers_across_application_attempts: true
applicationTags: "name: hbase"
applicationTags: "version: 0.98.4.2.2.0.0-667-hadoop2"
applicationTags: "description: apache hbase is the hadoop database, a
distributed, scalable, big data store...."
{code}
Is there a better debug location on the Slider-Client side?
> allow API users of slider to set the HADOOP_USER_NAME of the launched AM
> ------------------------------------------------------------------------
>
> Key: SLIDER-429
> URL: https://issues.apache.org/jira/browse/SLIDER-429
> Project: Slider
> Issue Type: Improvement
> Components: client
> Affects Versions: Slider 0.60
> Reporter: Srimanth Gunturi
> Assignee: Steve Loughran
>
> even when trying to launch slider apps in a doAs clause, the AM is coming up
> without access to the desired bits of HDFS.
> This is because it is being picked up from
> UserGroupInformation.getCurrentUser() and this may not be the right one
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
