[
https://issues.apache.org/jira/browse/HADOOP-14493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sathishkumar Manimoorthy updated HADOOP-14493:
----------------------------------------------
Description:
YARN Distributed shell application fails when doing RM failover or RM restarts.
Exception trace:
17/05/30 11:57:38 DEBUG security.UserGroupInformation: PrivilegedAction as:mapr
(auth:SIMPLE)
from:org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.renameScriptFile(ApplicationMaster.java:1032)
17/05/30 11:57:38 DEBUG security.UserGroupInformation:
PrivilegedActionException as:mapr (auth:SIMPLE) cause:java.io.IOException:
Invalid source or target
17/05/30 11:57:38 ERROR distributedshell.ApplicationMaster: Not able to add
suffix (.bat/.sh) to the shell script filename
java.io.IOException: Invalid source or target
at com.mapr.fs.MapRFileSystem.rename(MapRFileSystem.java:1132)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$2.run(ApplicationMaster.java:1036)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$2.run(ApplicationMaster.java:1032)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.renameScriptFile(ApplicationMaster.java:1032)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.access$1400(ApplicationMaster.java:167)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$LaunchContainerRunnable.run(ApplicationMaster.java:953)
at java.lang.Thread.run(Thread.java:748)
DS application trying to launch the additional container and it is failing to
rename the path Execscript.sh as it was already renamed by the previous
containers in filesystem path.
I will upload the logs and path details soon.
was:
YARN Distributed shell application fails when doing RM failover or RM restarts.
Exception trace:
17/05/30 11:57:38 DEBUG security.UserGroupInformation: PrivilegedAction as:mapr
(auth:SIMPLE)
from:org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.renameScriptFile(ApplicationMaster.java:1032)
17/05/30 11:57:38 DEBUG security.UserGroupInformation:
PrivilegedActionException as:mapr (auth:SIMPLE) cause:java.io.IOException:
Invalid source or target
17/05/30 11:57:38 ERROR distributedshell.ApplicationMaster: Not able to add
suffix (.bat/.sh) to the shell script filename
java.io.IOException: Invalid source or target
at com.mapr.fs.MapRFileSystem.rename(MapRFileSystem.java:1132)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$2.run(ApplicationMaster.java:1036)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$2.run(ApplicationMaster.java:1032)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.renameScriptFile(ApplicationMaster.java:1032)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.access$1400(ApplicationMaster.java:167)
at
org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$LaunchContainerRunnable.run(ApplicationMaster.java:953)
at java.lang.Thread.run(Thread.java:748)
DS application trying to lo launch the additional container and it is failing
to rename the path Execscript.sh as it was already renamed by the previous
containers in filesystem path.
I will upload the logs and path details soon.
> YARN distributed shell application fails, when RM failed over or Restarts
> -------------------------------------------------------------------------
>
> Key: HADOOP-14493
> URL: https://issues.apache.org/jira/browse/HADOOP-14493
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 2.7.0
> Reporter: Sathishkumar Manimoorthy
> Priority: Minor
> Labels: distributedshell, yarn
>
> YARN Distributed shell application fails when doing RM failover or RM
> restarts.
> Exception trace:
> 17/05/30 11:57:38 DEBUG security.UserGroupInformation: PrivilegedAction
> as:mapr (auth:SIMPLE)
> from:org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.renameScriptFile(ApplicationMaster.java:1032)
> 17/05/30 11:57:38 DEBUG security.UserGroupInformation:
> PrivilegedActionException as:mapr (auth:SIMPLE) cause:java.io.IOException:
> Invalid source or target
> 17/05/30 11:57:38 ERROR distributedshell.ApplicationMaster: Not able to add
> suffix (.bat/.sh) to the shell script filename
> java.io.IOException: Invalid source or target
> at com.mapr.fs.MapRFileSystem.rename(MapRFileSystem.java:1132)
> at
> org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$2.run(ApplicationMaster.java:1036)
> at
> org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$2.run(ApplicationMaster.java:1032)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
> at
> org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.renameScriptFile(ApplicationMaster.java:1032)
> at
> org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster.access$1400(ApplicationMaster.java:167)
> at
> org.apache.hadoop.yarn.applications.distributedshell.ApplicationMaster$LaunchContainerRunnable.run(ApplicationMaster.java:953)
> at java.lang.Thread.run(Thread.java:748)
> DS application trying to launch the additional container and it is failing to
> rename the path Execscript.sh as it was already renamed by the previous
> containers in filesystem path.
> I will upload the logs and path details soon.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
