[ 
https://issues.apache.org/jira/browse/YARN-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14558994#comment-14558994
 ] 

Sergey Svinarchuk commented on YARN-3715:
-----------------------------------------

There are problem in "yarn.resourcemanager.address" property. When we try 
submitting regular job this property set to "0.0.0.0:8032", but when Oozie 
submitting job this property set to jobtracker property from file
job.propertires. 
In case with RM HA we set to job.properties 
    jobTracker=maprfs:///
and then "yarn.resourcemanager.address" also set to "maprfs:///". 
Then Master.getMasterAddress get socket address from Configuration as 
"maprfs:///" and call NetUtils.createSocketAddr(address, defaultPort, name), 
but NetUtils.createSocketAddr can work only with format “hostname:port”. 
I think that for case when using RM HA need call getSocketAddr(String name, 
String defaultAddress, int defaultPort) from YarnConfiguration class. 


> Oozie jobs are failed with IllegalArgumentException: Does not contain a valid 
> host:port authority: maprfs:/// (configuration property 
> 'yarn.resourcemanager.address') on secure cluster with RM HA
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-3715
>                 URL: https://issues.apache.org/jira/browse/YARN-3715
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.7.0
>            Reporter: Sergey Svinarchuk
>
> 2015-05-21 16:06:55,887  WARN ActionStartXCommand:544 -
> SERVER[centos6.localdomain] USER[mapr] GROUP[-] TOKEN[] APP[Hive]
> JOB[0000001-150521123655733-oozie-mapr-W]
> ACTION[0000001-150521123655733-oozie-mapr-W@Hive] Error starting action 
> [Hive].
> ErrorType [ERROR], ErrorCode [IllegalArgumentException], Message
> [IllegalArgumentException: Does not contain a valid host:port authority:
> maprfs:/// (configuration property 'yarn.resourcemanager.address')]
> org.apache.oozie.action.ActionExecutorException: IllegalArgumentException: 
> Does
> not contain a valid host:port authority: maprfs:/// (configuration property
> 'yarn.resourcemanager.address')
>     at
> org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:401)
>     at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:979)
>     at
> org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1134)
>     at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
>     at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
>     at org.apache.oozie.command.XCommand.call(XCommand.java:281)
>     at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
>     at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
>     at
> org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
>     at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>     at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException: Does not contain a valid
> host:port authority: maprfs:/// (configuration property
> 'yarn.resourcemanager.address')
>     at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:211)
>     at
> org.apache.hadoop.conf.Configuration.getSocketAddr(Configuration.java:1788)
>     at org.apache.hadoop.mapred.Master.getMasterAddress(Master.java:58)
>     at org.apache.hadoop.mapred.Master.getMasterPrincipal(Master.java:67)
>     at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:114)
>     at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
>     at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
>     at
> org.apache.hadoop.mapred.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:127)
>     at
> org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:460)
>     at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:343)
>     at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
>     at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1566)
>     at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
>     at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:562)
>     at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:557)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1566)
>     at 
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:557)
>     at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:548)
>     at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:964)
>     ... 10 more
> 2015-05-21 16:06:55,889  WARN ActionStartXCommand:544 -
> SERVER[centos6.localdomain] USER[mapr] GROUP[-] TOKEN[] APP[Hive]
> JOB[0000001-150521123655733-oozie-mapr-W]
> ACTION[0000001-150521123655733-oozie-mapr-W@Hive] Setting Action Status to
> [DONE]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to