[
https://issues.apache.org/jira/browse/TWILL-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073897#comment-14073897
]
Terence Yim commented on TWILL-96:
----------------------------------
Attached a patch to do:
1. Use the Configuration returned by MiniYARNCluster as the Configuration
2. Use random port for RM/NM in unit-test
3. Update ApplicationMasterMain to alter the configuration with the same RM
scheduler address that the client is talking to.
Review is in
https://github.com/apache/incubator-twill/pull/9
> Yarn unit test fails in Travis-CI
> ---------------------------------
>
> Key: TWILL-96
> URL: https://issues.apache.org/jira/browse/TWILL-96
> Project: Apache Twill
> Issue Type: Bug
> Components: yarn
> Reporter: Terence Yim
> Assignee: Terence Yim
> Attachments: TWILL-96-1.patch
>
>
> The major reason is because in the YARN unit tests, it is not using the
> address that the RM is binded to, but rather using the one in yarn-default.xml
> It fails with error like this:
> java.lang.RuntimeException: java.net.UnknownHostException: Invalid host name:
> local host is: (unknown); destination host is:
> "testing-worker-linux-10-1-15919-linux-11-30791059":8032;
> java.net.UnknownHostException; For more details see:
> http://wiki.apache.org/hadoop/UnknownHost
> at org.apache.hadoop.ipc.Client$Connection.<init>(Client.java:400)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:1448)
> at org.apache.hadoop.ipc.Client.call(Client.java:1377)
> at org.apache.hadoop.ipc.Client.call(Client.java:1359)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
> at com.sun.proxy.$Proxy44.getNewApplication(Unknown Source)
> at
> org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:167)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
> at com.sun.proxy.$Proxy45.getNewApplication(Unknown Source)
> at
> org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:133)
> at
> org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:141)
> at
> org.apache.twill.internal.yarn.Hadoop21YarnAppClient.createLauncher(Hadoop21YarnAppClient.java:60)
> at
> org.apache.twill.internal.yarn.Hadoop21YarnAppClient.createLauncher(Hadoop21YarnAppClient.java:130)
> at
> org.apache.twill.yarn.YarnTwillPreparer.start(YarnTwillPreparer.java:249)
> at
> org.apache.twill.yarn.EchoServerTestRun.testEchoServer(EchoServerTestRun.java:59)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
