[jira] [Commented] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException
[
https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567762#comment-14567762
]
Masatake Iwasaki commented on YARN-3752:
My /etc/hosts works for pseudo distributed cluster and unit tests for
NameNode-HA in HDFS.
Hostnames are successfully resolved at first in TestRMFailover too at first.
{noformat}
java.net.ConnectException: Call From centos7/127.0.0.1 to 0.0.0.0:28031 failed
on connection exception: java.net.ConnectException: Connection refused; For
more details see: http://wiki.apache.org/hadoop/ConnectionRefused
...
java.io.EOFException: End of File Exception between local host is:
centos7/127.0.0.1; destination host is: 0.0.0.0:18031; :
java.io.EOFException; For more details see:
http://wiki.apache.org/hadoop/EOFException
...
{noformat}
Client fails to create connection due to UnknownHostException while client
retries to connect to next RM after failover.
{noformat}
java.io.IOException: java.util.concurrent.ExecutionException:
java.net.UnknownHostException: Invalid host name: local host is: (unknown);
destination host is: centos7:28032; java.net.UnknownHostException; For more
details see: http://wiki.apache.org/hadoop/UnknownHost
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1487)
at org.apache.hadoop.ipc.Client.call(Client.java:1410)
at org.apache.hadoop.ipc.Client.call(Client.java:1371)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
at com.sun.proxy.$Proxy15.getApplications(Unknown Source)
at
org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getApplications(ApplicationClientProtocolPBClientImpl.java:251)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:101)
at com.sun.proxy.$Proxy16.getApplications(Unknown Source)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getApplications(YarnClientImpl.java:484)
at
org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getApplications(YarnClientImpl.java:461)
at
org.apache.hadoop.yarn.client.TestRMFailover.verifyClientConnection(TestRMFailover.java:119)
at
org.apache.hadoop.yarn.client.TestRMFailover.verifyConnections(TestRMFailover.java:133)
at
org.apache.hadoop.yarn.client.TestRMFailover.testExplicitFailover(TestRMFailover.java:168
.
Caused by: java.net.UnknownHostException: Invalid host name: local host is:
(unknown); destination host is: centos7:28032; java.net.UnknownHostException;
For more details see: http://wiki.apache.org/hadoop/UnknownHost
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:744)
at org.apache.hadoop.ipc.Client$Connection.init(Client.java:408)
at org.apache.hadoop.ipc.Client$1.call(Client.java:1483)
at org.apache.hadoop.ipc.Client$1.call(Client.java:1480)
at
com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4767)
at
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3568)
at
com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2350)
... 49 more
{noformat}
It may be timing/environment issue because the test seems to succeed in QA
tests.
TestRMFailover fails due to intermittent UnknownHostException
-
Key: YARN-3752
URL: https://issues.apache.org/jira/browse/YARN-3752
Project: Hadoop YARN
Issue Type: Bug
Components: test
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
Priority: Minor
Client fails to create connection due to UnknownHostException while client
retries to connect to next RM after failover in unit test.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException
[ https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567763#comment-14567763 ] Masatake Iwasaki commented on YARN-3752: While I am doing trial-and-error, using 127.0.0.1 instead of 0.0.0.0 for server addresses fixed this. TestRMFailover fails due to intermittent UnknownHostException - Key: YARN-3752 URL: https://issues.apache.org/jira/browse/YARN-3752 Project: Hadoop YARN Issue Type: Bug Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor Client fails to create connection due to UnknownHostException while client retries to connect to next RM after failover in unit test. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException
[ https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567775#comment-14567775 ] Masatake Iwasaki commented on YARN-3752: I don't know the exact reason yet but using independent Configuration instances for each RM in MiniYARNCluster as YARN-3749 do also worked. TestRMFailover fails due to intermittent UnknownHostException - Key: YARN-3752 URL: https://issues.apache.org/jira/browse/YARN-3752 Project: Hadoop YARN Issue Type: Bug Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor Client fails to create connection due to UnknownHostException while client retries to connect to next RM after failover in unit test. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
