I have seen similar issues where, at home, "localhost" was being mapped to the router's IP and port allocation was failing. I think I just modified /etc/hosts to explicitly map localhost to 127.0.0.1.
In your case, which device has this ip 192.168.64.1 <http://192.168.64.1:0>? On Tue, Oct 21, 2014 at 8:09 AM, Jon Maron <[email protected]> wrote: > Additional logging from failing unit test: > > 2014-10-21 10:46:37,976 [Thread-76] INFO > containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:serviceStart(465)) - ContainerManager started at > /192.168.64.1:58613 > 2014-10-21 10:46:37,976 [Thread-76] INFO > containermanager.ContainerManagerImpl > (ContainerManagerImpl.java:serviceStart(466)) - ContainerManager bound to > HW10386.local/192.168.64.1:0 > > On Oct 21, 2014, at 11:06 AM, Jonathan Maron <[email protected]> wrote: > > > I am getting the following stack trace in random unit tests (when > running the full suite): > > > > java.net.BindException: Problem binding to [HW10386.local/192.168.64.1:0] > java.net.BindException: Can't assign requested address; For more details > see: http://wiki.apache.org/hadoop/BindException > > at sun.nio.ch.Net.connect0(Native Method) > > at sun.nio.ch.Net.connect(Net.java:465) > > at sun.nio.ch.Net.connect(Net.java:457) > > at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670) > > at > org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:192) > > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) > > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) > > at > org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:607) > > at > org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:705) > > at > org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:368) > > at org.apache.hadoop.ipc.Client.getConnection(Client.java:1521) > > at org.apache.hadoop.ipc.Client.call(Client.java:1438) > > at org.apache.hadoop.ipc.Client.call(Client.java:1399) > > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) > > at com.sun.proxy.$Proxy26.getApplications(Unknown Source) > > at > org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getApplications(ApplicationClientProtocolPBClientImpl.java:237) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) > > at > org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) > > at com.sun.proxy.$Proxy27.getApplications(Unknown Source) > > at > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getApplications(YarnClientImpl.java:430) > > at > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getApplications(YarnClientImpl.java:414) > > at > org.apache.slider.client.SliderYarnClientImpl.listInstances(SliderYarnClientImpl.java:75) > > at > org.apache.slider.client.SliderYarnClientImpl.findAllLiveInstances(SliderYarnClientImpl.java:241) > > at > org.apache.slider.core.registry.YarnAppListClient.findAllLiveInstances(YarnAppListClient.java:65) > > at > org.apache.slider.client.SliderClient.findAllLiveInstances(SliderClient.java:1856) > > at > org.apache.slider.client.SliderClient.verifyNoLiveClusters(SliderClient.java:1524) > > at > org.apache.slider.client.SliderClient.buildInstanceDefinition(SliderClient.java:769) > > at > org.apache.slider.client.SliderClient.actionBuild(SliderClient.java:661) > > at > org.apache.slider.client.SliderClient.actionCreate(SliderClient.java:607) > > at > org.apache.slider.client.SliderClient.exec(SliderClient.java:368) > > at > org.apache.slider.client.SliderClient.runService(SliderClient.java:339) > > at > org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:188) > > at > org.apache.slider.test.SliderTestUtils.execSliderCommand(SliderTestUtils.groovy:570) > > at > org.apache.slider.test.SliderTestUtils.launchClientAgainstRM(SliderTestUtils.groovy:621) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90) > > at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:233) > > at > groovy.lang.MetaClassImpl.invokeStaticMethod(MetaClassImpl.java:1339) > > at > org.codehaus.groovy.runtime.callsite.StaticMetaClassSite.callStatic(StaticMetaClassSite.java:62) > > at > org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:53) > > at > org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:157) > > at > org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:173) > > at > org.apache.slider.test.YarnMiniClusterTestBase.launchClientNoExitCodeCheck(YarnMiniClusterTestBase.groovy:316) > > at > org.apache.slider.test.YarnMiniClusterTestBase$launchClientNoExitCodeCheck$1.callCurrent(Unknown > Source) > > at > org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:49) > > at > org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:133) > > at > org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:145) > > at > org.apache.slider.test.YarnMiniClusterTestBase.launchClientAgainstMiniMR(YarnMiniClusterTestBase.groovy:297) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:207) > > at > org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56) > > at > org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:49) > > at > org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:133) > > at > org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:145) > > at > org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:473) > > at > org.apache.slider.test.YarnMiniClusterTestBase$createOrBuildCluster.callCurrent(Unknown > Source) > > at > org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:49) > > at > org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:133) > > at > org.apache.slider.test.YarnMiniClusterTestBase.createCluster(YarnMiniClusterTestBase.groovy:403) > > at > org.apache.slider.agent.AgentMiniClusterTestBase.createStandaloneAMWithArgs(AgentMiniClusterTestBase.groovy:179) > > at > org.apache.slider.agent.AgentMiniClusterTestBase.createStandaloneAM(AgentMiniClusterTestBase.groovy:155) > > at > org.apache.slider.agent.freezethaw.TestFreezeCommands.testFreezeCommands(TestFreezeCommands.groovy:50) > > > > I can see that an attempt is being made to bind to port 0: > > > > 2014-10-21 10:46:38,638 [IPC Server listener on 58623] INFO ipc.Server > (Server.java:run(674)) - IPC Server listener on 58623: starting > > 2014-10-21 10:46:39,632 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 2 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > 2014-10-21 10:46:40,633 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 3 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > 2014-10-21 10:46:41,634 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 4 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > 2014-10-21 10:46:42,636 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 5 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > 2014-10-21 10:46:43,637 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 6 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > 2014-10-21 10:46:44,638 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 7 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > 2014-10-21 10:46:45,639 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 8 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > 2014-10-21 10:46:46,640 [Thread-1] INFO ipc.Client > (Client.java:handleConnectionFailure(858)) - Retrying connect to server: > HW10386.local/192.168.64.1:0. Already tried 9 time(s); retry policy is > RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 > MILLISECONDS) > > > > Has anyone else seen this behavior? > > > > — Jon > > > > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. > -- thanks Sumit
