[
https://issues.apache.org/jira/browse/BROOKLYN-317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15398993#comment-15398993
]
Andrea Turli commented on BROOKLYN-317:
---------------------------------------
I couldn't reproduce the error but I can confirm that ap-souteast-1 looks
particularly slow (i.e. describeImages)
I have looked closely at the code and I think
https://github.com/cloudsoft/jclouds/blob/e711275fb132c8c2f0155400de01275653ad70e7/apis/ec2/src/main/java/org/jclouds/ec2/compute/strategy/EC2CreateNodesInGroupThenAddToSet.java#L158-L158
is the right place where to sanity-check if the running instances contain the
public IP address and fail-fast maybe as I don't think a retrier will help here
(possibly ec2 was having an issue and that VM will never have a public IP?)
how many times have you experienced this problem? always with that region?
> AWS-EC2 provisioning fails: doesn't get public ip when waiting for
> ssh-reachability
> -----------------------------------------------------------------------------------
>
> Key: BROOKLYN-317
> URL: https://issues.apache.org/jira/browse/BROOKLYN-317
> Project: Brooklyn
> Issue Type: Bug
> Affects Versions: 0.9.0
> Reporter: Aled Sage
>
> When using Brooklyn 0.10.0-SNAPSHOT...
> When deploying an app in aws-ec2 singapore, one of the VMs failed to
> provision (failed to reach port 22).
> The workaround is to configure {{machineCreateAttempts}} on the location,
> setting it to a number greater than 1. It will thus retry if the problem is
> encountered.
> Looking at the node information, it only lists the private address (and the
> private hostname), and not the public ip.
> Looking in the jclouds wire log, the first result from the API call
> {{Action=DescribeInstances&InstanceId.1=i-20c2df84&Version=2012-06-01}} only
> had the private address and not the public address.
> In terms of timing, we first started polling for the instance details at
> 10:58:38,293, and stopped polling at 10:58:56,764 (when the VM was
> "running"). At that point, the API responses still did not have the public
> address. We then waiting for an ssh port to be reachable, which timed out. We
> began to destroy the VM at 11:09:00,292 - the api result then included the
> public IP.
> I suspect that this will need to be fixed in jclouds: we'll need to poll
> again for the instance details, rather than just waiting for one of the
> initial private/public addresses to be reachable.
> {noformat}
> Failed after 11m 12s: Error invoking start at
> VanillaSoftwareProcessImpl{id=mf8o2c7ef4}: RunNodesException: error running 1
> node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
> location(ap-southeast-1) image(ami-f068a193) size(m3.large)
> options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
> userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
> brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker
> Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
> brooklyn-entity-name=swarm-manager,
> brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
> userDataCksum=2f4a740b})
> Execution failures:
> 0 error[s]
> Node failures:
> 1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
> java.util.NoSuchElementException: could not connect to any ip address port 22
> on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
> location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
> parent=ap-southeast-1, iso3166Codes=[SG]},
> group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
> imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
> version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
> 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
> status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
> privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
> processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
> size=32.0, device=/dev/sdb, bootDevice=false, durable=false},
> {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true,
> durable=true}], hypervisor=xen,
> supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
> loginUser=centos}
> at
> org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
> at
> org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 1 error[s]
> org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException:
> Error invoking start at VanillaSoftwareProcessImpl{id=mf8o2c7ef4}:
> RunNodesException: error running 1 node
> group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
> location(ap-southeast-1) image(ami-f068a193) size(m3.large)
> options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
> userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
> brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker
> Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
> brooklyn-entity-name=swarm-manager,
> brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
> userDataCksum=2f4a740b})
> Execution failures:
> 0 error[s]
> Node failures:
> 1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
> java.util.NoSuchElementException: could not connect to any ip address port 22
> on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
> location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
> parent=ap-southeast-1, iso3166Codes=[SG]},
> group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
> imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
> version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
> 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
> status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
> privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
> processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
> size=32.0, device=/dev/sdb, bootDevice=false, durable=false},
> {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true,
> durable=true}], hypervisor=xen,
> supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
> loginUser=centos}
> at
> org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
> at
> org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 1 error[s]
> at
> org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.propagate(EffectorUtils.java:318)
> at
> org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.access$100(EffectorUtils.java:285)
> at
> org.apache.brooklyn.core.mgmt.internal.EffectorUtils.handleEffectorException(EffectorUtils.java:326)
> at
> org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$2.handleException(EffectorTasks.java:90)
> at
> org.apache.brooklyn.util.core.task.DynamicSequentialTask.handleException(DynamicSequentialTask.java:469)
> at
> org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:417)
> at
> org.apache.brooklyn.util.core.task.BasicExecutionManager$SubmissionCallable.call(BasicExecutionManager.java:519)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException:
> RunNodesException: error running 1 node
> group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
> location(ap-southeast-1) image(ami-f068a193) size(m3.large)
> options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
> userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
> brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker
> Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
> brooklyn-entity-name=swarm-manager,
> brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
> userDataCksum=2f4a740b})
> Execution failures:
> 0 error[s]
> Node failures:
> 1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
> java.util.NoSuchElementException: could not connect to any ip address port 22
> on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
> location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
> parent=ap-southeast-1, iso3166Codes=[SG]},
> group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
> imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
> version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
> 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
> status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
> privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
> processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
> size=32.0, device=/dev/sdb, bootDevice=false, durable=false},
> {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true,
> durable=true}], hypervisor=xen,
> supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
> loginUser=centos}
> at
> org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
> at
> org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 1 error[s]
> at
> org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
> at
> org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:372)
> at org.apache.brooklyn.util.core.task.Tasks$2.get(Tasks.java:293)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.preStartAtMachineAsync(MachineLifecycleEffectorTasks.java:465)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocation(MachineLifecycleEffectorTasks.java:382)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocations(MachineLifecycleEffectorTasks.java:367)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.start(MachineLifecycleEffectorTasks.java:356)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:257)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:244)
> at
> org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$1.call(EffectorTasks.java:82)
> at
> org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:359)
> ... 5 more
> Caused by: java.util.concurrent.ExecutionException:
> org.apache.brooklyn.util.exceptions.PropagatedRuntimeException:
> RunNodesException: error running 1 node
> group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
> location(ap-southeast-1) image(ami-f068a193) size(m3.large)
> options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
> userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
> brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker
> Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
> brooklyn-entity-name=swarm-manager,
> brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
> userDataCksum=2f4a740b})
> Execution failures:
> 0 error[s]
> Node failures:
> 1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
> java.util.NoSuchElementException: could not connect to any ip address port 22
> on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
> location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
> parent=ap-southeast-1, iso3166Codes=[SG]},
> group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
> imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
> version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
> 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
> status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
> privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
> processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
> size=32.0, device=/dev/sdb, bootDevice=false, durable=false},
> {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true,
> durable=true}], hypervisor=xen,
> supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
> loginUser=centos}
> at
> org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
> at
> org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 1 error[s]
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:188)
> at
> com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:63)
> at org.apache.brooklyn.util.core.task.BasicTask.get(BasicTask.java:361)
> at
> org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:370)
> ... 14 more
> Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException:
> RunNodesException: error running 1 node
> group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
> location(ap-southeast-1) image(ami-f068a193) size(m3.large)
> options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
> userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
> brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker
> Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
> brooklyn-entity-name=swarm-manager,
> brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
> userDataCksum=2f4a740b})
> Execution failures:
> 0 error[s]
> Node failures:
> 1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
> java.util.NoSuchElementException: could not connect to any ip address port 22
> on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
> location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
> parent=ap-southeast-1, iso3166Codes=[SG]},
> group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
> imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
> version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
> 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
> status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
> privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
> processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
> size=32.0, device=/dev/sdb, bootDevice=false, durable=false},
> {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true,
> durable=true}], hypervisor=xen,
> supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
> loginUser=centos}
> at
> org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
> at
> org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 1 error[s]
> at
> org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
> at
> org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:1103)
> at
> org.apache.brooklyn.location.jclouds.JcloudsLocation.obtain(JcloudsLocation.java:626)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:459)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:449)
> at
> org.apache.brooklyn.util.core.task.Tasks.withBlockingDetails(Tasks.java:106)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:431)
> at
> org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:407)
> ... 6 more
> Caused by: org.jclouds.compute.RunNodesException: error running 1 node
> group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
> location(ap-southeast-1) image(ami-f068a193) size(m3.large)
> options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
> userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
> brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker
> Swarm with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
> brooklyn-entity-name=swarm-manager,
> brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
> userDataCksum=2f4a740b})
> Execution failures:
> 0 error[s]
> Node failures:
> 1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
> java.util.NoSuchElementException: could not connect to any ip address port 22
> on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
> location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
> parent=ap-southeast-1, iso3166Codes=[SG]},
> group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
> imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
> version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
> 1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
> status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
> privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
> processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
> size=32.0, device=/dev/sdb, bootDevice=false, durable=false},
> {id=vol-79c51fa4, type=SAN, device=/dev/sda1, bootDevice=true,
> durable=true}], hypervisor=xen,
> supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
> loginUser=centos}
> at
> org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
> at
> org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
> at
> org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
> at
> org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
> at
> org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
> at
> org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 1 error[s]
> at
> org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:222)
> at
> org.jclouds.ec2.compute.EC2ComputeService.createNodesInGroup(EC2ComputeService.java:149)
> at
> org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:735)
> ... 12 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
