Aled Sage created BROOKLYN-317:
----------------------------------
Summary: AWS-EC2 provisioning fails: doesn't get public ip when
waiting for ssh-reachability
Key: BROOKLYN-317
URL: https://issues.apache.org/jira/browse/BROOKLYN-317
Project: Brooklyn
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Aled Sage
When using Brooklyn 0.10.0-SNAPSHOT...
When deploying an app in aws-ec2 singapore, one of the VMs failed to provision
(failed to reach port 22).
The workaround is to configure {{machineCreateAttempts}} on the location,
setting it to a number greater than 1. It will thus retry if the problem is
encountered.
Looking at the node information, it only lists the private address (and the
private hostname), and not the public ip.
Looking in the jclouds wire log, the first result from the API call
{{Action=DescribeInstances&InstanceId.1=i-20c2df84&Version=2012-06-01}} only
had the private address and not the public address.
In terms of timing, we first started polling for the instance details at
10:58:38,293, and stopped polling at 10:58:56,764 (when the VM was "running").
At that point, the API responses still did not have the public address. We then
waiting for an ssh port to be reachable, which timed out. We began to destroy
the VM at 11:09:00,292 - the api result then included the public IP.
I suspect that this will need to be fixed in jclouds: we'll need to poll again
for the instance details, rather than just waiting for one of the initial
private/public addresses to be reachable.
{noformat}
Failed after 11m 12s: Error invoking start at
VanillaSoftwareProcessImpl{id=mf8o2c7ef4}: RunNodesException: error running 1
node group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large)
options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm
with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
brooklyn-entity-name=swarm-manager,
brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22
on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]},
group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException:
Error invoking start at VanillaSoftwareProcessImpl{id=mf8o2c7ef4}:
RunNodesException: error running 1 node
group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large)
options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm
with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
brooklyn-entity-name=swarm-manager,
brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22
on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]},
group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at
org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.propagate(EffectorUtils.java:318)
at
org.apache.brooklyn.core.mgmt.internal.EffectorUtils$EffectorCallPropagatedRuntimeException.access$100(EffectorUtils.java:285)
at
org.apache.brooklyn.core.mgmt.internal.EffectorUtils.handleEffectorException(EffectorUtils.java:326)
at
org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$2.handleException(EffectorTasks.java:90)
at
org.apache.brooklyn.util.core.task.DynamicSequentialTask.handleException(DynamicSequentialTask.java:469)
at
org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:417)
at
org.apache.brooklyn.util.core.task.BasicExecutionManager$SubmissionCallable.call(BasicExecutionManager.java:519)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException:
RunNodesException: error running 1 node
group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large)
options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm
with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
brooklyn-entity-name=swarm-manager,
brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22
on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]},
group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at
org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
at
org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:372)
at org.apache.brooklyn.util.core.task.Tasks$2.get(Tasks.java:293)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.preStartAtMachineAsync(MachineLifecycleEffectorTasks.java:465)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocation(MachineLifecycleEffectorTasks.java:382)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.startInLocations(MachineLifecycleEffectorTasks.java:367)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks.start(MachineLifecycleEffectorTasks.java:356)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:257)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$StartEffectorBody.call(MachineLifecycleEffectorTasks.java:244)
at
org.apache.brooklyn.core.effector.EffectorTasks$EffectorBodyTaskFactory$1.call(EffectorTasks.java:82)
at
org.apache.brooklyn.util.core.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:359)
... 5 more
Caused by: java.util.concurrent.ExecutionException:
org.apache.brooklyn.util.exceptions.PropagatedRuntimeException:
RunNodesException: error running 1 node
group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large)
options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm
with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
brooklyn-entity-name=swarm-manager,
brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22
on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]},
group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at
com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:63)
at org.apache.brooklyn.util.core.task.BasicTask.get(BasicTask.java:361)
at
org.apache.brooklyn.util.core.task.BasicTask.getUnchecked(BasicTask.java:370)
... 14 more
Caused by: org.apache.brooklyn.util.exceptions.PropagatedRuntimeException:
RunNodesException: error running 1 node
group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large)
options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm
with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
brooklyn-entity-name=swarm-manager,
brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22
on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]},
group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at
org.apache.brooklyn.util.exceptions.Exceptions.propagate(Exceptions.java:129)
at
org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:1103)
at
org.apache.brooklyn.location.jclouds.JcloudsLocation.obtain(JcloudsLocation.java:626)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:459)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ObtainLocationTask.call(MachineLifecycleEffectorTasks.java:449)
at
org.apache.brooklyn.util.core.task.Tasks.withBlockingDetails(Tasks.java:106)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:431)
at
org.apache.brooklyn.entity.software.base.lifecycle.MachineLifecycleEffectorTasks$ProvisionMachineTask.call(MachineLifecycleEffectorTasks.java:407)
... 6 more
Caused by: org.jclouds.compute.RunNodesException: error running 1 node
group(brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o)
location(ap-southeast-1) image(ami-f068a193) size(m3.large)
options({loginUser=centos, inboundPorts=[22, 2376, 3376], scriptPresent=true,
userMetadata={Name=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o-jkdo,
brooklyn-user=amp, brooklyn-app-id=s3vpt4rpqb, brooklyn-app-name=Docker Swarm
with Discovery and CA, brooklyn-entity-id=mf8o2c7ef4,
brooklyn-entity-name=swarm-manager,
brooklyn-server-creation-date=2016-07-23-1058}, groupNames=[brooklyn-all],
userDataCksum=2f4a740b})
Execution failures:
0 error[s]
Node failures:
1) NoSuchElementException on node ap-southeast-1/i-20c2df84:
java.util.NoSuchElementException: could not connect to any ip address port 22
on node {id=ap-southeast-1/i-20c2df84, providerId=i-20c2df84,
location={scope=ZONE, id=ap-southeast-1a, description=ap-southeast-1a,
parent=ap-southeast-1, iso3166Codes=[SG]},
group=brooklyn-oarida-amp-docker-swar-s3vp-swarm-manager-mf8o,
imageId=ap-southeast-1/ami-f068a193, os={family=unrecognized, arch=hvm,
version=, description=aws-marketplace/CentOS Linux 7 x86_64 HVM EBS
1602-b7ee8a69-ee97-4a49-9e68-afaee216db2e-ami-d7e1d2bd.3, is64Bit=true},
status=RUNNING[running], loginPort=22, hostname=ip-10-165-18-229,
privateAddresses=[10.165.18.229], hardware={id=m3.large, providerId=m3.large,
processors=[{cores=2.0, speed=3.25}], ram=7680, volumes=[{type=LOCAL,
size=32.0, device=/dev/sdb, bootDevice=false, durable=false}, {id=vol-79c51fa4,
type=SAN, device=/dev/sda1, bootDevice=true, durable=true}], hypervisor=xen,
supportsImage=And(ALWAYS_TRUE,Or(requiresVirtualizationType(hvm),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,ALWAYS_TRUE)},
loginUser=centos}
at
org.jclouds.compute.util.ConcurrentOpenSocketFinder.findOpenSocketOnNode(ConcurrentOpenSocketFinder.java:107)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:66)
at
org.jclouds.compute.functions.CreateSshClientOncePortIsListeningOnNode.apply(CreateSshClientOncePortIsListeningOnNode.java:40)
at
org.jclouds.compute.callables.SudoAwareInitManager.init(SudoAwareInitManager.java:67)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSsh.init(RunScriptOnNodeAsInitScriptUsingSsh.java:64)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:77)
at
org.jclouds.compute.callables.RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.init(RunScriptOnNodeAsInitScriptUsingSshAndBlockUntilComplete.java:38)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:61)
at
org.jclouds.compute.strategy.InitializeRunScriptOnNodeOrPlaceInBadMap.call(InitializeRunScriptOnNodeOrPlaceInBadMap.java:34)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:119)
at
org.jclouds.compute.strategy.CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.call(CustomizeNodeAndAddToGoodMapOrPutExceptionIntoBadMap.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 error[s]
at
org.jclouds.compute.internal.BaseComputeService.createNodesInGroup(BaseComputeService.java:222)
at
org.jclouds.ec2.compute.EC2ComputeService.createNodesInGroup(EC2ComputeService.java:149)
at
org.apache.brooklyn.location.jclouds.JcloudsLocation.obtainOnce(JcloudsLocation.java:735)
... 12 more
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
