Hi Andrea, Many thanks !
The configurations that you suggested solved the problem. Great ! IMHO, the "Getting Started" template brooklyn.properties file (http://brooklyncentral.github.io/use/guide/quickstart/brooklyn.properties) and the Location options for brooklyn.properties files (https://docs.google.com/spreadsheet/ccc?key=0Avy7Tdf2EOIqdGQzSlNiT2M0V19SejBScDhSdzMtT2c#gid=0) should be updated to reflect this case. Would you like that I open a JIRA (or other request) for that ? — Alessio On Jun 4, 2014, at 5:59 PM, Andrea Turli <[email protected]> wrote: > Hi Alessio, > > can you try to use this brooklyn.properties example > https://gist.github.com/andreaturli/d42d5aeaaacb693a4f66 > > I think those 2 properties, in particular, would be helpful, in your case > > brooklyn.location.jclouds.my-openstack.keyPair=your-keypair-name > brooklyn.location.jclouds.my-openstack.loginUser.privateKeyFile=/path/to/your-keypair-name.pem > > Let us know, > Andrea > > > On 4 June 2014 17:33, Alessio Gambi <[email protected]> wrote: > >> Hi Martin, >> >> sadly the situation is unchanged after implementing your suggestion. >> >> The ssh client (jclouds.ssh) cannot connect to the instances, because the >> key pair is not set up correctly. It seems that the privateKey/publicKey >> options are silently ignored. >> >> I think suspect that there might be a misconfiguration somewhere and not >> all the data are passed to jclouds. >> >> Something like this: >> >> http://stackoverflow.com/questions/19733905/pass-ssh-key-using-jclouds-in-openstack >> >> — Alessio >> >> On Jun 4, 2014, at 4:05 PM, Martin Harris <[email protected]> >> wrote: >> >>> Hi Alessio, >>> >>> Sorry, that should have read >> "brooklyn.location.named.OpenStack.user=ubuntu" >>> not "brooklyn.location.named.OpenStack.loginUser=ubuntu" - a >> copy-and-paste >>> error on my behalf. I must admit I haven't tried it on OpenStack as I >> don't >>> have an OpenStack account setup, but I've just tested it on AWS and it >>> works fine. If it doesn't work for you, let me know and I'll keep digging >>> >>> Cheers >>> >>> M >>> >>> >>> On 4 June 2014 14:28, Alessio Gambi <[email protected]> wrote: >>> >>>> Hi Martin, >>>> >>>> tried your solution, but unfortunately that did not work. >>>> >>>> As before, all the VMs are started but no keyPair is setup, and no ssh >> key >>>> put inside the VM. >>>> >>>> For the moment, I can workaround this by using an “hand made” image, >> that >>>> is, an image where I already install mine public key, but I would like >> to >>>> make the setup as correct as possible since the beginning. >>>> >>>> I attach some parts of the logs below. >>>> >>>> >>>> ==== Brooklyn.debug ==== >>>> >>>> 2014-06-04 13:04:41,403 DEBUG brooklyn.util.os.Os >>>> [brooklyn-execmanager-l0WUHIdn-9]: Quietly changing >> '~/.ssh/brooklyn_rsa' >>>> to '/home/ubuntu/.ssh/brooklyn_rsa' >>>> 2014-06-04 13:04:41,404 DEBUG b.l.jclouds.JcloudsLocation >>>> [brooklyn-execmanager-l0WUHIdn-13]: jclouds using template >>>> {image={id=myregion/9e6ee7a0-7dc9-4fe1-851a-7dc632f5f912, >>>> providerId=9e6ee7a0-7dc9-4fe1-851a- >>>> 7dc632f5f912, name=Ubuntu 12.04.1 LTS amd64, location={scope=ZONE, >>>> id=myregion, description=myregion, parent=openstack-nova}, >>>> os={family=ubuntu, name=Ubuntu 12.04.1 LTS amd64, version=12.04, >>>> description=Ubuntu >>>> 12.04.1 LTS amd64, is64Bit=true}, description=Ubuntu 12.04.1 LTS amd64, >>>> status=AVAILABLE, loginUser=ubuntu}, hardware={id=myregion/000000960, >>>> providerId=000000960, name=m1.micro, location={scope=ZONE, id=myregi >>>> on, description=myregion, parent=openstack-nova}, >> processors=[{cores=1.0, >>>> speed=1.0}], ram=960, volumes=[{type=LOCAL, size=40.0, bootDevice=true, >>>> durable=true}], supportsImage=ALWAYS_TRUE}, location={scope=ZONE >>>> , id=myregion, description=myregion, parent=openstack-nova}, >>>> options={loginUser=ubuntu, inboundPorts=[22, 8000], scriptPresent=true, >>>> autoAssignFloatingIp=false, securityGroupNames=[default], >>>> configDrive=false}} >>>> / options {loginUser=ubuntu, inboundPorts=[22, 8000], >> scriptPresent=true, >>>> autoAssignFloatingIp=false, securityGroupNames=[default], >>>> configDrive=false} to provision machine in >>>> openstack-novXXXX@NginxControllerImpl{id=IMgLLkfT} >>>> >>>> 2014-06-04 13:04:41,405 DEBUG jclouds.compute >>>> [brooklyn-execmanager-l0WUHIdn-13]: >> running 1 node >>>> group(brooklyn-kuhb-ubuntu-webclusterdatab-krt9-nginx-imgl) >>>> location(myregion) image(myregion/9e6ee7a0-7dc9-4fe1-851a-7dc632f5f912) >>>> hardwareProfile(myregion/000000960) options({loginUser=ubuntu, >>>> inboundPorts=[22, 8000], scriptPresent=true, >>>> >> userMetadata={Name=brooklyn-kuhb-ubuntu-webclusterdatab-krt9-nginx-imgl-vzFy}, >>>> autoAssignFloatingIp=false, securityGroupNames=[default], >>>> configDrive=false}) >>>> >>>> . . . >>>> >>>> 2014-06-04 13:04:42,010 DEBUG jclouds.wire [user thread 2]: << >> "{"server": >>>> {"status": "BUILD", "updated": "2014-06-04T13:04:41Z", "hostId": "", >>>> "addresses": {}, "links": [{"href": " >>>> >> http://openstack.infosys.tuwien.ac.at:8774/v2/dce8a3b04a3843c89d855e682a71c672/servers/94d99d6b-1a27-4169-855d-dbeed9b4c971 >> ", >>>> "rel": "self"}, {"href": " >>>> >> http://openstack.infosys.tuwien.ac.at:8774/dce8a3b04a3843c89d855e682a71c672/servers/94d99d6b-1a27-4169-855d-dbeed9b4c971 >> ", >>>> "rel": "bookmark"}], "key_name": null, "image": {"id": >>>> "9e6ee7a0-7dc9-4fe1-851a-7dc632f5f912", "links": [{"href": " >>>> >> http://openstack.infosys.tuwien.ac.at:8774/dce8a3b04a3843c89d855e682a71c672/images/9e6ee7a0-7dc9-4fe1-851a-7dc632f5f912 >> ", >>>> "rel": "bookmark"}]}, "OS-EXT-STS:task_state": "scheduling", >>>> "OS-EXT-STS:vm_state": "building", "flavor": {"id": "000000960", >> "links": >>>> [{"href": " >>>> >> http://openstack.infosys.tuwien.ac.at:8774/dce8a3b04a3843c89d855e682a71c672/flavors/000000960 >> ", >>>> "rel": "bookmark"}]}, "id": "94d99d6b-1a27-4169-855d-dbeed9b4c971", >>>> "security_groups": [{"name": "default"}], "user_id": >>>> "74416de8baf14f22ad1da0e20001252a", "name": >>>> "brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7", "created": >>>> "2014-06-04T13:04:41Z", "tenant_id": "dce8a3b04a3843c89d855e682a71c672", >>>> "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", >>>> "progress": 0, "OS-EXT-STS:power_state": 0, "config_drive": "", >> "metadata": >>>> {"Name": "brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-vbYG", >>>> "jclouds-group": >> "brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g"}}}" >>>> >>>> . . . // Eventually the VM starts >>>> >>>> 2014-06-04 13:06:40,019 DEBUG jclouds.ssh [user thread 2]: >> >>>> (ubuntu:pw[512839791320ffea9341a5edaa9f388f]@10.99.0.49:22) acquiring >>>> {hostAndPort=10.99.0.49:22, loginUser=ubuntu, ssh=null, >>>> connectTimeout=60000, sessionTimeout=60000} >>>> >>>> 2014-06-04 13:06:40,019 DEBUG jclouds.ssh [user thread 2]: >> >>>> (ubuntu:pw[512839791320ffea9341a5edaa9f388f]@10.99.0.49:22) acquiring >>>> {hostAndPort=10.99.0.49:22, loginUser=ubuntu, ssh=null, >>>> connectTimeout=60000, sessionTimeout=60000} >>>> 2014-06-04 13:06:45,620 WARN net.schmizz.sshj.DefaultConfig [user >> thread >>>> 3]: Disabling high-strength ciphers: cipher strengths apparently >> limited by >>>> JCE policy >>>> 2014-06-04 13:06:45,813 ERROR net.schmizz.concurrent.Promise [user >> thread >>>> 3]: <<authenticated>> woke to: >> net.schmizz.sshj.userauth.UserAuthException: >>>> password auth failed >>>> >>>> >>>> ==== MySQL VM ==== >>>> Generating public/private rsa key pair. >>>> >>>> Your identification has been saved in /etc/ssh/ssh_host_rsa_key. >>>> >>>> Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub. >>>> >>>> The key fingerprint is: >>>> >>>> 39:fd:cf:76:92:bd:cb:68:22:c1:2b:1a:a4:f0:ca:66 >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 >>>> >>>> . . . >>>> Generating public/private dsa key pair. >>>> >>>> Your identification has been saved in /etc/ssh/ssh_host_dsa_key. >>>> >>>> Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub. >>>> >>>> The key fingerprint is: >>>> >>>> 11:7d:6e:e7:db:e2:a4:0d:08:73:4f:16:ec:d7:a3:14 >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 >>>> >>>> . . . >>>> Generating public/private ecdsa key pair. >>>> >>>> Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key. >>>> >>>> Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub. >>>> >>>> The key fingerprint is: >>>> >>>> c4:65:ff:f9:86:be:be:b8:06:c5:1a:2e:1d:f5:4b:87 >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 >>>> >>>> . . . >>>> Generation complete. >>>> ec2: >>>> ec2: ############################################################# >>>> ec2: -----BEGIN SSH HOST KEY FINGERPRINTS----- >>>> ec2: 1024 11:7d:6e:e7:db:e2:a4:0d:08:73:4f:16:ec:d7:a3:14 >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 (DSA) >>>> ec2: 256 c4:65:ff:f9:86:be:be:b8:06:c5:1a:2e:1d:f5:4b:87 >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 (ECDSA) >>>> ec2: 2048 39:fd:cf:76:92:bd:cb:68:22:c1:2b:1a:a4:f0:ca:66 >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 (RSA) >>>> ec2: -----END SSH HOST KEY FINGERPRINTS----- >>>> ec2: ############################################################# >>>> -----BEGIN SSH HOST KEY KEYS----- >>>> ecdsa-sha2-nistp256 >>>> >> AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJohzlX8mGzbHW4SZzB7cw1Y7eJkTPPOjRis+WwiF++/GIX4xOcW+OTqX+pGhQMlIS3dVaRqhFlw3DuZNxMahws= >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 >>>> ssh-rsa >>>> >> AAAAB3NzaC1yc2EAAAADAQABAAABAQChtIR+qUTMGCUzEZrFvCz5xkzaGYRpiKNDT7GipBnyaGDz8rfrcJtvUrC3Qa11Rq+2TVv8CrLQ0AkgJB0dFu3F7xw1bG1IHn8xOClr2zz7Bpin7etu09A8fwj3iv7bCcJQiApOesfneM2Pt1PS/h6npl8ypt8UtFtUdkeNdr2JOmkJlxjuOShNWgdXntyUD//q+fbIWccN3Dt0gN7l8tbqJzwO+SEL71gxxjZ2Uj+OA6TiQWazUbrVn9kopDd1DbdNBRTjnbxxterPM5PqAm11vKHYm/eqXNtyIKMcZTo53jlVmGEzh1PTO/rkwkvJpvJdM+yyrP5qY1vf6ZIhr2T7 >>>> root@brooklyn-gtb0-ubuntu-webclusterdatab-krt9-mysql-uk2g-7c7 >>>> -----END SSH HOST KEY KEYS----- >>>> >>>> >>>> >>>> >>>> On Jun 4, 2014, at 2:57 PM, Martin Harris < >> [email protected]> >>>> wrote: >>>> >>>>> Hi Alessio, >>>>> >>>>> Great to hear that you're considering Brooklyn for your research >> project >>>> - >>>>> I hope it works well for you! >>>>> >>>>> To configure brooklyn to use a specific key file, you can use the >>>>> privateKeyFile and publicKeyFile (note the removal of the 'login' >> prefix) >>>>> configuration keys as follows: >>>>> >>>>> ======================================================== >>>>> >>>>> brooklyn.location.named.OpenStack=XXXX >>>>> brooklyn.location.named.OpenStack.identity=XXXX >>>>> brooklyn.location.named.OpenStack.credential=XXXX >>>>> brooklyn.location.named.OpenStack.imageId=XXXX >>>>> >>>>> # m1.micro >>>>> brooklyn.location.named.OpenStack.hardwareId=myregion/000000960 >>>>> >>>>> # Security Configuration >>>>> brooklyn.location.named.OpenStack.loginUser=ubuntu >>>>> brooklyn.location.named.OpenStack.privateKeyFile=~/.ssh/brooklyn_rsa >>>>> brooklyn.location.named.OpenStack.publicKeyFile=~/.ssh/brooklyn_rsa.pub >>>>> >>>>> brooklyn.location.named.OpenStack.securityGroups=default >>>>> >>>>> >>>>> ======================================================== >>>>> >>>>> Cheers >>>>> >>>>> Martin Harris >>>>> >>>>> >>>>> On 4 June 2014 13:50, Alessio Gambi <[email protected]> >>>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> I am about to start a new research project that focuses on testing >>>> elastic >>>>>> cloud-based applications, and I am considering Brooklyn as Case Study. >>>>>> >>>>>> At the moment, I am trying to deploy the WebClusterDatabaseExample on >> a >>>>>> private OpenStack installation. However I am stuck with something that >>>>>> should be simple, but apparently it is not: setting a KeyPair for the >>>> VM. >>>>>> >>>>>> I configured the OpenStack location in the brooklyn.properities file >> as >>>>>> below, but I am probably missing something. >>>>>> Maybe you can help. >>>>>> >>>>>> >>>>>> The deployment goes smooth up to the point of launching the three VMs >>>>>> (loadbalancer, jboss and mysql), but it gets stuck there. >>>>>> The machines run but the Brooklyn manager cannot ssh to them. >>>>>> >>>>>> From the Web console of OpenStack I see that the machines have no >>>> KeyPair, >>>>>> but from the startup logs of the VMs I see that they received 2 public >>>> keys. >>>>>> (Of course, none of them match the one specified in the properties >> file) >>>>>> >>>>>> Many thanks >>>>>> >>>>>> — Alessio >>>>>> >>>>>> ======================================================== >>>>>> >>>>>> brooklyn.location.named.OpenStack=XXXX >>>>>> brooklyn.location.named.OpenStack.identity=XXXX >>>>>> brooklyn.location.named.OpenStack.credential=XXXX >>>>>> brooklyn.location.named.OpenStack.imageId=XXXX >>>>>> >>>>>> # m1.micro >>>>>> brooklyn.location.named.OpenStack.hardwareId=myregion/000000960 >>>>>> >>>>>> # Security Configuration >>>>>> brooklyn.location.named.OpenStack.loginUser=ubuntu >>>>>> >>>> >> brooklyn.location.named.OpenStack.loginPrivateKeyFile=~/.ssh/brooklyn_rsa >>>>>> >>>>>> >>>> >> brooklyn.location.named.OpenStack.loginPublicKeyFile=~/.ssh/brooklyn_rsa.pub >>>>>> >>>>>> brooklyn.location.named.OpenStack.securityGroups=default >>>>>> >>>> >> brooklyn.location.named.OpenStack.extraSshPublicKeyData=~/.ssh/id_rsa.pub >>>>>> >>>>>> >>>>>> ======================================================== >>>>>> >>>>>> >>>>>> >>>>>> Dr. Alessio Gambi, PhD >>>>>> Distributed Systems Group (DSG) >>>>>> Vienna University of Technology, Austria >>>>>> [email protected] >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Martin Harris >>>>> Lead Software Engineer >>>>> Cloudsoft Corporation Ltd >>>>> www.cloudsoftcorp.com >>>>> Mobile: +44 (0)7989 047-855 >>>> >>>> >>> >>> >>> -- >>> Martin Harris >>> Lead Software Engineer >>> Cloudsoft Corporation Ltd >>> www.cloudsoftcorp.com >>> Mobile: +44 (0)7989 047-855 >> >>
