Hi Ruben, So I've been trying to experiment a bit. I started over. Re-imported ttylinux into ceph datastore. Created new template and new vm and I logged in as oneadmin and defined the secret as instructed on all hosts.
In creating the new VM, the process failed as before. I tried as you suggested: [oneadmin@cloud2 54]$ virsh create -c qemu:///system deployment.0 error: unexpected data 'qemu:///system' But as you can see I got an error message I'm not sure what to do with. Also, I have a new log that looks different -- seems adding the port to the CEPH_HOST was the distinguishing factor. Tue Apr 8 19:30:04 2014 [DiM][I]: New VM state is ACTIVE. Tue Apr 8 19:30:04 2014 [LCM][I]: New VM state is PROLOG. Tue Apr 8 19:30:09 2014 [LCM][I]: New VM state is BOOT Tue Apr 8 19:30:10 2014 [VMM][I]: Generating deployment file: /var/lib/one/vms/54/deployment.0 Tue Apr 8 19:30:10 2014 [VMM][I]: ExitCode: 0 Tue Apr 8 19:30:10 2014 [VMM][I]: Successfully execute network driver operation: pre. Tue Apr 8 19:30:10 2014 [VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/125/54/deployment.0' 'cloud2' 54 cloud2 Tue Apr 8 19:30:10 2014 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/125/54/deployment.0 Tue Apr 8 19:30:10 2014 [VMM][I]: error: internal error process exited while connecting to monitor: qemu-kvm: -drive file=rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789,if=none,id=drive-ide0-0-0,format=raw,cache=none: error connecting Tue Apr 8 19:30:10 2014 [VMM][I]: qemu-kvm: -drive file=rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image rbd:one/one-28-54-0:auth_supported=none:mon_host=cloudweb12\:6789: Operation not supported Tue Apr 8 19:30:10 2014 [VMM][I]: Tue Apr 8 19:30:10 2014 [VMM][E]: Could not create domain from /var/lib/one//datastores/125/54/deployment.0 Tue Apr 8 19:30:10 2014 [VMM][I]: ExitCode: 255 Tue Apr 8 19:30:10 2014 [VMM][I]: Failed to execute virtualization driver operation: deploy. Tue Apr 8 19:30:10 2014 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/125/54/deployment.0 Tue Apr 8 19:30:10 2014 [DiM][I]: New VM state is FAILED And also here is deployment.0: <domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'> <name>one-54</name> <cputune> <shares>1024</shares> </cputune> <memory>524288</memory> <os> <type arch='x86_64'>hvm</type> <boot dev='hd'/> </os> <devices> <emulator>/usr/libexec/qemu-kvm</emulator> <disk type='network' device='disk'> <source protocol='rbd' name='one/one-28-54-0'> <host name='cloudweb12' port='6789'/> </source> <target dev='hda'/> <driver name='qemu' type='raw' cache='none'/> </disk> <disk type='file' device='cdrom'> <source file='/var/lib/one//datastores/125/54/disk.1'/> <target dev='hdb'/> <readonly/> <driver name='qemu' type='raw'/> </disk> <interface type='bridge'> <source bridge='br0'/> <mac address='02:00:26:6b:bb:98'/> </interface> <graphics type='vnc' listen='0.0.0.0' port='5954'/> </devices> <features> <acpi/> </features> </domain> Thank you! Steve On Tue, Apr 8, 2014 at 10:13 AM, Ruben S. Montero <rsmont...@opennebula.org>wrote: > Hi > > I've tested with the very same environment and it should work. Could you > try to define the secret with the oneadmin account and: > > -c qemu:///system > > option for virsh command. > > Also to manually test it, once the vm is in failed state go to the vm > directory in the host and simply execute: > > virsh create -c qemu:///system deployment.0 > > Cheers > > Ruben > On Apr 8, 2014 7:05 PM, "Steve @ MyEvolve" <st...@myevolve.com> wrote: > >> Hi Bill, >> >> I am using Centos 6.5 and CephX. I installed the following rpm versions >> from Ceph on the nodes and I also followed the procedure for authentication >> : >> >> rpm -Uvh >> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-0.12.1.2-2.415.el6.3ceph.x86_64.rpm >> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-img-0.12.1.2-2.415.el6.3ceph.x86_64.rpm >> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-guest-agent-0.12.1.2-2.415.el6.3ceph.x86_64.rpm >> http://ceph.com/packages/ceph-extras/rpm/centos6.4/x86_64/qemu-kvm-tools-0.12.1.2-2.415.el6.3ceph.x86_64.rpm >> >> >> CephX >> >> virsh secret-define --file secret.xml; virsh secret-set-value --secret >> 34afabcd-8ee0-45fd-a880-09df24fef603 --base64 $(cat client.libvirt.key) >> >> >> Also, Ruben -- how do I: >> >> "1.- could you try manually to add port to the <source attribute, and >> check if the VM boots with virsh create" >> >> >> Thank you, >> >> Steve >> >> >> >> >> >> On Tue, Apr 8, 2014 at 6:20 AM, Campbell, Bill < >> bcampb...@axcess-financial.com> wrote: >> >>> Are you using CentOS/RHEL? Are you using CephX Authentication? >>> >>> >>> >>> There have been a few changes in how Libvirt handles the configurations >>> of Ceph images, and I'm not sure if that version of Qemu is compiled with >>> RBD support. >>> >>> >>> >>> *From:* users-boun...@lists.opennebula.org [mailto: >>> users-boun...@lists.opennebula.org] *On Behalf Of *Ruben S. Montero >>> *Sent:* Tuesday, April 08, 2014 6:00 AM >>> *To:* Steve @ MyEvolve >>> *Cc:* users@lists.opennebula.org >>> *Subject:* Re: [one-users] Images from Images (Ceph) Datastore Not >>> Deploying >>> >>> >>> >>> Well >>> >>> >>> >>> The deployment file seems to be properly generated, so given the error >>> message complaining about the missing port: >>> >>> >>> >>> 1.- could you try manually to add port to the <source attribute, and >>> check if the VM boots with virsh create >>> >>> >>> >>> 2.- I've not seen this required by ceph, here it is working with the >>> libvirt packages from the ceph guys (libvirt 0.10.2 and qemu-kvm-0.12.1), >>> Could it be a version problem? >>> >>> >>> >>> Cheers >>> >>> >>> >>> >>> >>> >>> >>> On Tue, Apr 8, 2014 at 11:09 AM, Steve @ MyEvolve <st...@myevolve.com> >>> wrote: >>> >>> Hi Ruben, >>> >>> >>> >>> Contents of /var/lib/one//datastores/125/32/deployment.0 >>> >>> >>> >>> <domain type='kvm' xmlns:qemu=' >>> http://libvirt.org/schemas/domain/qemu/1.0'> >>> >>> <name>one-32</name> >>> >>> <cputune> >>> >>> <shares>1024</shares> >>> >>> </cputune> >>> >>> <memory>524288</memory> >>> >>> <os> >>> >>> <type arch='x86_64'>hvm</type> >>> >>> <boot dev='hd'/> >>> >>> </os> >>> >>> <devices> >>> >>> <emulator>/usr/libexec/qemu-kvm</emulator> >>> >>> <disk type='network' device='disk'> >>> >>> <source protocol='rbd' name='one/one-18-32-0'> >>> >>> <host name='cloudweb12' port='6789'/> >>> >>> <host name='cloudweb13' port='6789'/> >>> >>> <host name='cloudweb14' port='6789'/> >>> >>> </source> >>> >>> <target dev='hda'/> >>> >>> <driver name='qemu' type='raw' cache='none'/> >>> >>> </disk> >>> >>> <disk type='file' device='cdrom'> >>> >>> <source >>> file='/var/lib/one//datastores/125/32/disk.1'/> >>> >>> <target dev='hdb'/> >>> >>> <readonly/> >>> >>> <driver name='qemu' type='raw'/> >>> >>> </disk> >>> >>> <interface type='bridge'> >>> >>> <source bridge='br0'/> >>> >>> <mac address='02:00:26:6b:bb:96'/> >>> >>> </interface> >>> >>> <graphics type='vnc' listen='0.0.0.0' port='5947'/> >>> >>> </devices> >>> >>> <features> >>> >>> <acpi/> >>> >>> </features> >>> >>> </domain> >>> >>> >>> >>> >>> >>> Ceph Datastore: >>> >>> CEPH_HOST = cloudweb12:6789 cloudweb13:6789 cloudweb14:6789 >>> >>> >>> >>> >>> >>> Thanks, >>> >>> Steve >>> >>> >>> >>> On Tue, Apr 8, 2014 at 1:18 AM, Ruben S. Montero < >>> rsmont...@opennebula.org> wrote: >>> >>> Hi >>> >>> >>> >>> Could you send /var/lib/one//datastores/125/32/deployment.0? Also could >>> you double check you ceph datastore configuration, specially the CEPH_HOST >>> attribute to read something like >>> >>> >>> >>> CEPH_HOST="cephmon1:6789 cephmon2:6789" >>> >>> >>> >>> Cheers >>> >>> >>> >>> Ruben >>> >>> >>> >>> On Mon, Apr 7, 2014 at 2:02 AM, Steve @ MyEvolve <st...@myevolve.com> >>> wrote: >>> >>> Hi, >>> >>> >>> >>> I've added successfully images from the marketplace to the default image >>> datastore and deployed without any issues. >>> >>> >>> >>> I've continued to add a Ceph datastore and retrieved an image from >>> marketplace to it successfully as well. >>> >>> >>> >>> However, when I try to deploy this same image, I get the following >>> failures: >>> >>> >>> >>> Sun Apr 6 16:01:41 2014 [DiM][I]: New VM state is ACTIVE. >>> >>> Sun Apr 6 16:01:41 2014 [LCM][I]: New VM state is PROLOG. >>> >>> Sun Apr 6 16:01:43 2014 [LCM][I]: New VM state is BOOT >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: Generating deployment file: >>> /var/lib/one/vms/32/deployment.0 >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 0 >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: Successfully execute network driver >>> operation: pre. >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: Command execution fail: cat << EOT | >>> /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/125/32/deployment.0' >>> 'cloud4' 32 cloud4 >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: error: Failed to create domain from >>> /var/lib/one//datastores/125/32/deployment.0 >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: error: XML error: missing port for >>> host >>> >>> Sun Apr 6 16:01:43 2014 [VMM][E]: Could not create domain from >>> /var/lib/one//datastores/125/32/deployment.0 >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: ExitCode: 255 >>> >>> Sun Apr 6 16:01:43 2014 [VMM][I]: Failed to execute virtualization >>> driver operation: deploy. >>> >>> Sun Apr 6 16:01:43 2014 [VMM][E]: Error deploying virtual machine: >>> Could not create domain from /var/lib/one//datastores/125/32/deployment.0 >>> >>> Sun Apr 6 16:01:43 2014 [DiM][I]: New VM state is FAILED >>> >>> >>> >>> Any suggestions/help would be greatly appreciated! >>> >>> >>> >>> Thank you, >>> >>> Steve >>> >>> >>> >>> >>> >>> _______________________________________________ >>> Users mailing list >>> Users@lists.opennebula.org >>> http://lists.opennebula.org/listinfo.cgi/users-opennebula.org >>> >>> >>> >>> >>> >>> -- >>> >>> -- >>> >>> Ruben S. Montero, PhD >>> Project co-Lead and Chief Architect >>> >>> OpenNebula - Flexible Enterprise Cloud Made Simple >>> www.OpenNebula.org | rsmont...@opennebula.org | @OpenNebula >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> -- >>> >>> Ruben S. Montero, PhD >>> Project co-Lead and Chief Architect >>> >>> OpenNebula - Flexible Enterprise Cloud Made Simple >>> www.OpenNebula.org | rsmont...@opennebula.org | @OpenNebula >>> >>> *NOTICE: Protect the information in this message in accordance with the >>> company's security policies. If you received this message in error, >>> immediately notify the sender and destroy all copies.* >>> >>> >>
_______________________________________________ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org