Re: Windows capture fails
Hello Michael,
Which version are you using? VCL 2.2.1 or the pre-release of 2.3? The
execute subroutine is not implemented is concerning.
Thanks,
Aaron
On Tue, Jun 19, 2012 at 7:53 PM, Michael Jinks mji...@uchicago.edu wrote:
Hi List. As threatened, here's the tale of our attempt to capture our
first Windows image. As with our Linux capture, it appears that the VM
disk image is being copied into our Data and Repository paths, but
something goes wrong later in the process, but the warnings we find in
the log are different for our Windows image than for the Linux one.
As before, I'll paste the full log from the PROBLEM mail below, but it
looks like this is significant:
|19609|20:20|image| WARNING
|19609|20:20|image| 2012-06-19
14:36:58|19609|20:20|image|VIM_SSH.pm:initialize(112)|required VM host OS
subroutine is not implemented: execute
|19609|20:20|image| ( 0) VIM_SSH.pm, initialize (line: 112)
|19609|20:20|image| (-1) Module.pm, new (line: 207)
|19609|20:20|image| (-2) VMware.pm, (eval) (line: 1303)
|19609|20:20|image| (-3) VMware.pm, get_vmhost_api_object (line: 1303)
|19609|20:20|image| (-4) VMware.pm, initialize (line: 278)
|19609|20:20|image| (-5) Module.pm, new (line: 207)
2012-06-19
14:36:58|19609|20:20|image|VMware.pm:get_vmhost_api_object(1313)|API object
could not be created: VCL::Module::Provisioning::VMware::VIM_SSH
This looks to me like there must be something missing, maybe within the
Windows VM itself? Did we leave out a package somewhere?
Thanks,
-m
--
Michael Jinks :: mji...@uchicago.edu
University of Chicago IT Services
Complete log message follows:
VCL::image object could not be created and initialized
time: 2012-06-19 14:36:58
caller: vcld:make_new_child(571)
( 0) vcld, make_new_child (line: 571)
(-1) vcld, main (line: 346)
management node: pilot-lab.uchicago.edu
reservation PID: 19609
parent vcld PID: 2491
request ID: 20
reservation ID: 20
request state/laststate: image/image
request start time: 2012-06-19 14:36:50
request end time: 2012-06-19 15:36:50
for imaging: no
log ID: none
computer: vcl-win7-test
computer id: 8
computer type: virtualmachine
computer eth0 MAC address: undefined
computer eth1 MAC address: undefined
computer private IP address: 10.50.84.16
computer public IP address: 10.50.84.16
computer in block allocation: no
provisioning module: VCL::Module::Provisioning::VMware::VMware
vm host: undefined
vm host ID: undefined
vm host computer ID: undefined
vm profile: undefined
vm profile VM path: undefined
vm profile repository path: undefined
vm profile datastore path: undefined
vm profile disk type: undefined
image: vmwarewin7-win7vmimage27-v0
image display name: win7-vm-image
image ID: 27
image revision ID: 23
image size: 1450 MB
use Sysprep: no
root access: yes
image owner ID: 1
image owner affiliation: Local
image revision date created: 2012-06-19 14:36:50
image revision production: yes
OS module: VCL::Module::OS::Windows::Version_6::7
user: admin
user name: vcl admin
user ID: 1
user affiliation: Local
RECENT LOG ENTRIES FOR THIS PROCESS:
|19609|20:20|image| (-1) Autoload.pm, __ANON__ (line: 80)
|19609|20:20|image| (-2) VMware.pm, get_vmhost_datastructure (line: 1161)
|19609|20:20|image| (-3) VMware.pm, get_vmhost_api_object (line: 1282)
|19609|20:20|image| (-4) VMware.pm, initialize (line: 278)
|19609|20:20|image| (-5) Module.pm, new (line: 207)
|19609|20:20|image| WARNING
|19609|20:20|image| 2012-06-19
14:36:58|19609|20:20|image|DataStructure.pm:_automethod(812)|corresponding
data has not been initialized for get_vmhost_profile_image_id:
$self-request_data-{reservation}{20}{computer}{vmhost}{vmprofile}{imageid}
|19609|20:20|image| ( 0) DataStructure.pm, _automethod (line: 812)
|19609|20:20|image| (-1) Autoload.pm, __ANON__ (line: 80)
|19609|20:20|image| (-2) VMware.pm, get_vmhost_datastructure (line: 1162)
|19609|20:20|image| (-3) VMware.pm, get_vmhost_api_object (line: 1282)
|19609|20:20|image| (-4) VMware.pm, initialize (line: 278)
|19609|20:20|image| (-5) Module.pm, new (line: 207)
2012-06-19
14:36:58|19609|20:20|image|VMware.pm:get_vmhost_datastructure(1190)|created
DataStructure object for VM host: vcl-win7-test
2012-06-19
14:36:58|19609|20:20|image|VMware.pm:get_vmhost_api_object(1293)|attempting
to load VMware control module: VCL::Module::Provisioning::VMware::VIM_SSH
2012-06-19
14:36:58|19609|20:20|image|VMware.pm:get_vmhost_api_object(1299)|loaded
VMware control module: VCL::Module::Provisioning::VMware::VIM_SSH
2012-06-19 14:36:58|19609|20:20|image|Module.pm:new(172)|set 'vmhost_data'
key for VCL::Module::Provisioning::VMware::VIM_SSH object from arguments
2012-06-19
Re: VCL image capture dies, failed to prepare vmx file
I've run into issues adding new machines that have MAC addresses matching deleted machines in 2.2.1. On Wed, Jun 20, 2012 at 11:10 AM, Aaron Peeler fapee...@ncsu.edu wrote: I agree with Aaron C. and Mike. Another method, you could mark them as deleted in the VCL web interface and add new ones. To delete them you would need to remove them from the virtual hosts and edit the hostname so you can reuse it. Aaron P. On Wed, Jun 20, 2012 at 11:04 AM, Aaron Coburn acob...@amherst.edu wrote: Michael, It isn't necessary to delete the rows from 'vcl.computer'. In order to edit the MAC addresses, you only need to update the 'eth0macaddress' and 'eth1macaddress' fields in the existing records. I wouldn't recommend it, but if you really need to delete the records from the computer table, there should be no issue as long as the vcl.reservation table is empty. Aaron -- Aaron Coburn Systems Administrator and Programmer Academic Technology Services, Amherst College acob...@amherst.edu On Jun 20, 2012, at 10:47 AM, Michael Jinks wrote: Okay. If I go to SQL-land and delete the record for that host from the 'computers' table, will that be enough to remove it from the system or are there other areas of the DB I need to clean out as well? (Sorry if that's a dumb question, but I've found other areas where just removing a record doesn't remove all traces of the record, like the list of virtual machines assigned to a hypervisor, so I figured I should check before I start deleting things.) Thanks all. -m On Wed, Jun 20, 2012 at 10:16:04AM -0400, Josh Thompson wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Michael, Unfortunately, yes, in 2.2.1, you can only set MAC addresses via the add multiple computers page. You'll need to set them in the database. This is fixed in 2.3. Josh On Wednesday, June 20, 2012 9:12:52 AM Michael Jinks wrote: Thanks Aaron. Ah, yes. It didn't occur to me that we'd have to have MAC addresses defined for a machine we're capturing *from*. I figured, well, it's running and has IP addresses... At any rate, I'm looking around the UI and I can't find any page that will let me enter a MAC address for an existing computer record. Is this something I have to do by hand in the database? On Wed, Jun 20, 2012 at 08:46:40AM -0400, Aaron Peeler wrote: Hello Michael, One thing that stands out in the log is that your MAC addresses are not defined. computer eth0 MAC address: undefined computer eth1 MAC address: undefined This will be needed to correctly create the vmx file and thus get an address from the private dhcp server that is should be running on your management node. Secondly also make sure you have the dhcp server setup on your management node for the private network. Aaron On Tue, Jun 19, 2012 at 5:53 PM, Michael Jinks mji...@uchicago.edu wrote: Hi, all. Trying to resurrect a thread I started on Friday, subject 'Image capture succeeds, then fails'. ?Mike Haudenschild helped me narrow down the problem but so far I haven't been able to find a cause or a fix. I'm trying to capture my first Linux VM. ?Things go along okay through the capture stage, but (thanks Mike) we fail when VCL tries to reserve and deploy the new image. The critical message from the log appears to be: ?|17491|19:19|reload| WARNING ?|17491|19:19|reload| 2012-06-19 ?14:10:22|17491|19:19|reload|VMware.pm:load(395)|failed to prepare vmx file for vcl-linux-template-2-bak on VM host: vcl0001 ?|17491|19:19|reload| ( 0) VMware.pm, load (line: 395) ?|17491|19:19|reload| (-1) new.pm, reload_image (line: 618) ?|17491|19:19|reload| (-2) new.pm, process (line: 248) ?|17491|19:19|reload| (-3) vcld, make_new_child (line: 568) ?|17491|19:19|reload| (-4) vcld, main (line: 346) Further down, I'll paste in a complete copy of the log mail I got from this attempt. Our VM storage settings for this VM host are: ?Repository Path: ? ? ? /vmfs/volumes/nfs-vcl-templates ?Data Store Path: ? ? ? /vmfs/volumes/T2_6045_dev_VCL_ds01 ?VM Path: ? ? ? /vmfs/volumes/T2_6045_dev_VCL_ds01 (Note Data Store and VM are explicitly the same; we've also had VM Path set to (empty) with no apparent difference in behavior.) Both of those paths are writable on the hypervisor. ?During capture, a VM directory appears in both locations. ?In the directory under the Repository path, we have many vmdk files, sizes ranging from 842M to 1.5k, with names like: ?vmwarelinux-linuxtemplate2v1226-v0-s001.vmdk ?vmwarelinux-linuxtemplate2v1226-v0-s002.vmdk ?vmwarelinux-linuxtemplate2v1226-v0-s003.vmdk ?[...] ?vmwarelinux-linuxtemplate2v1226-v0-s016.vmdk ?vmwarelinux-linuxtemplate2v1226-v0.vmdk
Re: VCL image capture dies, failed to prepare vmx file
ok. Then best bet is to update the computer records for the missing mac addresses. I typically use phpmyadmin or cmdline. I'm not sure what other tools are available for editing mysql db's. An issue with just deleting the computer record, is that there is also a record in the resource table that is used to reference the computer.id. This resource.id is used for computer groups and some other things. If deleting only the computer record, then it would cause other queries to fail. Aaron On Wed, Jun 20, 2012 at 11:16 AM, Mike Haudenschild m...@longsight.com wrote: I've run into issues adding new machines that have MAC addresses matching deleted machines in 2.2.1. On Wed, Jun 20, 2012 at 11:10 AM, Aaron Peeler fapee...@ncsu.edu wrote: I agree with Aaron C. and Mike. Another method, you could mark them as deleted in the VCL web interface and add new ones. To delete them you would need to remove them from the virtual hosts and edit the hostname so you can reuse it. Aaron P. On Wed, Jun 20, 2012 at 11:04 AM, Aaron Coburn acob...@amherst.edu wrote: Michael, It isn't necessary to delete the rows from 'vcl.computer'. In order to edit the MAC addresses, you only need to update the 'eth0macaddress' and 'eth1macaddress' fields in the existing records. I wouldn't recommend it, but if you really need to delete the records from the computer table, there should be no issue as long as the vcl.reservation table is empty. Aaron -- Aaron Coburn Systems Administrator and Programmer Academic Technology Services, Amherst College acob...@amherst.edu On Jun 20, 2012, at 10:47 AM, Michael Jinks wrote: Okay. If I go to SQL-land and delete the record for that host from the 'computers' table, will that be enough to remove it from the system or are there other areas of the DB I need to clean out as well? (Sorry if that's a dumb question, but I've found other areas where just removing a record doesn't remove all traces of the record, like the list of virtual machines assigned to a hypervisor, so I figured I should check before I start deleting things.) Thanks all. -m On Wed, Jun 20, 2012 at 10:16:04AM -0400, Josh Thompson wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Michael, Unfortunately, yes, in 2.2.1, you can only set MAC addresses via the add multiple computers page. You'll need to set them in the database. This is fixed in 2.3. Josh On Wednesday, June 20, 2012 9:12:52 AM Michael Jinks wrote: Thanks Aaron. Ah, yes. It didn't occur to me that we'd have to have MAC addresses defined for a machine we're capturing *from*. I figured, well, it's running and has IP addresses... At any rate, I'm looking around the UI and I can't find any page that will let me enter a MAC address for an existing computer record. Is this something I have to do by hand in the database? On Wed, Jun 20, 2012 at 08:46:40AM -0400, Aaron Peeler wrote: Hello Michael, One thing that stands out in the log is that your MAC addresses are not defined. computer eth0 MAC address: undefined computer eth1 MAC address: undefined This will be needed to correctly create the vmx file and thus get an address from the private dhcp server that is should be running on your management node. Secondly also make sure you have the dhcp server setup on your management node for the private network. Aaron On Tue, Jun 19, 2012 at 5:53 PM, Michael Jinks mji...@uchicago.edu wrote: Hi, all. Trying to resurrect a thread I started on Friday, subject 'Image capture succeeds, then fails'. ?Mike Haudenschild helped me narrow down the problem but so far I haven't been able to find a cause or a fix. I'm trying to capture my first Linux VM. ?Things go along okay through the capture stage, but (thanks Mike) we fail when VCL tries to reserve and deploy the new image. The critical message from the log appears to be: ?|17491|19:19|reload| WARNING ?|17491|19:19|reload| 2012-06-19 ?14:10:22|17491|19:19|reload|VMware.pm:load(395)|failed to prepare vmx file for vcl-linux-template-2-bak on VM host: vcl0001 ?|17491|19:19|reload| ( 0) VMware.pm, load (line: 395) ?|17491|19:19|reload| (-1) new.pm, reload_image (line: 618) ?|17491|19:19|reload| (-2) new.pm, process (line: 248) ?|17491|19:19|reload| (-3) vcld, make_new_child (line: 568) ?|17491|19:19|reload| (-4) vcld, main (line: 346) Further down, I'll paste in a complete copy of the log mail I got from this attempt. Our VM storage settings for this VM host are: ?Repository Path: ? ? ? /vmfs/volumes/nfs-vcl-templates ?Data Store Path: ? ? ? /vmfs/volumes/T2_6045_dev_VCL_ds01 ?VM Path: ? ? ? /vmfs/volumes/T2_6045_dev_VCL_ds01 (Note Data Store and VM are explicitly the same; we've also
Re: libvirt/KVM
Andy I did 'svn up' and ran install_perl_libs.pl as well. While trying to make reservation still getting an error. Attached is reservation log. I'll try to trace the error, if you see something what causes it, please let me know. I'll try to capture image with new code little later today and will let you know if it fails. Thanks. --- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 10:38 , Andy Kurth wrote: There were some definite bugs which I hopefully corrected with the commit from this morning. Be sure to use the latest code from trunk. Also, you'll need to run install_perl_libs.pl (http://install_perl_libs.pl) again. Regarding KVM installation/configuration, I have mainly been working off of Fedora 16. The version of KVM included with Fedora 16 seems more stable than Red Hat or CentOS 6.x. The code should work under these OS's but automatic conversion of existing ESXi images to KVM-compatible qcow2 images probably won't work. The version of qemu-img included with Fedora 16 is able to do the conversion correctly. The versions included with Red Had and CentOS do not. Regarding image conversion, you should be able load an existing vmdk ESXi image on KVM if the image resides in the repository path. The code should copy it to the datastore in the format specified for the image type in the VM profile for your KVM host. Be sure to set this to qcow2. I fixed some bugs which caused base image creation to fail in the commit this morning. Please try this out. I started the following page which describes which components to install and how to configure networking and storage: https://cwiki.apache.org/confluence/display/VCL/KVM+Configuration -Andy On Tue, Jun 19, 2012 at 5:02 PM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Hi Has anyone tried Libvirt in 2.3 RC3? I've updated VCL 2.2.1 to VCL 2.3 and cannot get Libvirt working. I've made some adjustments and able to successfully capture an image, but cannot make reservation based on the image. I'm using CentOS 6.2 with KVM as VM host (yum groupinstall Virtualization 'Virtualization Client' 'Virtualization Platform' 'Virtualization Tools'). If Libvirt is working for you, could you please share your configuration (ie. VM host version and packages, VCL computer configuration, etc) ? -- Thank you, Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 Untitled.txt Description: Binary data
Re: libvirt/KVM
For some reason the OS module for the image being loaded is showing as VCL::Module::Provisioning::libvirt. Check which module centos5image-kvmlinuxv4105-v0 is configured to use in the database: image.OSid -- OS.moduleid -- module.perlpackagepath -Andy On Wed, Jun 20, 2012 at 11:24 AM, Dmitri Chebotarov dcheb...@gmu.edu wrote: Andy I did 'svn up' and ran install_perl_libs.pl as well. While trying to make reservation still getting an error. Attached is reservation log. I'll try to trace the error, if you see something what causes it, please let me know. I'll try to capture image with new code little later today and will let you know if it fails. Thanks. --- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 10:38 , Andy Kurth wrote: There were some definite bugs which I hopefully corrected with the commit from this morning. Be sure to use the latest code from trunk. Also, you'll need to run install_perl_libs.pl (http://install_perl_libs.pl) again. Regarding KVM installation/configuration, I have mainly been working off of Fedora 16. The version of KVM included with Fedora 16 seems more stable than Red Hat or CentOS 6.x. The code should work under these OS's but automatic conversion of existing ESXi images to KVM-compatible qcow2 images probably won't work. The version of qemu-img included with Fedora 16 is able to do the conversion correctly. The versions included with Red Had and CentOS do not. Regarding image conversion, you should be able load an existing vmdk ESXi image on KVM if the image resides in the repository path. The code should copy it to the datastore in the format specified for the image type in the VM profile for your KVM host. Be sure to set this to qcow2. I fixed some bugs which caused base image creation to fail in the commit this morning. Please try this out. I started the following page which describes which components to install and how to configure networking and storage: https://cwiki.apache.org/confluence/display/VCL/KVM+Configuration -Andy On Tue, Jun 19, 2012 at 5:02 PM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Hi Has anyone tried Libvirt in 2.3 RC3? I've updated VCL 2.2.1 to VCL 2.3 and cannot get Libvirt working. I've made some adjustments and able to successfully capture an image, but cannot make reservation based on the image. I'm using CentOS 6.2 with KVM as VM host (yum groupinstall Virtualization 'Virtualization Client' 'Virtualization Platform' 'Virtualization Tools'). If Libvirt is working for you, could you please share your configuration (ie. VM host version and packages, VCL computer configuration, etc) ? -- Thank you, Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404
[ANNOUNCE] Happy Graduation!
All, The ASF Board has approved the resolution to establish Apache VCL as a top-level ASF project. Congratulations to all! --kevan
Re: [ANNOUNCE] Happy Graduation!
This is HUGE! Well done. On Wed, Jun 20, 2012 at 2:04 PM, Kevan Miller kevan.mil...@gmail.com wrote: All, The ASF Board has approved the resolution to establish Apache VCL as a top-level ASF project. Congratulations to all! --kevan -- Cameron Seay, Ph.D. Department of Computer Systems Technology School of Technology NC A T State University Greensboro, NC 336 334 7717 x2251
Re: [ANNOUNCE] Happy Graduation!
Yay! Thanks to all in the VCL community for helping make this happen, and special thanks to our mentors for leading us through this process! Josh On Jun 20, 2012 2:05 PM, Kevan Miller kevan.mil...@gmail.com wrote: All, The ASF Board has approved the resolution to establish Apache VCL as a top-level ASF project. Congratulations to all! --kevan
Re: [ANNOUNCE] Happy Graduation!
Congratulations!!!, All of you made it. Young Hyun Oh IBM Tivoli CTO Technology and Architecture From: Cameron Seay cws...@gmail.com To: vcl-user@incubator.apache.org, Cc: vcl-...@incubator.apache.org Date: 06/20/2012 02:36 PM Subject:Re: [ANNOUNCE] Happy Graduation! This is HUGE! Well done. On Wed, Jun 20, 2012 at 2:04 PM, Kevan Miller kevan.mil...@gmail.com wrote: All, The ASF Board has approved the resolution to establish Apache VCL as a top-level ASF project. Congratulations to all! --kevan -- Cameron Seay, Ph.D. Department of Computer Systems Technology School of Technology NC A T State University Greensboro, NC 336 334 7717 x2251 inline: graycol.gif
Re: libvirt/KVM
I think I'm missing something here. I fail to understand how KVM-based image is linked to libvirt.pm/KVM.pm modules in this case (and if it should). Once I set image.osid to 36, (36 is os.id for vmwarelinux, module 5 - VCL::Module::OS::Linux), vcld is trying to load KVM-based image to a computer with Provisioning Engine set to VMware and using a VMware host. It fails. In this case (image.OSid = 36) there is no link between KVM image and libvirt computers/KVM hosts. Thanks. --- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 13:06 , Andy Kurth wrote: image.OSid should be set to the id that corresponds to vmwarelinux. OS.moduleid should point to the os_linux module table entry, which has module.perlpackagepath = VCL::Module::OS::Linux. -Andy On Wed, Jun 20, 2012 at 12:30 PM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Andy It's pointing to VCL::Module::Provisioning::libvirt This is a result of my earlier attempt to troubleshoot the issue. I've added new OSid, moduleid. The original image.osid was 29, which is CentOS Bare Metal, processed by VCL::Module::OS::Linux. With image.osid set to 29 VCL was trying to use xCAT module to process KVM reservations. At this moment I don't have any xCAT (bare metal) computers available and once I select the [KVM] image for reservation I get popup asking to select available time for reservation, which means that I don't have available resources to support this reservation. When I've added new OSid and moduleid (pointing to VCL::Module::Provisioning::libvirt), I'm able to start reservation, VCLd finds available computers (which are configured to use libvirt engine) and attempts to make reservation on correct KVM host, but fails with error attached in previous email. What should image.osid, moduleid be set to? -- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 11:52 , Andy Kurth wrote: For some reason the OS module for the image being loaded is showing as VCL::Module::Provisioning::libvirt. Check which module centos5image-kvmlinuxv4105-v0 is configured to use in the database: image.OSid -- OS.moduleid -- module.perlpackagepath -Andy On Wed, Jun 20, 2012 at 11:24 AM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Andy I did 'svn up' and ran install_perl_libs.pl (http://install_perl_libs.pl (http://_perl_libs.pl)) as well. While trying to make reservation still getting an error. Attached is reservation log. I'll try to trace the error, if you see something what causes it, please let me know. I'll try to capture image with new code little later today and will let you know if it fails. Thanks. --- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 10:38 , Andy Kurth wrote: There were some definite bugs which I hopefully corrected with the commit from this morning. Be sure to use the latest code from trunk. Also, you'll need to run install_perl_libs.pl (http://install_perl_libs.pl (http://_perl_libs.pl) (http://_perl_libs.pl)) again. Regarding KVM installation/configuration, I have mainly been working off of Fedora 16. The version of KVM included with Fedora 16 seems more stable than Red Hat or CentOS 6.x. The code should work under these OS's but automatic conversion of existing ESXi images to KVM-compatible qcow2 images probably won't work. The version of qemu-img included with Fedora 16 is able to do the conversion correctly. The versions included with Red Had and CentOS do not. Regarding image conversion, you should be able load an existing vmdk ESXi image on KVM if the image resides in the repository path. The code should copy it to the datastore in the format specified for the image type in the VM profile for your KVM host. Be sure to set this to qcow2. I fixed some bugs which caused base image creation to fail in the commit this morning. Please try this out. I started the following page which describes which components to install and how to configure networking and storage: https://cwiki.apache.org/confluence/display/VCL/KVM+Configuration -Andy On Tue, Jun 19, 2012 at 5:02 PM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Hi Has anyone tried Libvirt
Re: libvirt/KVM
I'm confused about what you're trying to load. Is centos5image-kvmlinuxv4105-v0 a bare metal image? The reservation info you sent earlier had this image being loaded on the virtual machine sandbox-vcl-19. Assuming you have a Linux VM image, its OSid should be set to vmwarelinux, which should be pointing to VCL::Module::OS::Linux. The computer.provisioningid value of the VM should be set the libvirt entry in the provisioning table, which should be pointing to VCL::Module::Provisioning::libvirt. -Andy On Wed, Jun 20, 2012 at 2:57 PM, Dmitri Chebotarov dcheb...@gmu.edu wrote: I think I'm missing something here. I fail to understand how KVM-based image is linked to libvirt.pm/KVM.pm modules in this case (and if it should). Once I set image.osid to 36, (36 is os.id for vmwarelinux, module 5 - VCL::Module::OS::Linux), vcld is trying to load KVM-based image to a computer with Provisioning Engine set to VMware and using a VMware host. It fails. In this case (image.OSid = 36) there is no link between KVM image and libvirt computers/KVM hosts. Thanks. --- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 13:06 , Andy Kurth wrote: image.OSid should be set to the id that corresponds to vmwarelinux. OS.moduleid should point to the os_linux module table entry, which has module.perlpackagepath = VCL::Module::OS::Linux. -Andy On Wed, Jun 20, 2012 at 12:30 PM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Andy It's pointing to VCL::Module::Provisioning::libvirt This is a result of my earlier attempt to troubleshoot the issue. I've added new OSid, moduleid. The original image.osid was 29, which is CentOS Bare Metal, processed by VCL::Module::OS::Linux. With image.osid set to 29 VCL was trying to use xCAT module to process KVM reservations. At this moment I don't have any xCAT (bare metal) computers available and once I select the [KVM] image for reservation I get popup asking to select available time for reservation, which means that I don't have available resources to support this reservation. When I've added new OSid and moduleid (pointing to VCL::Module::Provisioning::libvirt), I'm able to start reservation, VCLd finds available computers (which are configured to use libvirt engine) and attempts to make reservation on correct KVM host, but fails with error attached in previous email. What should image.osid, moduleid be set to? -- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 11:52 , Andy Kurth wrote: For some reason the OS module for the image being loaded is showing as VCL::Module::Provisioning::libvirt. Check which module centos5image-kvmlinuxv4105-v0 is configured to use in the database: image.OSid -- OS.moduleid -- module.perlpackagepath -Andy On Wed, Jun 20, 2012 at 11:24 AM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Andy I did 'svn up' and ran install_perl_libs.pl (http://install_perl_libs.pl (http://_perl_libs.pl)) as well. While trying to make reservation still getting an error. Attached is reservation log. I'll try to trace the error, if you see something what causes it, please let me know. I'll try to capture image with new code little later today and will let you know if it fails. Thanks. --- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 10:38 , Andy Kurth wrote: There were some definite bugs which I hopefully corrected with the commit from this morning. Be sure to use the latest code from trunk. Also, you'll need to run install_perl_libs.pl (http://install_perl_libs.pl (http://_perl_libs.pl) (http://_perl_libs.pl)) again. Regarding KVM installation/configuration, I have mainly been working off of Fedora 16. The version of KVM included with Fedora 16 seems more stable than Red Hat or CentOS 6.x. The code should work under these OS's but automatic conversion of existing ESXi images to KVM-compatible qcow2 images probably won't work. The version of qemu-img included with Fedora 16 is able to do the conversion correctly. The versions included with Red Had and CentOS do not. Regarding image conversion, you should be able load an existing vmdk ESXi image on KVM if the image resides in the repository path. The code should copy it to the datastore in the format specified for the image type in
Re: [ANNOUNCE] Happy Graduation!
Very nice, gratz ... Kevan, thanks to you for goat herding all of the things I can't remember :) On Jun 20, 2012, at 2:04 PM, Kevan Miller wrote: All, The ASF Board has approved the resolution to establish Apache VCL as a top-level ASF project. Congratulations to all! --kevan signature.asc Description: Message signed with OpenPGP using GPGMail
Re: [ANNOUNCE] Happy Graduation!
Great news! Congratulations! -Kelly On 6/20/12 2:04 PM, Kevan Miller kevan.mil...@gmail.com wrote: All, The ASF Board has approved the resolution to establish Apache VCL as a top-level ASF project. Congratulations to all! --kevan
RE: [ANNOUNCE] Happy Graduation!
Congratulations for a job well done!!! Donna M. Grant, Ph.D. Assistant Professor North Carolina Central University School of Business, Computer Information Systems C.T. Willis Commerce Building, Room 103 (919) 530-7373 (telephone) From: Kevan Miller [kevan.mil...@gmail.com] Sent: Wednesday, June 20, 2012 2:04 PM To: vcl-...@incubator.apache.org; vcl-user@incubator.apache.org Subject: [ANNOUNCE] Happy Graduation! All, The ASF Board has approved the resolution to establish Apache VCL as a top-level ASF project. Congratulations to all! --kevan __ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com __ __ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com __
Re: libvirt/KVM
Andy Success! Thank you for your help. Correct, I'm working with KVM-based Linux image. I was able to make it work with a slight changes. Do you have any entries in vcl.OS table with installtype='libvirt'? The only way I'm able to make reservations is by adding new entry into vcl.OS table and then setting image.osid to the id of the new entry (49 in my case): This is the entry I've added: select * from OS where installtype='libvirt'; ++--+--+---+-+---+--+ | id | name | prettyname | type | installtype | sourcepath | moduleid | ++--+--+---+-+---+--+ | 49 | libvirtlinux | CentOS 5/6 (libvirt) | linux | libvirt | vmware_images | 5 | ++--+--+---+-+---+--+ Thanks. -- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 15:43 , Andy Kurth wrote: I'm confused about what you're trying to load. Is centos5image-kvmlinuxv4105-v0 a bare metal image? The reservation info you sent earlier had this image being loaded on the virtual machine sandbox-vcl-19. Assuming you have a Linux VM image, its OSid should be set to vmwarelinux, which should be pointing to VCL::Module::OS::Linux. The computer.provisioningid value of the VM should be set the libvirt entry in the provisioning table, which should be pointing to VCL::Module::Provisioning::libvirt. -Andy On Wed, Jun 20, 2012 at 2:57 PM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: I think I'm missing something here. I fail to understand how KVM-based image is linked to libvirt.pm/KVM.pm modules in this case (and if it should). Once I set image.osid to 36, (36 is os.id for vmwarelinux, module 5 - VCL::Module::OS::Linux), vcld is trying to load KVM-based image to a computer with Provisioning Engine set to VMware and using a VMware host. It fails. In this case (image.OSid = 36) there is no link between KVM image and libvirt computers/KVM hosts. Thanks. --- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 13:06 , Andy Kurth wrote: image.OSid should be set to the id that corresponds to vmwarelinux. OS.moduleid should point to the os_linux module table entry, which has module.perlpackagepath = VCL::Module::OS::Linux. -Andy On Wed, Jun 20, 2012 at 12:30 PM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Andy It's pointing to VCL::Module::Provisioning::libvirt This is a result of my earlier attempt to troubleshoot the issue. I've added new OSid, moduleid. The original image.osid was 29, which is CentOS Bare Metal, processed by VCL::Module::OS::Linux. With image.osid set to 29 VCL was trying to use xCAT module to process KVM reservations. At this moment I don't have any xCAT (bare metal) computers available and once I select the [KVM] image for reservation I get popup asking to select available time for reservation, which means that I don't have available resources to support this reservation. When I've added new OSid and moduleid (pointing to VCL::Module::Provisioning::libvirt), I'm able to start reservation, VCLd finds available computers (which are configured to use libvirt engine) and attempts to make reservation on correct KVM host, but fails with error attached in previous email. What should image.osid, moduleid be set to? -- Dmitri Chebotarov Virtual Computing Lab Systems Engineer, TSD - Ent Servers Messaging 223 Aquia Building, Ffx, MSN: 1B5 Phone: (703) 993-6175 Fax: (703) 993-3404 On Wednesday, June 20, 2012 at 11:52 , Andy Kurth wrote: For some reason the OS module for the image being loaded is showing as VCL::Module::Provisioning::libvirt. Check which module centos5image-kvmlinuxv4105-v0 is configured to use in the database: image.OSid -- OS.moduleid -- module.perlpackagepath -Andy On Wed, Jun 20, 2012 at 11:24 AM, Dmitri Chebotarov dcheb...@gmu.edu (mailto:dcheb...@gmu.edu) wrote: Andy I did 'svn up' and ran install_perl_libs.pl (http://install_perl_libs.pl (http://_perl_libs.pl) (http://_perl_libs.pl)) as well. While trying to make reservation still getting an error. Attached is reservation log. I'll try to trace the error, if you see something what causes it, please let me know. I'll try to capture image with new code little
