We do run VMs with multiple disks, sometimes, it depends on application
needs. We have not seen, upon creating a new profile for a guest using
"nodeadd" and adding a single hard disk, the issue only came when, in the
process of provisioning, if the server application type dictates a second
hard disk for data (done post firstboot via chef or legacy scripting), or
if and existing VM needed a second (or third) disk added to the profile.
To keep our build process simple and manage just a few osimages, we install
with only one hard disk on VM. Once we have OS installed and VM speaking
to our entire configuration server set, that is when any secondary disks
would be added. Normally we use chdef for this.
for instance, if we do a chdef <node> vmstorage="disk1|disk2" and node is
power cycled for legacy scsi disks, or inadvertently powered for virtio
disks, we get the ide error if I don't comment out hte cdrom info on kvm.pm
It occurs on any add of a disk and reread of a non cached profile, e.g. not
in kvm_nodedata, which was required for the old style scsi disks on VMs and
that I still have in parts of my clusters. However, if for some reason a
vititio allocation gets uncached it gives same error when we try to rpower
on, unless we edit the xml entry in kvm_nodedata or change it back to a
single disk and hot add the other storage. Backend storage types also
doesn't seem to matter, whether we are using a file based disk image in
local or SAN or a LV device, if we go past one disk, this pops up.
_________________________________
Douglas Myers,
IBM Special Events - Smart Cloud BMS Lead
_________________________________
"It's not an opportunity if it doesn't scare you a little bit"
From: Mark Gurevich/Poughkeepsie/IBM
To: Douglas Myers <dgmy...@us.ibm.com>
Cc: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>, Xiao
Peng Wang/China/IBM@IBMCN, Victor Hu/Poughkeepsie/IBM@IBMUS
Date: 08/03/2016 07:17 AM
Subject: Re: [xcat-user] : KVM storage question
Douglas,
Xiaopeng asked me to look into this problem.
Is your goal to be able to run mkvm to create a VM with multiple image
files as disks ? Have you looked into chvm -a option ?
Mark Gurevich
Poughkeepsie Development Lab
HPC Software Development - xCAT
"If we knew what it was we were doing, it would not be called research,
would it?"
--Albert Einstein
From: Douglas Myers/Schaumburg/IBM@IBMUS
To: "xCAT Users Mailing list" <xcat-user@lists.sourceforge.net>
Date: 07/27/2016 04:38 PM
Subject: Re: [xcat-user] : KVM storage question
Bringing this up again, now that I have upgraded to 2.12.1 on the MN.
We've hit this off and on ever since, but with 2.12 it seems to occur
whenever there's a removal from kvm_nodedata cache of a node def and try to
rpower on:
# rpower w30234 on
w30234: Error: internal error Only 1 ide controller is supported
We would get this error if we had more than one hard disk, virtio or scsi,
defined on a client node profile. There was a hint in RH bug
https://bugzilla.redhat.com/show_bug.cgi?id=1136182
Using that idediscussion as a basis, I removed the creation of virtual
cdrom from /opt/xcat/lib/perl/xCAT_plugin/kvm.pm :
#} else { #give the VM an empty optical drive, to allow chvm live
attach/remove
# my $cdhash;
# $cdhash->{device} = 'cdrom';
# $cdhash->{type} = 'file';
# $cdhash->{readonly};
# $cdhash->{target}->{dev} = $cdprefix . $suffixes[$suffidx];
# push @returns, $cdhash;
And restarted xCAT. We no longer get the ide error, but is defintiely a
hack we can't maintain easily. We don't normally need the cdrom so not
having it is not harmful to us, but kvm.pm will be clobbered on next
upgrade.
MN x86_64 SLES11 xCAT 2.12.1
Hypervisor x86_64 SLES11
_________________________________
Douglas Myers,
IBM Special Events - Smart Cloud BMS Lead
_________________________________
"It's not an opportunity if it doesn't scare you a little bit"
Inactive hide details for Douglas Myers---08/19/2015 08:32:25 AM---Anything
further on this? ________________________________Douglas
Myers---08/19/2015 08:32:25 AM---Anything further on this?
_________________________________
From: Douglas Myers/Schaumburg/IBM
To: "xCAT Users Mailing list" <xcat-user@lists.sourceforge.net>
Date: 08/19/2015 08:32 AM
Subject: Fw: [xcat-user] KVM storage question
Anything further on this?
_________________________________
Douglas Myers,
IBM Special Events - Smart Cloud BMS Lead
_________________________________
"It's not an opportunity if it doesn't scare you a little bit"
----- Forwarded by Douglas Myers/Schaumburg/IBM on 08/19/2015 08:31 AM
-----
From: Douglas Myers/Schaumburg/IBM
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Date: 08/12/2015 03:23 PM
Subject: Re: [xcat-user] KVM storage question
Ah, that's was my confusion then, because kvm_nodedata has nothing for
z10071 node, unless I only specify one disk, e.g. I get the rootvg image in
vmstorage, system will power on with rpower, but when I add in second disk,
I clear the cahced profile in kvm_nodedata ( chtab -d node=z10071
kvm_nodedata before power on) or it won't assign the second image as second
disk, but if I clear the cache I get the IDE error and nothing gets added
to the table. So I have nothing to compare a manual creation on the
hypervisor to...
_________________________________
Douglas Myers,
IBM Special Events - Smart Cloud BMS Lead
_________________________________
"It's not an opportunity if it doesn't scare you a little bit"
Inactive hide details for Xiao Peng Wang ---08/11/2015 11:10:27 PM---I did
get your point. But I have not your exactly images tXiao Peng Wang
---08/11/2015 11:10:27 PM---I did get your point. But I have not your
exactly images to create the problem and fix it. Since you already verified
the confi
From: Xiao Peng Wang <w...@cn.ibm.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Date: 08/11/2015 11:10 PM
Subject: Re: [xcat-user] KVM storage question
I did get your point. But I have not your exactly images to create the
problem and fix it. Since you already verified the configure in libvirt
manually, if you can share me what the xml looks like and the different
between it with the one created by xCAT, it will be helpful for me to fix
it.
Thanks
Best Regards
----------------------------------------------------------------------
Wang Xiaopeng (王晓朋)
IBM China System Technology Laboratory
Tel: 86-10-82453455
Email: w...@cn.ibm.com
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193
Inactive hide details for Douglas Myers ---2015/08/12 01:20:09---I'm
wondering if we have a communications problem on this threDouglas Myers
---2015/08/12 01:20:09---I'm wondering if we have a communications problem
on this thread... I know how to make the image fil
From: Douglas Myers <dgmy...@us.ibm.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Date: 2015/08/12 01:20
Subject: Re: [xcat-user] KVM storage question
I'm wondering if we have a communications problem on this thread...
I know how to make the image files work within libvirtd and I can
create/modify using cli tools and/or gui within libvirtd. The actual actual
of havign a second disk is not the problem. What is my issue is having xCAT
create teh profile when we rpower on the VM from MN and have it do it
ephemerally instead of xCAT managing an existing profile on a hypervisor.
In other words, w/o xCAT and it's dynamic VM profiles, this works fine,
it's only when I use xCAT that it ahs a problem, and I'm pretty sure it
comes down to the entry for vmstorage field, what I'm looking for is if
there is an accepted syntax for that field.
To restate, this is not a libvirtd issue, it's not KVM, it's getting xCAT's
dynamic xml creation to function with two image files that are not viritio.
If not possible, ok, then I'll go form there, but if it is possible, I jsut
need assistance with getting the syntax right on the xCAT definition of VM.
_________________________________
Douglas Myers,
IBM Special Events - Smart Cloud BMS Lead
_________________________________
"It's not an opportunity if it doesn't scare you a little bit"
Inactive hide details for Xiao Peng Wang ---08/10/2015 06:31:20 AM---If the
manually change through virsh can make it change, yXiao Peng Wang
---08/10/2015 06:31:20 AM---If the manually change through virsh can make
it change, you can dump out the xml file of the dom and diff it with the
xml whic
From: Xiao Peng Wang <w...@cn.ibm.com>
To: xCAT Users Mailing list
<xcat-user@lists.sourceforge.net>
Date: 08/10/2015 06:31 AM
Subject: Re: [xcat-user] KVM storage question
If the manually change through virsh can make it change, you can dump out
the xml file of the dom and diff it with the xml which generated by xcat
(use tabdump kvm_nodedata command)
Thanks
Best Regards
----------------------------------------------------------------------
Wang Xiaopeng (王晓朋)
IBM China System Technology Laboratory
Tel: 86-10-82453455
Email: w...@cn.ibm.com
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193
Inactive hide details for Douglas Myers ---2015/08/09 01:37:12---libvirtd
is happy enough to run the second and/or third disk iDouglas Myers
---2015/08/09 01:37:12---libvirtd is happy enough to run the second and/or
third disk if I manually insert via virt-manager o
From: Douglas Myers <dgmy...@us.ibm.com>
To: xCAT Users Mailing list <xcat-user@lists.sourceforge.net>
Date: 2015/08/09 01:37
Subject: Re: [xcat-user] KVM storage question
libvirtd is happy enough to run the second and/or third disk if I manually
insert via virt-manager or cli and VM sees the disk fine, so this issue is
how to get xcat to start an ephmeral VM that doesn't have a a porfile saved
on a hypervisor?
I can do this with lvm using vmstorage=phy:/path/tol/v1|phy:/path/to/lv2 on
a node yealds to compalints from xcat, all I'm looking for is the
equivalent for a file based disk image
_________________________________
Douglas Myers,
IBM Special Events - Smart Cloud BMS Lead
_________________________________
"It's not an opportunity if it doesn't scare you a little bit"
Inactive hide details for Xiao Peng Wang ---08/06/2015 03:41:19 AM---I
think you first need to figure out what libvirt can do fXiao Peng Wang
---08/06/2015 03:41:19 AM---I think you first need to figure out what
libvirt can do for you since xcat totally following it's functionalities.
From: Xiao Peng Wang <w...@cn.ibm.com>
To: xCAT Users Mailing list
<xcat-user@lists.sourceforge.net>
Date: 08/06/2015 03:41 AM
Subject: Re: [xcat-user] KVM storage question
I think you first need to figure out what libvirt can do for you since xcat
totally following it's functionalities.
Thanks
Best Regards
----------------------------------------------------------------------
Wang Xiaopeng (王晓朋)
IBM China System Technology Laboratory
Tel: 86-10-82453455
Email: w...@cn.ibm.com
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193
Inactive hide details for Douglas Myers ---2015/08/06 12:45:05---SLES 11 MN
and VM xCAT-2.9.1 x86_64 KVM I am in the process Douglas Myers
---2015/08/06 12:45:05---SLES 11 MN and VM xCAT-2.9.1 x86_64 KVM I am in
the process of converting from a LVM backed storag
From: Douglas Myers <dgmy...@us.ibm.com>
To: "xCAT Users Mailing list" <xcat-user@lists.sourceforge.net>
Date: 2015/08/06 12:45
Subject: [xcat-user] KVM storage question
SLES 11 MN and VM xCAT-2.9.1 x86_64 KVM
I am in the process of converting from a LVM backed storage solution for
VMs to a raw file for disk housed in a GPFS cell. The design has the
hypervisors seeing gpfs as local storage, and when I add a single raw image
file and start the VM with it, everythign works fine. The problem is,
several of these VMs have two or three logical volumes presented as disks,
sd[abc]. When I attempt to convert the second lv to a file, the conversion
works fine, but I'm missing the proper syntax to add it to the vmstorage
object:
vmstorage=/gpfs/root/z10071_rootvg.img|r/gpfs/app/z10071_appvg.img
When attempting to power up, I receive this message:
z10000:~ # rpower z10071 on
z10071: Error: internal error Only 1 ide controller is supported
If I try to set the vmstoragemodel to scsi, xCAT will boot the VM but the
VM cannot find it's root disk. If I revert to a single disk and remove
vmstoragemodel I can successfully power on and boot into OS. So how to I
add more than one image file as a disk?
(Yes, I know, should be using virtio disks, these are legacy machines,
newer VMs will hopefully be using it)
_________________________________
Douglas Myers,
IBM Special Events - Smart Cloud BMS Lead
_________________________________
"It's not an opportunity if it doesn't scare you a little bit"
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
------------------------------------------------------------------------------
_______________________________________________
xCAT-user mailing list
xCAT-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/xcat-user
