Benchmarking Software's on VCL
Dear All, I have run into issues of software(GIS) being slower on VCL as opposed to Laptop. Although I have 8GB RAM and 2 vCPU assigned for this VM, comparison of few tests resulted in poor performance on VCL. It could be the nature of GIS and RDP or something else. I have tried to isolate GIS vm's onto one blade and no other vm's end up on this blade. Any ideas or options on how could I track this down to identify what could cause this. Thank you, Amit
RE: EC2 Provisioning Module
Hi Aaron, This is of interest to us as well. Thank you, Amit From: Aaron Peeler [fapee...@ncsu.edu] Sent: Friday, July 29, 2011 8:54 AM To: vcl-dev@incubator.apache.org Subject: Re: EC2 Provisioning Module There was some work done a couple of years ago by either Xianqing or Milan (or both) not sure. I believe it was under IBM control just as a proof of concept and wasn't contributed. We should be able to easily re-create it. If there is strong interest in VCL requesting resources from EC2, sounds like there is -:) , I can help kickstart it. Aaron On Wed, Jul 27, 2011 at 10:21 AM, Alan D. Cabrera l...@toolazydogs.com wrote: That sounds like a fun thing to work on. Who's working on it? Regards, Alan On Jul 27, 2011, at 7:09 AM, Everett Toews wrote: How goes the work on open sourcing the EC2 Provisioning Module? Thanks, Everett -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -- BEGIN-ANTISPAM-VOTING-LINKS -- Teach CanIt if this mail (ID 534490822) is spam: Spam: https://www.spamtrap.odu.edu/b.php?i=534490822m=20b3a292cb28t=20110729c=s Not spam: https://www.spamtrap.odu.edu/b.php?i=534490822m=20b3a292cb28t=20110729c=n Forget vote: https://www.spamtrap.odu.edu/b.php?i=534490822m=20b3a292cb28t=20110729c=f -- END-ANTISPAM-VOTING-LINKS
RE: VCL Risk for Collaborators With Permissions to manage Images
With great power comes great responsibility ... works everywhere :-) Thank you Aaron!, just wanted to learn if I had missed out any possibilities as well. Amit -Original Message- From: Aaron Peeler [mailto:fapee...@ncsu.edu] Sent: Tuesday, July 19, 2011 8:15 AM To: vcl-dev@incubator.apache.org Subject: Re: VCL Risk for Collaborators With Permissions to manage Images Hello Amit, There's always risks, but I think it depends on the situation and the relation with the other party. You can add them as a non-root or non-admin user and always monitor their usage, also explain to them that they must follow your existing computer use policies or there access will be revoked(if feasible). This usually works for us. Hope this helps, Aaron On Mon, Jul 18, 2011 at 5:22 PM, Kumar, Amit H. ahku...@odu.edu wrote: Hello, Don't know if this has been answered already in the forum... What are the risks? If we were to let collaborators external to the university have admin access to a reservation made on a VCL resource either vmware or baremetal? Any thoughts? Any way to lock him out? Please advise! Regards, Amit -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -- BEGIN-ANTISPAM-VOTING-LINKS -- Teach CanIt if this mail (ID 530743466) is spam: Spam: https://www.spamtrap.odu.edu/b.php?i=530743466m=bde068cdea4et=2011071 9c=s Not spam: https://www.spamtrap.odu.edu/b.php?i=530743466m=bde068cdea4et=2011071 9c=n Forget vote: https://www.spamtrap.odu.edu/b.php?i=530743466m=bde068cdea4et=2011071 9c=f -- END-ANTISPAM-VOTING-LINKS
VCL Risk for Collaborators With Permissions to manage Images
Hello, Don't know if this has been answered already in the forum... What are the risks? If we were to let collaborators external to the university have admin access to a reservation made on a VCL resource either vmware or baremetal? Any thoughts? Any way to lock him out? Please advise! Regards, Amit
RE: Private vs Public Setup of VCL
Hi Aaron, This is really great, being able to access EC2 IBM resource or any other cloud resources for that matter. I can't wait to test that one out. Any body working on EC2 interface? Thank you for your insight! Regards, Amit From: Aaron Peeler [fapee...@ncsu.edu] Sent: Friday, May 27, 2011 12:19 PM To: vcl-u...@incubator.apache.org Cc: vcl-dev@incubator.apache.org Subject: Re: Private vs Public Setup of VCL Hello Amit, Good questions. I would agree that the simplest description of a public cloud is what you mention - one that allows anyone to sign up(either freely or paid) to access the resources provided. Like amazon EC2, etc. The hybrid model mentioned is what I would describe as a private cloud that when needed can pull in or access resources of a public cloud. There do exists VCL provisioning modules in development that can request resources from EC2 and IBM's cloud. Xianqing Yu is working on a JIRA issue for interacting with an IBM cloud https://issues.apache.org/jira/browse/VCL-457 as an example. Aaron On Fri, May 27, 2011 at 10:39 AM, Kumar, Amit H. ahku...@odu.edu wrote: Hi All, Reading through this document on VCL on IBM developers site: http://www.ibm.com/developerworks/webservices/library/ws-vcl/index.html Brings me to the following question: First of all I am not sure how this question will be treated on this forum , because I have not seen a discussion on VCL that talks about Private vs. Public setup like the IBMers do in the above link. So please bare with me and my naïve thoughts …. Q. When would an implementation of VCL be considered as a Public Cloud Setup? I cannot draw a clear line to distinguish between private vs. public VCL setup. Here is what I am thinking: If the VCL implementation allows anyone to sign up(either freely or paid) to access the resources provided. Then it is a public cloud setup. ? If the VCL implementation allows other similar VCL type resources to join the existing pool of resources to provide free or paid access to once signed up. Is this a public cloud setup? Please advise! Regards, Amit -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -- BEGIN-ANTISPAM-VOTING-LINKS -- Teach CanIt if this mail (ID 510875134) is spam: Spam: https://www.spamtrap.odu.edu/b.php?i=510875134m=42adbaeee8c1t=20110527c=s Not spam: https://www.spamtrap.odu.edu/b.php?i=510875134m=42adbaeee8c1t=20110527c=n Forget vote: https://www.spamtrap.odu.edu/b.php?i=510875134m=42adbaeee8c1t=20110527c=f -- END-ANTISPAM-VOTING-LINKS
Re: Reloading VM After Image Capture and VM Registration: FAILS
Weird, actually I just ran into your problem above, I noticed that I can't browse the NFS after the vmdk is supposedly copied, remounting your NFS will probably fix the problem. Hi Ryan that is weird ...but I will try your fix when i get to work early tomorrow and see how it goes; Thanks for you constant help! Amit
RE: Reservation Error:
Hi All, Looking closely it looks like there is an issue when, the esx.pm picks all the parameters to initiate a poweroff command on the VMguest using the VMware Perl toolkit API Please advise ...if my understanding below is right or wrong? 2010-03-22 16:51:09|15553|2:2|image|esx.pm:capture(646)|found previous name= 2010-03-22 16:51:09|15553|2:2|image|esx.pm:capture(648)|SSHing to node to configure currentimage.txt 2010-03-22 16:51:09|15553|2:2|image|utils.pm:run_ssh_command(6180)|executing SSH command on resxi000: |15553|2:2|image| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x resxi000 'echo esx3-basewinxp-v0 /root/currentimage.txt' 21 2010-03-22 16:51:10|15553|2:2|image|utils.pm:run_ssh_command(6262)|run_ssh_command output: |15553|2:2|image| bash: /root/currentimage.txt: No such file or directory 2010-03-22 16:51:10|15553|2:2|image|utils.pm:run_ssh_command(6272)|SSH command executed on resxi000, command: |15553|2:2|image| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x resxi000 'echo esx3-basewinxp-v0 /root/currentimage.txt' 21 |15553|2:2|image| returning (1, bash: /root/currentimage.txt: ...) 2010-03-22 16:51:10|15553|2:2|image|esx.pm:capture(658)|Power off command: /usr/lib/vmware-vcli/apps/vm/vmcontrol.pl --server '128' --vmname resxi000 --operation poweroff --username 0 --password 'xxx' # 1. Here the server info seems to be wrong. 2. --vmname should actually be esx3-basewinxp-v0 and not the VMguest name; 3. NOT sure if the username 0 is associated with root ??? if yes then that seems right. When I corrected the above info and executed on command line it powered off the VMguest. I am still looking into where the above incorrect info is pulled from so that I can correct it. Any idea ?? Any database tables ?? I am also curious to know if we are supposed to name our Vmguest based on the vmnames? Just for imaging purpose? Thank you, Amit
RE: Reservation Error:
Hi Ryan, Thank you for your quick response. I just realized the part with giving hostname rather than just the IP for VMhost by looking at the regular expression parsing for hostname. I didn't know that we need to have the same name for Vmguest and the base image. Now that you mentioned it makes sense why the code is looking for vmguest name. I will give this a try. Thank you!!! Amit -Original Message- From: Ryan Johnson [mailto:rjoh...@gwmail.gwu.edu] Sent: Tuesday, March 23, 2010 12:50 PM To: vcl-dev@incubator.apache.org Subject: Re: Reservation Error: I believe when you are creating a base image, the vmguest name should be the same as the name of the image you are creating it should be in a format like vmwarewinxp-base7-v1. Note that the vm you are imaging should have this name as well as the vmdk file. Your other problem with the hostname is that you need to use the hostname of the esxi server in the hostname column of the computer table entry you have for your esxi server (rather than the IP address). Because VCL just uses the hostname and not the fully qualified name, make sure you have an entry for the hostname in your /etc/hosts file on the management node. On Tue, Mar 23, 2010 at 11:01 AM, Kumar, Amit H. ahku...@odu.edu wrote: Hi All, Looking closely it looks like there is an issue when, the esx.pm picks all the parameters to initiate a poweroff command on the VMguest using the VMware Perl toolkit API Please advise ...if my understanding below is right or wrong? 2010-03-22 16:51:09|15553|2:2|image|esx.pm:capture(646)|found previous name= 2010-03-22 16:51:09|15553|2:2|image|esx.pm:capture(648)|SSHing to node to configure currentimage.txt 2010-03-22 16:51:09|15553|2:2|image|utils.pm:run_ssh_command(6180)|executing SSH command on resxi000: |15553|2:2|image| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x resxi000 'echo esx3-basewinxp-v0 /root/currentimage.txt' 21 2010-03-22 16:51:10|15553|2:2|image|utils.pm:run_ssh_command(6262)|run_ssh_command output: |15553|2:2|image| bash: /root/currentimage.txt: No such file or directory 2010-03-22 16:51:10|15553|2:2|image|utils.pm:run_ssh_command(6272)|SSH command executed on resxi000, command: |15553|2:2|image| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x resxi000 'echo esx3-basewinxp-v0 /root/currentimage.txt' 21 |15553|2:2|image| returning (1, bash: /root/currentimage.txt: ...) 2010-03-22 16:51:10|15553|2:2|image|esx.pm:capture(658)|Power off command: /usr/lib/vmware-vcli/apps/vm/vmcontrol.pl --server '128' --vmname resxi000 --operation poweroff --username 0 --password 'xxx' # 1. Here the server info seems to be wrong. 2. --vmname should actually be esx3-basewinxp-v0 and not the VMguest name; 3. NOT sure if the username 0 is associated with root ??? if yes then that seems right. When I corrected the above info and executed on command line it powered off the VMguest. I am still looking into where the above incorrect info is pulled from so that I can correct it. Any idea ?? Any database tables ?? I am also curious to know if we are supposed to name our Vmguest based on the vmnames? Just for imaging purpose? Thank you, Amit
RE: Reservation Error:
Hi Andy,
I followed through every step in esx.README and still not successful in
capturing an image:
I can SSH to the hypervisor and the VMhost through the management node with
the/etc/vcl/vcl.key etc etc ..everything else looks okay; below I also have the
query's that I used to create this image and reservation.
Please advise.
2010-03-22 13:55:11|14001|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-03-22 13:55:11
2010-03-22
13:55:11|14001|2:3|image|utils.pm:reservation_being_processed(9634)|computerloadlog
'begin' entry does NOT exist for reservation 3
2010-03-22
13:55:11|14001|2:3|image|utils.pm:reservation_being_processed(9686)|reservation
is NOT currently being processed
2010-03-22 13:55:11|14001|2:3|image|vcld:main(276)|reservation 3 is NOT already
being processed
|14001|2:3|image| WARNING
|14001|2:3|image| 2010-03-22
13:55:11|14001|2:3|image|utils.pm:get_request_info(5218)|preferredimageid is
not set for computer id=3
|14001|2:3|image| ( 0) utils.pm, notify (line: 737)
|14001|2:3|image| (-1) utils.pm, get_request_info (line: 5218)
|14001|2:3|image| (-2) vcld, main (line: 280)
2010-03-22 13:55:11|14001|2:3|image|utils.pm:get_request_info(5354)|standalone
affiliation found: Local
2010-03-22
13:55:11|14001|2:3|image|utils.pm:get_management_node_info(6815)|management
node info retrieved from database for colbert
2010-03-22 13:55:11|14001|2:3|image|vcld:main(281)|retrieved request
information from database
2010-03-22
13:55:11|14001|2:3|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 3
2010-03-22 13:55:11|14001|2:3|image|utils.pm:update_request_state(2186)|request
2 state updated to: pending, laststate to: image
2010-03-22 13:55:11|14001|2:3|image|utils.pm:insertloadlog(4710)|inserted
computer=3, begin, beginning to process, state is image
2010-03-22 13:55:11|14001|2:3|image|vcld:make_new_child(509)|loaded VCL::image
module
2010-03-22 13:55:11|14061|2:3|image|vcld:make_new_child(582)|vcld environment
variable set to 0 for this process
2010-03-22 13:55:11|14061|2:3|image|Module.pm:new(132)|constructor called,
class=VCL::image
2010-03-22 13:55:11|14061|2:3|image|Module.pm:new(154)|VCL::image object created
2010-03-22 13:55:11|14001|2:3|image|vcld:make_new_child(566)|current number of
forked kids: 1
2010-03-22 13:55:11|14061|2:3|image|State.pm:initialize(85)|obtained a database
handle for this state process, stored as $ENV{dbh}
2010-03-22 13:55:11|14061|2:3|image|State.pm:check_image_os(839)|no corrections
need to be made to image OS: esx35
2010-03-22
13:55:11|14061|2:3|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 3
2010-03-22
13:55:11|14061|2:3|image|utils.pm:rename_vcld_process(7863)|reservation count: 1
2010-03-22
13:55:11|14061|2:3|image|utils.pm:rename_vcld_process(7882)|PARENTIMAGE: 1
2010-03-22
13:55:11|14061|2:3|image|utils.pm:rename_vcld_process(7883)|SUBIMAGE: 0
2010-03-22 13:55:11|14061|2:3|image|utils.pm:rename_vcld_process(7901)|renamed
process to 'vcld VCL::image 2:3 image imaging'
2010-03-22
13:55:11|14061|2:3|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 3
2010-03-22
13:55:11|14061|2:3|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 3
2010-03-22 13:55:11|14061|2:3|image|State.pm:initialize(121)|attempting to load
provisioning module: VCL::Module::Provisioning::esx
2010-03-22 13:55:11|14061|2:3|image|esx.pm:initialize(138)|esx vmware toolkit
root path found: /usr/lib/vmware-vcli/apps
2010-03-22 13:55:11|14061|2:3|image|esx.pm:initialize(140)|vmware ESX module
initialized
2010-03-22
13:55:11|14061|2:3|image|State.pm:initialize(127)|VCL::Module::Provisioning::esx
module loaded
2010-03-22 13:55:11|14061|2:3|image|Module.pm:new(132)|constructor called,
class=VCL::Module::Provisioning::esx
2010-03-22
13:55:11|14061|2:3|image|Module.pm:new(154)|VCL::Module::Provisioning::esx
object created
2010-03-22 13:55:11|14061|2:3|image|esx.pm:initialize(138)|esx vmware toolkit
root path found: /usr/lib/vmware-vcli/apps
2010-03-22 13:55:11|14061|2:3|image|esx.pm:initialize(140)|vmware ESX module
initialized
2010-03-22
13:55:11|14061|2:3|image|State.pm:initialize(131)|VCL::Module::Provisioning::esx
provisioner object created
2010-03-22 13:55:11|14061|2:3|image|State.pm:initialize(145)|attempting to load
OS module: VCL::Module::OS::Linux
2010-03-22
13:55:11|14061|2:3|image|State.pm:initialize(151)|VCL::Module::OS::Linux module
loaded
2010-03-22 13:55:11|14061|2:3|image|Module.pm:new(132)|constructor called,
class=VCL::Module::OS::Linux
2010-03-22 13:55:11|14061|2:3|image|Module.pm:new(154)|VCL::Module::OS::Linux
object created
2010-03-22
13:55:11|14061|2:3|image|State.pm:initialize(154)|VCL::Module::OS::Linux OS
object created
2010-03-22
RE: Reservation Error:
Hi Ryan, you are great! I made quite a bit of progress with your suggestion.
I hope you can help me with this next step error: Seems like image creation was
successful but upon realod/poweron VMware perl toolkit looks for server '128'
instead of the full ip.
Something seems to be missing: Hope you can shed some more light on this!!!
2010-03-22 16:50:28|14912|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-03-22 16:50:28
2010-03-22 16:50:33|14912|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-03-22 16:50:33
===
OUTPUT for vcld run on 2010-03-22 16:51:04
===
2010-03-22 16:51:04|15551|vcld:main(116)|vcld environment variable set to 1 for
this process
2010-03-22 16:51:04|15551|utils.pm:rename_vcld_process(7901)|renamed process to
'vcld vcld'
2010-03-22 16:51:04|15551|utils.pm:get_management_node_info(6815)|management
node info retrieved from database for colbert
2010-03-22 16:51:04|15551|vcld:main(127)|retrieved management node information
from database
2010-03-22 16:51:04|15551|vcld:main(140)|management_node_id environment
variable set: 1
2010-03-22 16:51:04|15551|vcld:main(148)|management node checkin interval is 5
seconds
2010-03-22 16:51:04|15551|vcld:main(149)|vcld started on
colbert.vcls.priv.odu.edu
2010-03-22 16:51:09|15551|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-03-22 16:51:09
2010-03-22
16:51:09|15551|2:2|image|utils.pm:reservation_being_processed(9634)|computerloadlog
'begin' entry does NOT exist for reservation 2
2010-03-22
16:51:09|15551|2:2|image|utils.pm:reservation_being_processed(9686)|reservation
is NOT currently being processed
2010-03-22 16:51:09|15551|2:2|image|vcld:main(276)|reservation 2 is NOT already
being processed
|15551|2:2|image| WARNING
|15551|2:2|image| 2010-03-22
16:51:09|15551|2:2|image|utils.pm:get_request_info(5218)|preferredimageid is
not set for computer id=3
|15551|2:2|image| ( 0) utils.pm, notify (line: 737)
|15551|2:2|image| (-1) utils.pm, get_request_info (line: 5218)
|15551|2:2|image| (-2) vcld, main (line: 280)
2010-03-22 16:51:09|15551|2:2|image|utils.pm:get_request_info(5354)|standalone
affiliation found: Local
2010-03-22
16:51:09|15551|2:2|image|utils.pm:get_management_node_info(6815)|management
node info retrieved from database for colbert
2010-03-22 16:51:09|15551|2:2|image|vcld:main(281)|retrieved request
information from database
2010-03-22
16:51:09|15551|2:2|image|utils.pm:get_management_node_info(6815)|management
node info retrieved from database for colbert
2010-03-22
16:51:09|15551|2:2|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 2
2010-03-22 16:51:09|15551|2:2|image|utils.pm:update_request_state(2186)|request
2 state updated to: pending, laststate to: image
2010-03-22 16:51:09|15551|2:2|image|utils.pm:insertloadlog(4710)|inserted
computer=3, begin, beginning to process, state is image
2010-03-22 16:51:09|15551|2:2|image|vcld:make_new_child(509)|loaded VCL::image
module
2010-03-22 16:51:09|15553|2:2|image|vcld:make_new_child(582)|vcld environment
variable set to 0 for this process
2010-03-22 16:51:09|15553|2:2|image|Module.pm:new(132)|constructor called,
class=VCL::image
2010-03-22 16:51:09|15553|2:2|image|Module.pm:new(154)|VCL::image object created
2010-03-22 16:51:09|15551|2:2|image|vcld:make_new_child(566)|current number of
forked kids: 1
2010-03-22 16:51:09|15553|2:2|image|State.pm:initialize(85)|obtained a database
handle for this state process, stored as $ENV{dbh}
2010-03-22 16:51:09|15553|2:2|image|State.pm:check_image_os(839)|no corrections
need to be made to image OS: esx35
2010-03-22
16:51:09|15553|2:2|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 2
2010-03-22
16:51:09|15553|2:2|image|utils.pm:rename_vcld_process(7863)|reservation count: 1
2010-03-22
16:51:09|15553|2:2|image|utils.pm:rename_vcld_process(7882)|PARENTIMAGE: 1
2010-03-22
16:51:09|15553|2:2|image|utils.pm:rename_vcld_process(7883)|SUBIMAGE: 0
2010-03-22 16:51:09|15553|2:2|image|utils.pm:rename_vcld_process(7901)|renamed
process to 'vcld VCL::image 2:2 image imaging'
2010-03-22
16:51:09|15553|2:2|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 2
2010-03-22
16:51:09|15553|2:2|image|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 2
2010-03-22 16:51:09|15553|2:2|image|State.pm:initialize(121)|attempting to load
provisioning module: VCL::Module::Provisioning::esx
2010-03-22 16:51:09|15553|2:2|image|esx.pm:initialize(138)|esx vmware toolkit
root path found: /usr/lib/vmware-vcli/apps
2010-03-22 16:51:09|15553|2:2|image|esx.pm:initialize(140)|vmware ESX module
initialized
2010-03-22
RE: Reservation Error:
:27|20986|1:1|image|utils.pm:delete_computerloadlog_reservation(7551)|removing
computerloadlog entries matching loadstate = begin
2010-03-18
15:06:27|20986|1:1|image|utils.pm:delete_computerloadlog_reservation(7598)|deleted
rows from computerloadlog for reservation id=1
2010-03-18 15:06:27|20986|1:1|image|State.pm:DESTROY(912)|removed
computerloadlog rows with loadstate=begin for reservation
2010-03-18 15:06:27|20986|1:1|image|State.pm:DESTROY(924)|number of database
handles state process created: 1
2010-03-18 15:06:27|20986|1:1|image|State.pm:DESTROY(933)|process has a
database handle stored in $ENV{dbh}, attempting disconnect
2010-03-18 15:06:27|20986|1:1|image|State.pm:DESTROY(935)|$ENV{dbh}: database
disconnect successful
2010-03-18 15:06:27|20986|1:1|image|State.pm:DESTROY(949)|VCL::image process
20986 exiting
2010-03-18 15:06:27|20858|vcld:REAPER(744)|VCL process exited for reservation 1
2010-03-18 15:06:27|20858|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-03-18 15:06:27
2010-03-18 15:06:32|20858|vcld:main(165)|lastcheckin time updated for
management node 1: 2010-03-18 15:06:32
You have new mail in /var/spool/mail/root
[r...@colbert vcl-debug]# exit
Script done, file is vclamit03.18.a.2010.log
You have new mail in /var/spool/mail/root
[r...@colbert vcl-debug]# /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
128.82.128.252 'ls -1 /vmfs/volumes/15a5e041-86bf33de/golden
[r...@colbert vcl-debug]# /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
128.82.128.252 'ls -1 /vmfs/volumes/15a5e041-86bf33de/golden'
/vmfs/volumes/15a5e041-86bf33de/golden
[r...@colbert vcl-debug]# /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
128.82.128.252 'ls -1 /vmfs/volumes/15a5e041-86bf33de/golden/' - Note forward
slash
thrash
vmwarewinxp-base7-v0
Thank you,
Amit
-Original Message-
From: Andy Kurth [mailto:andy_ku...@ncsu.edu]
Sent: Thursday, March 18, 2010 12:22 PM
To: vcl-dev@incubator.apache.org
Subject: Re: Reservation Error:
Yes, the management node needs to be be able to SSH to the VM hosts before
attempting the image capture, or any other VM operations. Assuming password
authentication is still enabled on the VM hosts, you can run gen-node-key.sh
IP for each of them. I wouldn't try the VCL image capture process until
this
works:
ssh -i /etc/vcl/vcl.key -l root -p 22 VM host IP
-Andy
Kumar, Amit H. wrote:
Ah! .. I see. Seems like I started with a wrong assumption.
I didn't not do the capture image process yet. I wanted to see if I can
make a reservation
for the already existing VM, that I built with the name
'vmwarewinxp-base7-v0' and placed
it under the Data-Store-Path on the VMhost that built it.
Yes you were right I was missing the IP address in the Data-Store Path: I
will put in the
VMhost IP here.
In that case shouldn't I generate-node-key's for all the VMhost's because
it will try to
SSH to it to get to the Data-Store-Path?
Thank you Andy for the help ... I will give image capture a try first.
Amit
RE: Reservation Error:
Ah! .. I see. Seems like I started with a wrong assumption.
I didn't not do the capture image process yet. I wanted to see if I can make a
reservation for the already existing VM, that I built with the name
'vmwarewinxp-base7-v0' and placed it under the Data-Store-Path on the VMhost
that built it.
Yes you were right I was missing the IP address in the Data-Store Path: I will
put in the VMhost IP here.
In that case shouldn't I generate-node-key's for all the VMhost's because it
will try to SSH to it to get to the Data-Store-Path?
Thank you Andy for the help ... I will give image capture a try first.
Amit
-Original Message-
From: Andy Kurth [mailto:andy_ku...@ncsu.edu]
Sent: Thursday, March 18, 2010 10:56 AM
To: vcl-dev@incubator.apache.org
Subject: Re: Reservation Error:
376 |16651|5:5|new| WARNING ^M
377 |16651|5:5|new| 2010-03-17
13:02:45|16651|5:5|new|DataStructure.pm:_automethod(675)|corresponding data
has not
been initialized for get_computer_preferredimage_id:
$self-request_data-
{reservation}{5}{computer}{preferredimage}{id}^M
378 |16651|5:5|new| ( 0) utils.pm, notify (line: 737)^M
379 |16651|5:5|new| (-1) DataStructure.pm, _automethod (line: 675)^M
380 |16651|5:5|new| (-2) Autoload.pm, __ANON__ (line: 80)^M
381 |16651|5:5|new| (-3) new.pm, process (line: 106)^M
382 |16651|5:5|new| (-4) vcld, make_new_child (line: 594)^M
383 |16651|5:5|new| (-5) vcld, main (line: 341)^M
# Not sure if I am missing something here.
This isn't a problem. It occurs because computer.preferredimageid isn't set
in
the database. It should get set automatically after a successful reservation
is
made on the computer.
475 2010-03-17
13:02:46|16651|5:5|new|utils.pm:run_ssh_command(6180)|executing
SSH command on resxi-2:^M
476 |16651|5:5|new| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
resxi-2 'cat
currentimage.txt' 21^M
477 2010-03-17
13:02:47|16651|5:5|new|utils.pm:run_ssh_command(6262)|run_ssh_command
output:^M
478 |16651|5:5|new| cat: currentimage.txt: No such file or directory^M
# currentimage.txt : Is this something that we have to create at
anytime? I am
thinking it is created automatically when a image is loaded for the first
time.
This appears to be a problem. You never have to manually create/alter
currentimage.txt. It should be created automatically during the image capture
process and saved within the image. This file is used when a reservation is
made to determine if the correct image is loaded on the computer in order to
know if the computer needs to be reloaded or not. The computer will be
reloaded
every time a reservation is made if the file is missing or incorrect, even if
the correct image is loaded.
Check if currentimage.txt exists in root's home directory on that computer.
You
should be able to shell into it from the management node via:
ssh -i /etc/vcl/vcl.key -l root -p 22 -x resxi-2
Then run ls -l ~. What do you see?
If you still have the vcld.log output from the image capture process, search
it
for currentimage.txt to see if anything went wrong.
516 2010-03-17
13:02:47|16651|5:5|new|utils.pm:run_ssh_command(6180)|executing
SSH command on /install/image/nfs1:^M
517 |16651|5:5|new| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
/install/image/nfs1
'ls -1 /golden 21' 21^M
# This is where my real issues are: I realized reading the README for
esx and
esxthin, that I need to have a VCL mount point and a subdirectory /golden for
my images
But what I am missing here is why is it trying to ssh -x
/install/image/nfs1 which is
actually the Data Store path. Isn't it supposed to ssh to my VMhost machine.
Also when does VCL code use the esxthin.pm, as opposed to esx.pm?
The previous two questions are related. I'm not too familiar with the esx.pm
module but you cannot ignore this. From looking at the code, the warning is
being displayed because there's a problem with your VM host profile's data
store
path value. It's looking for this setting to be in the format:
IP address:datastore path
Check this setting:
Virtual Hosts VM Host Profiles Configure Profile Data Store Path
I'm guessing it doesn't include the IP address where the golden images reside
or
a colon. The ls -1 SSH command above is being incorrectly assembled because
of this. It's inserting /install/image/nfs1 where the IP address should go.
Once the data store path is changed to include IP address:, the command
should be assembled correctly as:
/usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x IP address 'ls -1
/install/image/nfs1/golden 21'
The rest of the SSH errors are occurring because it's attempting to connect to
the computer with the address /install/image/nfs1.
518 ^M
519 |16651|5:5|new| WARNING ^M
520 |16651|5:5|new| 2010-03-17
Reservation Error:
Hi All,
I am trying this in baby steps and running into few issues:
One thing I have to say is your vcld.log is really amazing, it kind of walks
you through the code precisely and yet complete.
I have few missing pieces that I want to identify and need your help here. I
have inline questions starting with # as below:
324 2010-03-17
13:02:45|19349|5:5|new|utils.pm:reservation_being_processed(9634)|computerloadlog
'begin' entry does NOT exist for reservation 5^M
325 2010-03-17
13:02:45|19349|5:5|new|utils.pm:reservation_being_processed(9686)|reservation
is NOT currently being processed^M
326 2010-03-17 13:02:45|19349|5:5|new|vcld:main(276)|reservation 5 is NOT
already being processed^M
327 ^M
328 |19349|5:5|new| WARNING ^M
329 |19349|5:5|new| 2010-03-17
13:02:45|19349|5:5|new|utils.pm:get_request_info(5218)|preferredimageid is not
set for computer id=3^M
330 |19349|5:5|new| ( 0) utils.pm, notify (line: 737)^M
331 |19349|5:5|new| (-1) utils.pm, get_request_info (line: 5218)^M
332 |19349|5:5|new| (-2) vcld, main (line: 280)^M
333 ^M
334 2010-03-17
13:02:45|19349|5:5|new|utils.pm:get_request_info(5354)|standalone affiliation
found: Local^M
335 2010-03-17
13:02:45|19349|5:5|new|utils.pm:get_management_node_info(6815)|management node
info retrieved from database for colbert^M
336 2010-03-17 13:02:45|19349|5:5|new|vcld:main(281)|retrieved request
information from database^M
337 2010-03-17
13:02:45|19349|5:5|new|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 5^M
338 2010-03-17
13:02:45|19349|5:5|new|utils.pm:update_request_state(2186)|request 5 state
updated to: pending, laststate to: new^M
339 2010-03-17 13:02:45|19349|5:5|new|utils.pm:insertloadlog(4710)|inserted
computer=3, begin, beginning to process, state is new^M
340 2010-03-17 13:02:45|19349|5:5|new|vcld:make_new_child(509)|loaded
VCL::new module^M
341 2010-03-17 13:02:45|16651|5:5|new|vcld:make_new_child(582)|vcld
environment variable set to 0 for this process^M
342 2010-03-17 13:02:45|16651|5:5|new|Module.pm:new(132)|constructor
called, class=VCL::new^M
343 2010-03-17 13:02:45|16651|5:5|new|Module.pm:new(154)|VCL::new object
created^M
344 2010-03-17 13:02:45|19349|5:5|new|vcld:make_new_child(566)|current
number of forked kids: 1^M
345 2010-03-17 13:02:45|16651|5:5|new|State.pm:initialize(85)|obtained a
database handle for this state process, stored as $ENV{dbh}^M
346 2010-03-17 13:02:45|16651|5:5|new|State.pm:check_image_os(820)|no
corrections need to be made, not an imaging request, returning 1^M
347 2010-03-17
13:02:45|16651|5:5|new|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 5^M
348 2010-03-17
13:02:45|16651|5:5|new|utils.pm:rename_vcld_process(7863)|reservation count: 1^M
349 2010-03-17
13:02:45|16651|5:5|new|utils.pm:rename_vcld_process(7882)|PARENTIMAGE: 1^M
350 2010-03-17
13:02:45|16651|5:5|new|utils.pm:rename_vcld_process(7883)|SUBIMAGE: 0^M
351 2010-03-17
13:02:45|16651|5:5|new|utils.pm:rename_vcld_process(7901)|renamed process to
'vcld VCL::new 5:5 new'^M
352 2010-03-17
13:02:45|16651|5:5|new|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 5^M
353 2010-03-17
13:02:45|16651|5:5|new|DataStructure.pm:is_parent_reservation(854)|returning
true: parent reservation ID for this request: 5^M
354 2010-03-17 13:02:45|16651|5:5|new|State.pm:initialize(121)|attempting
to load provisioning module: VCL::Module::Provisioning::esx^M
355 2010-03-17 13:02:45|16651|5:5|new|esx.pm:initialize(138)|esx vmware
toolkit root path found: /usr/lib/vmware-vcli/apps^M
356 2010-03-17 13:02:45|16651|5:5|new|esx.pm:initialize(140)|vmware ESX
module initialized^M
357 2010-03-17
13:02:45|16651|5:5|new|State.pm:initialize(127)|VCL::Module::Provisioning::esx
module loaded^M
358 2010-03-17 13:02:45|16651|5:5|new|Module.pm:new(132)|constructor
called, class=VCL::Module::Provisioning::esx^M
359 2010-03-17
13:02:45|16651|5:5|new|Module.pm:new(154)|VCL::Module::Provisioning::esx object
created^M
360 2010-03-17 13:02:45|16651|5:5|new|esx.pm:initialize(138)|esx vmware
toolkit root path found: /usr/lib/vmware-vcli/apps
361 2010-03-17 13:02:45|16651|5:5|new|esx.pm:initialize(140)|vmware ESX
module initialized^M
362 2010-03-17
13:02:45|16651|5:5|new|State.pm:initialize(131)|VCL::Module::Provisioning::esx
provisioner object created^M
363 2010-03-17 13:02:45|16651|5:5|new|State.pm:initialize(145)|attempting
to load OS module: VCL::Module::OS::Windows::Version_5::XP^M
364 2010-03-17
13:02:45|16651|5:5|new|State.pm:initialize(151)|VCL::Module::OS::Windows::Version_5::XP
module loaded^M
365 2010-03-17 13:02:45|16651|5:5|new|Module.pm:new(132)|constructor
called,
Current SVN: missing .ht-inc/php5extras.php
Hi All, Following the current instructions on installing the VCL Frontend Web Code results in a error at step 12; With a little debugging found that in file .ht-inc/utils.php at line 110 currently, the code fails to find require_once(.ht-inc/php5extras.php); I see that the documentation mentions to edit the .ht-inc/php5extras.php at the end, but One wouldn't know if that's really an issue to begin with. Is this file .ht-inc/php5extras.php supposed to be in new svn? I could be wrong! Please advise. Thank you, Amit
