VCL board report due on Nov 9th

2011-11-03 Thread Josh Thompson
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

The November board report is due this coming Wednesday.  It is really pretty 
easy to do and a simple way to get a little more involved with the VCL 
community.  The following page explains what needs to be done to create it, 
including explaining how to just copy the last one so that you can just make a 
few changes to it instead of having to write it from scratch.

https://cwiki.apache.org/confluence/display/VCL/Board+Reports

Josh
- -- 
- ---
Josh Thompson
VCL Developer
North Carolina State University

my GPG/PGP key can be found at pgp.mit.edu
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)

iEYEARECAAYFAk6yjGkACgkQV/LQcNdtPQPiUACfbPP92dHrvBiYH32EyzbIprTW
U5sAnieYhlSUySnfhmVMxT0G3GbfbG7y
=4H51
-END PGP SIGNATURE-


Re: Linux base image on ESXi server?

2011-11-03 Thread Dmitri Chebotarov
Hi

After some progress yesterday I still got an error while creating an image.
The error was:

...
2011-11-02
13:40:38|6392|14:3|image|vSphere_SDK.pm:_get_file_info(2005)|searching for
matching file paths: base directory path: '[datastore1]
vmwarelinux-238-v0', search pattern: 'vmwarelinux-238-v0.vmdk'
2011-11-02
13:40:40|6392|14:3|image|vSphere_SDK.pm:_get_file_info(2016)|base directory
does not exist: '[datastore1] vmwarelinux-238-v0'
2011-11-02
13:40:40|6392|14:3|image|vSphere_SDK.pm:find_files(1753)|matching file
count: 0
2011-11-02 13:40:40|6392|14:3|image|vSphere_SDK.pm:file_exists(1625)|file
does not exist: [datastore1] vmwarelinux-238-v0/vmwarelinux-238-v0.vmdk
2011-11-02 13:40:40|6392|14:3|image|VMware.pm:does_image_exist(3915)|image
does not exist in the non-persistent directory on the VM host
|6392|14:3|image|  WARNING 
|6392|14:3|image| 2011-11-02
13:40:40|6392|14:3|image|VMware.pm:_get_datastore_name(5848)|unable to
determine datastore name from path: '/vclfile', path does not begin with
any of the datastore paths:
|6392|14:3|image| '[datastore1]'
|6392|14:3|image| '/vmfs/volumes/datastore1'
|6392|14:3|image| '/vmfs/volumes/4e72606b-01b8dc93-5cdb-0023aeae26d2'
...

I'll figure out how to fix it, but have a related questions.

Creating the image failed and during the process vm-00 was put in 'maintains'
mode (stateid=10) and it stays in this mode after failure. It's not
possible to change the mode to 'available' (get the message - Virtual
machines can only be added in the maintenance state.) via web portal. Looks
like I need to re-add vm-00 (have to use 'Add multiple' option) or to
change stateid value in vcl.computer : UPDATE `vcl`.`computer` SET
`stateid` = '2' WHERE `computer`.`id` =36

Is it OK to do it this way? Or am I missing something?

Thanks.

On Wed, Nov 2, 2011 at 4:50 PM, Dmitri Chebotarov 4dim...@gmail.com wrote:

 Hi

 I got some progress on this issue. I tried to run vmware-cmd from
 vcl-server and got the same error - Server version unavailable at  ,
 which could mean SSL certificate is missing. Then found this post
 http://communities.vmware.com/message/1347703 and added these two lines
 to /usr/local/vcl/lib/VCL/Module/Provisioning/VMware/vSphere_SDK.pm after
 line 62

 $ENV{SSL_verify_mode} = 0x00;
 $ENV{PERL_LWP_SSL_VERIFY_HOSTNAME} = 0;

 This change allowed image creation to start successfully. VCLD connects to
 ESXi server OK and gets server version. It doesn't use ssh keys from
 /etc/vcl/vcl.key, but username/password configured in the profile.

 Thanks.


 On Wed, Nov 2, 2011 at 3:45 PM, Dmitri Chebotarov 4dim...@gmail.comwrote:

 Hello

 Got this link from one of the posts on this elist -
 https://sites.google.com/a/ncsu.edu/vcl-bootcamp/. I hope it helps me
 understand the VCL better...
 Can you recommend anything else to read about Apache VCL, besides
 https://cwiki.apache.org/VCL/ ?

 Thanks.


 On Tue, Nov 1, 2011 at 1:22 PM, Dmitri Chebotarov 4dim...@gmail.comwrote:

 Hi All

 I'm stuck on creating a base image (Linux) for newly deployed Apache VCL
 system and looking for help...
 This is the closes I got so far to a working system.
 I'm using ESXi 4.1 (60 days evaluation), ssh is enabled, ESXi server
 name is esxiServer01, added to the host file on VCL management server.
 Linux server being imaged is vm-00 running on esxiServer01. Added to the
 host file as well on VCL server. I can ping both and ssh -i key host works.

 Below is the full log for the process. These lines puzzle me:

 2011-11-01
 08:40:59|16965|20:20|image|OS.pm:is_ssh_responding(405)|esxiServer01 is NOT
 responding to SSH, SSH command failed, port 22: open, port 24: closed

 2011-11-01 08:40:59|16965|20:20|image|VMware.pm:initialize(257)|unable
 to control OS of VM host esxiServer01 using VCL::Module::OS::Linux::UnixLab
 OS object because VM host is not responding to SSH

 since I can ping the VM host and 'ssh -i /etc/vcl/vcl.key esxiServer01'
 works fine.

 Also all http(s) links work fine when I access them from management
 server.

 Is there a way to create and register images manually? Can I use Veeam
 FastSCP or similar software to copy VMs to VCL server and register them? If
 there is way to do so, anyone has a link?

 I would appreciate any help. Thank you.

 Here is the full log file for the imaging process:

VCL::image object could not be created and initialized
 
 time: 2011-11-01 08:40:59
 caller: vcld:make_new_child(571)
 ( 0) vcld, make_new_child (line: 571)
 (-1) vcld, main (line: 346)
 
 management node: vcl-01
 reservation PID: 16965
 parent vcld PID: 5086

 request ID: 20
 reservation ID: 20
 request state/laststate: image/image
 request start time: 2011-11-01 08:40:49
 request end time: 2011-11-01 09:40:49
 for imaging: no
 log ID: none

 computer: vm-00
 computer id: 23
 computer type: virtualmachine
 computer eth0 MAC 

Re: Linux base image on ESXi server?

2011-11-03 Thread Aaron Coburn
Dmitri,

If you go to the 'Computer Utilities' screen under manage computers, you will 
be able to change the computer's state. It sounds like you are trying to modify 
the state from the 'Edit Computer Information' page, which is not where that 
should be done.

Aaron



--
Aaron Coburn
Systems Administrator and Programmer
Academic Technology Services, Amherst College






On Nov 3, 2011, at 10:32 AM, Dmitri Chebotarov wrote:

 Hi
 
 After some progress yesterday I still got an error while creating an image. 
 The error was: 
 
 ...
 2011-11-02 
 13:40:38|6392|14:3|image|vSphere_SDK.pm:_get_file_info(2005)|searching for 
 matching file paths: base directory path: '[datastore1] vmwarelinux-238-v0', 
 search pattern: 'vmwarelinux-238-v0.vmdk'
 2011-11-02 13:40:40|6392|14:3|image|vSphere_SDK.pm:_get_file_info(2016)|base 
 directory does not exist: '[datastore1] vmwarelinux-238-v0'
 2011-11-02 13:40:40|6392|14:3|image|vSphere_SDK.pm:find_files(1753)|matching 
 file count: 0
 2011-11-02 13:40:40|6392|14:3|image|vSphere_SDK.pm:file_exists(1625)|file 
 does not exist: [datastore1] vmwarelinux-238-v0/vmwarelinux-238-v0.vmdk
 2011-11-02 13:40:40|6392|14:3|image|VMware.pm:does_image_exist(3915)|image 
 does not exist in the non-persistent directory on the VM host
 |6392|14:3|image|  WARNING  
 |6392|14:3|image| 2011-11-02 
 13:40:40|6392|14:3|image|VMware.pm:_get_datastore_name(5848)|unable to 
 determine datastore name from path: '/vclfile', path does not begin with any 
 of the datastore paths:
 |6392|14:3|image| '[datastore1]'
 |6392|14:3|image| '/vmfs/volumes/datastore1'
 |6392|14:3|image| '/vmfs/volumes/4e72606b-01b8dc93-5cdb-0023aeae26d2'
 ...
 
 I'll figure out how to fix it, but have a related questions. 
 
 Creating the image failed and during the process vm-00 was put in 'maintains' 
 mode (stateid=10) and it stays in this mode after failure. It's not possible 
 to change the mode to 'available' (get the message - Virtual machines can 
 only be added in the maintenance state.) via web portal. Looks like I need to 
 re-add vm-00 (have to use 'Add multiple' option) or to change stateid value 
 in vcl.computer : UPDATE `vcl`.`computer` SET `stateid` = '2' WHERE 
 `computer`.`id` =36
 
 Is it OK to do it this way? Or am I missing something?
 
 Thanks.
 
 On Wed, Nov 2, 2011 at 4:50 PM, Dmitri Chebotarov 4dim...@gmail.com wrote:
 Hi
 
 I got some progress on this issue. I tried to run vmware-cmd from vcl-server 
 and got the same error - Server version unavailable at  , which could mean 
 SSL certificate is missing. Then found this post 
 http://communities.vmware.com/message/1347703 and added these two lines to 
 /usr/local/vcl/lib/VCL/Module/Provisioning/VMware/vSphere_SDK.pm after line 62
 
 $ENV{SSL_verify_mode} = 0x00;
 $ENV{PERL_LWP_SSL_VERIFY_HOSTNAME} = 0;
 
 This change allowed image creation to start successfully. VCLD connects to 
 ESXi server OK and gets server version. It doesn't use ssh keys from 
 /etc/vcl/vcl.key, but username/password configured in the profile.
 
 Thanks.
 
 
 On Wed, Nov 2, 2011 at 3:45 PM, Dmitri Chebotarov 4dim...@gmail.com wrote:
 Hello
 
 Got this link from one of the posts on this elist - 
 https://sites.google.com/a/ncsu.edu/vcl-bootcamp/. I hope it helps me 
 understand the VCL better... 
 Can you recommend anything else to read about Apache VCL, besides 
 https://cwiki.apache.org/VCL/ ?
 
 Thanks.
 
 
 On Tue, Nov 1, 2011 at 1:22 PM, Dmitri Chebotarov 4dim...@gmail.com wrote:
 Hi All
 
 I'm stuck on creating a base image (Linux) for newly deployed Apache VCL 
 system and looking for help...
 This is the closes I got so far to a working system. 
 I'm using ESXi 4.1 (60 days evaluation), ssh is enabled, ESXi server name is 
 esxiServer01, added to the host file on VCL management server. Linux server 
 being imaged is vm-00 running on esxiServer01. Added to the host file as well 
 on VCL server. I can ping both and ssh -i key host works.
 
 Below is the full log for the process. These lines puzzle me:
 
 2011-11-01 
 08:40:59|16965|20:20|image|OS.pm:is_ssh_responding(405)|esxiServer01 is NOT 
 responding to SSH, SSH command failed, port 22: open, port 24: closed
 2011-11-01 08:40:59|16965|20:20|image|VMware.pm:initialize(257)|unable to 
 control OS of VM host esxiServer01 using VCL::Module::OS::Linux::UnixLab OS 
 object because VM host is not responding to SSH
 
 since I can ping the VM host and 'ssh -i /etc/vcl/vcl.key esxiServer01' works 
 fine. 
 
 Also all http(s) links work fine when I access them from management server.
 
 Is there a way to create and register images manually? Can I use Veeam 
 FastSCP or similar software to copy VMs to VCL server and register them? If 
 there is way to do so, anyone has a link?
 
 I would appreciate any help. Thank you.
 
 Here is the full log file for the imaging process:
 
 VCL::image object could not be created and initialized
 
 time: 2011-11-01 

Re: Linux base image on ESXi server?

2011-11-03 Thread Josh Thompson
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Dmitri,

Aaron is correct that you need to do it under Computer Utilities.

However, it is okay to change the state under Edit Computer Information.  
There just happens to be a bug in 2.2.1 that keeps you from being able to 
change the state for virtual computers.  I've fixed it for the 2.3 release.

Josh

On Thursday November 03, 2011, Aaron Coburn wrote:
 Dmitri,
 
 If you go to the 'Computer Utilities' screen under manage computers, you
 will be able to change the computer's state. It sounds like you are trying
 to modify the state from the 'Edit Computer Information' page, which is
 not where that should be done.
 
 Aaron
- -- 
- ---
Josh Thompson
VCL Developer
North Carolina State University

my GPG/PGP key can be found at pgp.mit.edu
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)

iEYEARECAAYFAk6yqysACgkQV/LQcNdtPQNG2gCeO5IkG8KZan4657xneiu+J76e
XlAAn1RXskIyz5dT/w4xvgidAOZgBDyl
=jPaK
-END PGP SIGNATURE-


Re: Base Image creation - problems - PLEASE HELP

2011-11-03 Thread Evelio Quiros
Hello,

Ok, I actually have tried many times to create a base image. I had it with NIC 
1 in the private network and NIC 2 in the public previously.

Each time, when VCL deletes my base image and copies it back to the VM server, 
the networks on the nics are REVERSED.

When I start with nic 1 in Private and nic 2 in Public, it ends up with nic 1 
in Pub and nic 2 in Priv.
When I start with nic 1 in Public and nic 2 in Private, it ends up with nic 1 
in Priv and nic 2 in Pub.

The VM host profile has Virtual Switch 0 in Public and Virtual Switch 1 in 
Private.
The DHCP server is only listening on the private network.
I see unauthorized dhcp requests come in for public network IP addresses when 
VCL swaps them.

In the last attempt, I did something new: When the new image is brought up, I 
manually swapped the nics back before VCL times out waiting for the image to 
boot.
At that time, it declares the image a success, but it should not need such 
manual intervention.

Any clues why VCL decides to swap the networks ?

Al Quiros


From: Aaron Coburn acob...@amherst.edumailto:acob...@amherst.edu
Reply-To: vcl-user@incubator.apache.orgmailto:vcl-user@incubator.apache.org
Date: Wed, 2 Nov 2011 16:24:02 -0400
To: vcl-user@incubator.apache.orgmailto:vcl-user@incubator.apache.org
Subject: Re: Base Image creation - problems - PLEASE HELP

Evelio,
in our VCL setup and according to the docs on this page:

https://cwiki.apache.org/confluence/display/VCL/Create+a+Windows+Base+Image

you may want to try configuring your base image to use NIC 1 for the private 
network and NIC 2 for the public network.

The sshd configuration script that you ran on your base image typically closes 
ssh access over the public network, but if the two networks are switched, you 
may have inadvertently cut off access over the private network.

Aaron



--
Aaron Coburn
Systems Administrator and Programmer
Academic Technology Services, Amherst College
(413) 542-5451 acob...@amherst.edumailto:acob...@amherst.edu





On Nov 2, 2011, at 4:09 PM, Evelio Quiros wrote:

Hello,
Ok, I'm stumped.
I continue to have issues creating a base image on our vcl setup.

Here is my info:

I have a single server running web, management node, and database.
It has two interfaces, one on our private network, another on our public net.

I have a single Vmware server, also with two interfaces.
One interface, switch 0, is on our public net. It also has the VM management 
net.
Another interface, switch 1, is on our private net.
Each of these switches is labeled the same as in the Management node config.

When I create the base image to capture,
I create eth0 (nic1) on the public network, then
I create eth1 (nic2) on the private network.

I set them both to dhcp, and the dhcp server on the VCL server responds
and gives it an address of an image in my database.
I set the ssh key in the new image.
I set the image in /etc/hosts so that the server can resolve it.

I set the vcld to capture the image,
It begins and copies the image to the management node directory,
It deletes the image from the Vmware server, and re-creates the image
All well and good.

but then :
When the recreated image comes up,
The OTHER interface begins asking the dhcp server for addresses in the public 
network.
The dhcp server denies it as non-authoritative, and the private interface never 
comes up.
Even though it was able to dhcp previously.
The image creation completes successfully,
but the newly created image cannot connect to the vcl server.
So, I eventually get a failure message from VCL.

WHAT GIVES ???

Here is my error email:

reservation failed on image6: process failed after trying to load or make 
available

time: 2011-11-02 16:05:30
caller: State.pm:reservation_failed(213)
( 0) State.pm, reservation_failed (line: 213)
(-1) new.pm, process (line: 298)
(-2) vcld, make_new_child (line: 568)
(-3) vcld, main (line: 346)

management node: vcltst.fiu.eduhttp://vcltst.fiu.edu
reservation PID: 29777
parent vcld PID: 23341

request ID: 11
reservation ID: 11
request state/laststate: reload/image
request start time: 2011-11-02 15:53:56
request end time: 2011-11-02 16:23:56
for imaging: no
log ID: none

computer: image6
computer id: 7
computer type: virtualmachine
computer eth0 MAC address: 00:50:56:00:10:0a
computer eth1 MAC address: 00:50:56:00:10:0b
computer private IP address: 10.0.0.9
computer public IP address: 10.106.128.59
computer in block allocation: no
provisioning module: VCL::Module::Provisioning::VMware::VMware

vm host: vcldell01
vm host ID: 1
vm host computer ID: 1
vm profile: VMware ESX - local storage
vm profile VM path: /vmfs/volumes/datastore1
vm profile repository path: /images
vm profile datastore path: /vmfs/volumes/datastore1
vm profile disk type: localdisk

image: vmwarelinux-redhatbase10-v0
image display name: redhatbase
image ID: 10

Re: Base Image creation - problems - PLEASE HELP

2011-11-03 Thread Josh Thompson
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Al,

I haven't worked with setting up VM hosts much, but it sounds like you need to 
swap your Virtual Switches so that Virtual Switch 0 is Private and Virtual 
Switch 1 is Public.

Give that a try and let us know how it works.

Josh

On Thursday November 03, 2011, Evelio Quiros wrote:
 Hello,
 
 Ok, I actually have tried many times to create a base image. I had it with
 NIC 1 in the private network and NIC 2 in the public previously.
 
 Each time, when VCL deletes my base image and copies it back to the VM
 server, the networks on the nics are REVERSED.
 
 When I start with nic 1 in Private and nic 2 in Public, it ends up with nic
 1 in Pub and nic 2 in Priv. When I start with nic 1 in Public and nic 2 in
 Private, it ends up with nic 1 in Priv and nic 2 in Pub.
 
 The VM host profile has Virtual Switch 0 in Public and Virtual Switch 1 in
 Private. The DHCP server is only listening on the private network.
 I see unauthorized dhcp requests come in for public network IP addresses
 when VCL swaps them.
 
 In the last attempt, I did something new: When the new image is brought up,
 I manually swapped the nics back before VCL times out waiting for the
 image to boot. At that time, it declares the image a success, but it
 should not need such manual intervention.
 
 Any clues why VCL decides to swap the networks ?
 
 Al Quiros
- -- 
- ---
Josh Thompson
VCL Developer
North Carolina State University

my GPG/PGP key can be found at pgp.mit.edu
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.17 (GNU/Linux)

iEYEARECAAYFAk6y97gACgkQV/LQcNdtPQMiqgCeK06HLp+6QIYobUvQD1FssukV
sSkAn11mo1/j4wUmD98gDI8ZF718kQUF
=T16z
-END PGP SIGNATURE-