VCL Appliance
I have been unable to download the VCL appliance. The torrent appears to not have any seeders and the http link appears to be broken. How do I download it? -- Mark Gardner --
Re: VCL Appliance
The http link is not broken, just horribly slow. At the current rate, it will take 3-4 days to download it. Does anyone have a faster copy? Mark On 4/6/09, Mark Gardner wrote: > > I have been unable to download the VCL appliance. The torrent appears to > not have any seeders and the http link appears to be broken. How do I > download it? > > -- > Mark Gardner > -- -- Mark Gardner --
Migrate to VCL 2.1
Are there any hints on the best way to migrate from a release candidate to 2.1? (I believe I am running vcl-2.1.r835953.) It seems that the most important problem is migrating the database. The management and web code should be swapped out pretty easily. Mark -- Mark Gardner --
Re: proposed change to release Road Map
We are still using VMware Server so I would vote "yes". (We also use Xen, VirtualBox, and KVM prioritized in that order.) Mark On Tue, Feb 9, 2010 at 12:04 PM, Josh Thompson wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > When we released VCL 2.1, we had the following road map for 2.2 and 2.3: > > VCL 2.2 > >* support for xCAT 2.3 >* improve cluster reservations >* improve block reservations(rename to block allocations) > > VCL 2.3 > >* Service deployments >* power management >* VMWare Free Server 2.x > > I'd like to propose swapping "improve cluster reservations" and "VMWare > Free > Server 2.x". We don't hear much about people using cluster reservations, > and > they work fairly well if you only have one management node. Windows 7 > works > much better under VMWare Free Server 2.x; so, it would probably provide > more > value to everyone to get that support added in sooner than reworking the > cluster reservation code. That would give us this road map: > > VCL 2.2 > >* support for xCAT 2.3 >* VMWare Free Server 2.x >* improve block reservations(rename to block allocations) > > VCL 2.3 > >* Service deployments >* power management >* improve cluster reservations > > Any thoughts? > > Thanks, > Josh > - -- > - --- > Josh Thompson > Systems Programmer > Advanced Computing | VCL Developer > North Carolina State University > > josh_thomp...@ncsu.edu > 919-515-5323 > > my GPG/PGP key can be found at pgp.mit.edu > -BEGIN PGP SIGNATURE- > Version: GnuPG v1.4.6 (GNU/Linux) > > iD8DBQFLcZWMV/LQcNdtPQMRAlt6AJ9KXTnKRvvAQbu/vXbOlZMR1TC0ugCfXuv0 > xZbkJWpfzWJMgdlzAClghMw= > =mY43 > -END PGP SIGNATURE- > -- Mark Gardner --
Management node not checking in with the database
I have worked my way through the database installation, the web code installation, and am now nearly through http://cwiki.apache.org/confluence/display/VCL/Management+Node+Installationbut I never see the management node check in with the database as end of the page suggests. I have gone back and rechecked but didn't find anything a miss. What is the best way to debug this problem? Mark -- Mark Gardner --
Preferred Image ID not set
I was trying to capture my first image and received the following error message in vcld.log. What should preferredimageid be? Do I set it by updating the computer table or is there another way? |641|1:1|image| WARNING |641|1:1|image| 2010-03-05 12:32:17|641|1:1|image|utils.pm:get_request_info(5218)|preferredimageid is not set for computer id=1 |641|1:1|image| ( 0) utils.pm, notify (line: 737) |641|1:1|image| (-1) utils.pm, get_request_info (line: 5218) |641|1:1|image| (-2) vcld, main (line: 280) Extra info: 1) using Dell 1850s 2) Webserver, database and management all on one node (vcl-01) 3) vcl-01 is also being used as a compute node 4) VMware Server 1.0.9 Mark -- Mark Gardner --
Re: Management node not checking in with the database
Here is the complete contents of /var/log/vcld.log: === OUTPUT for vcld run on 2010-03-01 13:39:24 === 2010-03-01 13:39:24|27508|utils.pm:rename_vcld_process(7901)|renamed process to 'vcld vcld' 2010-03-01 13:39:24|27508|vcld:main(149)|vcld started on vcl-01.cc.vt.edu.mgt I expect to begin seeing last checking time messages but don't. I checked to make sure that I can manually login to the vcl database using the values for LockerWrtUser and wrtPass so I don't think that is the problem. Mark On Mon, Mar 1, 2010 at 2:36 PM, Aaron Peeler wrote: > Hi Mark, > > Is vcld able to start on the management node? > > It's output will be writing to /var/log/vcld.log which will include in > database connection issues. > > Aaron > > > On 3/1/10 2:11 PM, Mark Gardner wrote: > >> I have worked my way through the database installation, the web code >> installation, and am now nearly through >> >> http://cwiki.apache.org/confluence/display/VCL/Management+Node+Installationbut >> I never see the management node check in with the database as end of >> the >> page suggests. I have gone back and rechecked but didn't find anything a >> miss. What is the best way to debug this problem? >> >> Mark >> >> >> > > > -- > > Aaron Peeler > Program Manager > Virtual Computing Lab > NC State University > aaron_pee...@ncsu.edu > 919-513-4571 > > -- Mark Gardner --
Re: Management node not checking in with the database
Aaron, I figured out the problem. I needed to make sure to supply the -v option to vcld. It was working all along but I just didn't see it. BTW, I am installing on Debian 5.0 "Lenny" rather than RH/Centos. Thus I had to write a different init.d script and in doing so I forgot to add the DAEMON_OPTIONS. At any rate, I plan to check the changes back in when I get it all working. Should I also be creating/updating a wiki page for this? Mark On Tue, Mar 2, 2010 at 11:26 AM, Mark Gardner wrote: > Here is the complete contents of /var/log/vcld.log: > > === > OUTPUT for vcld run on 2010-03-01 13:39:24 > === > 2010-03-01 13:39:24|27508|utils.pm:rename_vcld_process(7901)|renamed > process to 'vcld vcld' > 2010-03-01 13:39:24|27508|vcld:main(149)|vcld started on > vcl-01.cc.vt.edu.mgt > > I expect to begin seeing last checking time messages but don't. I checked > to make sure that I can manually login to the vcl database using the values > for LockerWrtUser and wrtPass so I don't think that is the problem. > > Mark > > On Mon, Mar 1, 2010 at 2:36 PM, Aaron Peeler wrote: > >> Hi Mark, >> >> Is vcld able to start on the management node? >> >> It's output will be writing to /var/log/vcld.log which will include in >> database connection issues. >> >> Aaron >> >> >> On 3/1/10 2:11 PM, Mark Gardner wrote: >> >>> I have worked my way through the database installation, the web code >>> installation, and am now nearly through >>> >>> http://cwiki.apache.org/confluence/display/VCL/Management+Node+Installationbut >>> I never see the management node check in with the database as end of >>> the >>> page suggests. I have gone back and rechecked but didn't find anything a >>> miss. What is the best way to debug this problem? >>> >>> Mark >>> >>> >>> >> >> >> -- >> >> Aaron Peeler >> Program Manager >> Virtual Computing Lab >> NC State University >> aaron_pee...@ncsu.edu >> 919-513-4571 >> >> > > > -- > Mark Gardner > -- > -- Mark Gardner --
grep not found
For some reason, I am getting an error message that grep cannot be found while trying to establish a new reservation for my first captured image. It works fine when I execute the du-grep pipeline from the command line. Any idea what I am doing wrong? 2010-03-15 15:08:10|9312|5:5|new|new.pm:reload_image(616)|calling VCL::Module::Provisioning::vmware->does_image_exist() 2010-03-15 15:08:10|9312|5:5|new|vmware.pm:does_image_exist(2018)|image repository path: /images/vmware 2010-03-15 15:08:10|9312|5:5|new|utils.pm:run_command(9737)|executed command: du -c /images/vmware/*xubuntu_9.10_vmware_base-v0* 2>&1 | grep total 2>&1, pid: 9328, exit status: 1, output: |9312|5:5|new| sh: grep: command not found |9312|5:5|new| WARNING |9312|5:5|new| 2010-03-15 15:08:10|9312|5:5|new|vmware.pm:does_image_exist(2058)|du output does not contain a total line: |9312|5:5|new| sh: grep: command not found |9312|5:5|new| ( 0) utils.pm, notify (line: 737) |9312|5:5|new| (-1) vmware.pm, does_image_exist (line: 2058) |9312|5:5|new| (-2) new.pm, reload_image (line: 618) |9312|5:5|new| (-3) new.pm, process (line: 266) |9312|5:5|new| (-4) vcld, make_new_child (line: 594) |9312|5:5|new| (-5) vcld, main (line: 341) Mark -- Mark Gardner --
Easy way to search mail archive?
Has anyone found an easy way to search the mail archive? I suspect that at least some of my questions have been answered before but I am finding it very tedious to check before I post. Mark -- Mark Gardner --
Creating and registering first (VMware) image
I have installed the database, web pages, and management nodes and they appear to be working correctly. (There are no errors in the logs.) Now I am at the stage where I need to create and register the base VMware server image that will be duplicated when requests are made. I have VMware Server 1.0.9 installled and have created a clean XUbuntu 9.10 installation. As per http://cwiki.apache.org/confluence/display/VCL/Create+a+Linux+Base+Image, I have created the rc.local in the guest that sets up the sshd_config/ext_sshd_config files. I am able to ssh in without a key from the management node after rebooting the image. Note: I am not sure I have fulfilled the compute node requirement but Linux is running on the hardware and I have added it to the database as shown below. # Click "Manage Computers" # Select the "Add Single Computer" radio button # Click the Submit # Fill in Hostname: vhost-01 # IP Address: 172.16.1.1 # State: available # Owner: ad...@local # Platform: i386 # Schedule: VCL 24x7 # RAM: 3072 # CPU: 2 # Proc Speed: 2800 # Network Speed: 100 # Type: virtualmachine # Provisioning engine: VMware Server GSX # Click checkbox: allcomputers, newimages, newvmimages # Click Confirm Computer # Click Submit At this point I don't have a mental model of what should happen and I am not sure what to do next. According to the "Add a New Image to the VCL Database" section of http://cwiki.apache.org/confluence/display/VCL/Create+a+Linux+Base+Image it looks like I should be pushing stuff into the database. (Is there a diagram or something that shows how the foreign keys in the database tables relate to other fields?) However, it also looks like http://cwiki.apache.org/confluence/display/VCL/Configuring+a+Standalone+VMware+VCL+Environmentalso applies as I am going to use the server that the database, web server, and management software is installed on to run a few VMs. (I also have other servers that will be added to the system later. That is why I am not sure the standalone documentation applies.) I have been following what Terry McGuire did but I got lost at http://www.mail-archive.com/vcl-dev@incubator.apache.org/msg00776.html. Can someone give me an overview of what needs to happen? (Terry, do you have a list of the things you did to get your system working?) Mark -- Mark Gardner --
Wiki Down?
Is the wiki down? Mark -- Mark Gardner --
VM deleted while attempting to capture image in standalone installation (again)
3 | 16 |8 | 12 | |3 | 16 |9 | 12 | |3 | 16 | 13 | 12 | |3 | 16 | 14 | 12 | | 10 | 13 | 14 | 12 | +--+-+--+-+ 7 rows in set (0.00 sec) === END mysql tables === Mark -- Mark Gardner --
Cannot open disk
Making a bit of progress... Hit another snag. After the image is copied, it
tries to start it up but hits an error because the VM requires user input:
|32571|10:10|new| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x
localvmhost 'vmware-cmd
/home/vm/vmware/vmwarelinux-xubuntu904-v0vmguest-1/vmwarelinux-xubuntu904-v0vmguest-1.vmx
start' 2>&1
...
|32571|10:10|new| VMControl error -16: Virtual machine requires user input
to continue
Starting the VM up in the vmware GUI client gives the error "Cannot open the
disk
'/images/vmware/vmwarelinux-xubuntu904-v0/vmwarelinux-xubuntu904-v0.vmdk' or
one of the snapshot disks it depends on. Reason: Failed to lock the file.".
The disk image exists:
$ ls -l
/images/vmware/vmwarelinux-xubuntu904-v0/vmwarelinux-xubuntu904-v0.vmdk
2524548 -rw--- 1 root root 2524544 Apr 28 09:53
/images/vmware/vmwarelinux-xubuntu904-v0/vmwarelinux-xubuntu904-v0.vmdk
As far as I can tell, there are no locks on the disk anyware.
I am enclosing the vcld.log.
Thanks in advance,
Mark
--
Mark Gardner
--
===
OUTPUT for vcld run on 2010-04-28 09:53:22
===
2010-04-28 09:53:22|32550|vcld:main(116)|vcld environment variable set to 1 for this process
2010-04-28 09:53:22|32550|utils.pm:rename_vcld_process(7901)|renamed process to 'vcld vcld'
2010-04-28 09:53:22|32550|utils.pm:get_management_node_info(6815)|management node info retrieved from database for localhost
2010-04-28 09:53:22|32550|vcld:main(127)|retrieved management node information from database
2010-04-28 09:53:22|32550|vcld:main(140)|management_node_id environment variable set: 1
2010-04-28 09:53:22|32550|vcld:main(148)|management node checkin interval is 5 seconds
2010-04-28 09:53:22|32550|vcld:main(149)|vcld started on localhost
2010-04-28 09:53:27|32550|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-28 09:53:27
...
2010-04-28 09:53:42|32550|vcld:main(165)|lastcheckin time updated for management node 1: 2010-04-28 09:53:42
2010-04-28 09:53:42|32550|10:10|new|utils.pm:reservation_being_processed(9634)|computerloadlog 'begin' entry does NOT exist for reservation 10
2010-04-28 09:53:42|32550|10:10|new|utils.pm:reservation_being_processed(9686)|reservation is NOT currently being processed
2010-04-28 09:53:42|32550|10:10|new|vcld:main(276)|reservation 10 is NOT already being processed
2010-04-28 09:53:42|32550|10:10|new|utils.pm:get_request_info(5354)|standalone affiliation found: Local
2010-04-28 09:53:42|32550|10:10|new|utils.pm:get_management_node_info(6815)|management node info retrieved from database for localhost
2010-04-28 09:53:42|32550|10:10|new|vcld:main(281)|retrieved request information from database
2010-04-28 09:53:42|32550|10:10|new|utils.pm:get_management_node_info(6815)|management node info retrieved from database for localhost
2010-04-28 09:53:42|32550|10:10|new|DataStructure.pm:is_parent_reservation(854)|returning true: parent reservation ID for this request: 10
2010-04-28 09:53:42|32550|10:10|new|utils.pm:update_request_state(2186)|request 10 state updated to: pending, laststate to: new
2010-04-28 09:53:42|32550|10:10|new|utils.pm:insertloadlog(4710)|inserted computer=2, begin, beginning to process, state is new
2010-04-28 09:53:42|32550|10:10|new|vcld:make_new_child(509)|loaded VCL::new module
2010-04-28 09:53:42|32550|10:10|new|vcld:make_new_child(566)|current number of forked kids: 1
2010-04-28 09:53:42|32571|10:10|new|vcld:make_new_child(582)|vcld environment variable set to 0 for this process
2010-04-28 09:53:42|32571|10:10|new|Module.pm:new(132)|constructor called, class=VCL::new
2010-04-28 09:53:42|32571|10:10|new|Module.pm:new(154)|VCL::new object created
2010-04-28 09:53:42|32571|10:10|new|State.pm:initialize(85)|obtained a database handle for this state process, stored as $ENV{dbh}
2010-04-28 09:53:42|32571|10:10|new|State.pm:check_image_os(820)|no corrections need to be made, not an imaging request, returning 1
2010-04-28 09:53:42|32571|10:10|new|DataStructure.pm:is_parent_reservation(854)|returning true: parent reservation ID for this request: 10
2010-04-28 09:53:42|32571|10:10|new|utils.pm:rename_vcld_process(7863)|reservation count: 1
2010-04-28 09:53:42|32571|10:10|new|utils.pm:rename_vcld_process(7882)|PARENTIMAGE: 1
2010-04-28 09:53:42|32571|10:10|new|utils.pm:rename_vcld_process(7883)|SUBIMAGE: 0
2010-04-28 09:53:42|32571|10:10|new|utils.pm:rename_vcld_process(7901)|renamed process to 'vcld VCL::new 10:10 new'
2010-04-28 09:53:42|32571|10:10|new|DataStructure.pm:is_parent_reservation(854)|returning true: parent reservation ID for this request: 10
2010-04-28 09:53:42|32571|10:10|new|DataStructure.pm:is_parent_reservation(854)|returning true: parent reservation ID for this request: 10
2010-04-28 09:53:42|32571|10:10|new|State.pm:initialize(121)|attempting to load provisioning module: VC
Re: VM deleted while attempting to capture image in standalone installation (again)
OK. That makes sense. I had a symlink between /home/vm/vmware and /images/vmware. I have removed it. My original vm image is in /home/vm/vmware and the cloned image should be in /images/vmware. Do I set datastorepath to /home/vm/vmware and vmpath to /images/vmware? Mark On Mon, Apr 26, 2010 at 12:21 PM, Aaron Peeler wrote: > Hi Mark, > > Sorry you ran into this, unfortunately this is an unexpected event of > running a vcl setup in standalone mode. > > https://cwiki.apache.org/VCL/configuring-a-standalone-vmware-vcl-environment.html > > Do you have separate locations for your image library and your running vms? > It looks like you might be using the same location /images/vmware. > > This is the intended behavior of the vmware.pm module when using local > disk. The idea behind this is to keep the disk on the vmware host server > freed up and not have too many non-running vmware disk images residing on > the remote machine. Also the same would happen if the disk usage would be > close to full for the partition where the virtual machine path was defined. > But since the vmware host server and the vcl management node are on the same > box, I can see where this can happen if not careful. In this setup vcld(the > management node) assumes that the remote localvmhost server is a different > machine, etc and that the copy of the image on the vcld management node > server is safe. > > Looking at your logs. > > The part around 10:31:53 reports the vm is on but appears could not ssh > into it. Thus it returned a RELOAD flag. > The the load routine calls control_VM routine to clear any possible vms > running with that hostname vmguest-1 > So it finds a vm running out of /home/vm/vmware and stops and removes it. > > > /home/vm/vmware/vmwarelinux-xubuntu904-v0vmguest-1/vmwarelinux-xubuntu904-v0vmguest-1.vmx > > I'm not sure where this is coming from, since /home/vm/vmware is not in > your vmprofile table. > Could this be one you manually fired up? > Is /home/vm/vmware a symlink to /images/vmware? > > Anyway, when using the standalone mode(not recommended for anything > production) please make sure to have a separate directory or partition for > your stored vms and your running vms. > > Aaron > > > On 4/26/10 11:18 AM, Mark Gardner wrote: > >> [Still looking for help with this.] >> >> I have obviously misconfigured something... >> >> I have been working on a standalone system and have been systematically >> fixing errors I find in the logs. On the last attempt to make a >> reservation, >> the VMware Server virtual machine was unregistered and deleted. Needless >> to >> say it was definitely a surprise! >> >> I am enclosing vcld.log. The problem occurs at time 10:31:55. I am also >> enclosing selects from related tables. Your help in correcting this >> unexpected behavior would be greatly appreciated. >> >> == BEGIN vcld.log === >> === >> OUTPUT for vcld run on 2010-04-20 10:31:22 >> === >> 2010-04-20 10:31:22|25426|vcld:main(116)|vcld environment variable set to >> 1 >> for this process >> 2010-04-20 10:31:22|25426|utils.pm:rename_vcld_process(7901)|renamed >> process >> to 'vcld vcld' >> 2010-04-20 10:31:22|25426|utils.pm: >> get_management_node_info(6815)|management >> node info retrieved from database for localhost >> 2010-04-20 10:31:22|25426|vcld:main(127)|retrieved management node >> information from database >> 2010-04-20 10:31:22|25426|vcld:main(140)|management_node_id environment >> variable set: 1 >> 2010-04-20 10:31:22|25426|vcld:main(148)|management node checkin interval >> is >> 5 seconds >> 2010-04-20 10:31:22|25426|vcld:main(149)|vcld started on localhost >> 2010-04-20 10:31:27|25426|vcld:main(165)|lastcheckin time updated for >> management node 1: 2010-04-20 10:31:27 >> 2010-04-20 10:31:32|25426|vcld:main(165)|lastcheckin time updated for >> management node 1: 2010-04-20 10:31:32 >> 2010-04-20 10:31:37|25426|vcld:main(165)|lastcheckin time updated for >> management node 1: 2010-04-20 10:31:37 >> 2010-04-20 10:31:42|25426|vcld:main(165)|lastcheckin time updated for >> management node 1: 2010-04-20 10:31:42 >> 2010-04-20 10:31:47|25426|vcld:main(165)|lastcheckin time updated for >> management node 1: 2010-04-20 10:31:47 >> 2010-04-20 10:31:52|25426|vcld:main(165)|lastcheckin time updated for >> management node 1: 2010-04-20 10:31:52 >> 2010-04-20 10:31:52|25426|7:7|new|utils.pm: >> reservation_being_processed(9634)|computerloadlog >> '
Re: VM deleted while attempting to capture image in standalone installation (again)
Looks like I got that backwards. datastorepath should be /images/vmware and vmpath should be /home/vm/vmware. At least the master image is being copied... Mark On Wed, Apr 28, 2010 at 9:38 AM, Mark Gardner wrote: > OK. That makes sense. I had a symlink between /home/vm/vmware and > /images/vmware. I have removed it. > > My original vm image is in /home/vm/vmware and the cloned image should be > in /images/vmware. Do I set datastorepath to /home/vm/vmware and vmpath to > /images/vmware? > > Mark > > On Mon, Apr 26, 2010 at 12:21 PM, Aaron Peeler wrote: > >> Hi Mark, >> >> Sorry you ran into this, unfortunately this is an unexpected event of >> running a vcl setup in standalone mode. >> >> https://cwiki.apache.org/VCL/configuring-a-standalone-vmware-vcl-environment.html >> >> Do you have separate locations for your image library and your running >> vms? It looks like you might be using the same location /images/vmware. >> >> This is the intended behavior of the vmware.pm module when using local >> disk. The idea behind this is to keep the disk on the vmware host server >> freed up and not have too many non-running vmware disk images residing on >> the remote machine. Also the same would happen if the disk usage would be >> close to full for the partition where the virtual machine path was defined. >> But since the vmware host server and the vcl management node are on the same >> box, I can see where this can happen if not careful. In this setup vcld(the >> management node) assumes that the remote localvmhost server is a different >> machine, etc and that the copy of the image on the vcld management node >> server is safe. >> >> Looking at your logs. >> >> The part around 10:31:53 reports the vm is on but appears could not ssh >> into it. Thus it returned a RELOAD flag. >> The the load routine calls control_VM routine to clear any possible vms >> running with that hostname vmguest-1 >> So it finds a vm running out of /home/vm/vmware and stops and removes it. >> >> >> /home/vm/vmware/vmwarelinux-xubuntu904-v0vmguest-1/vmwarelinux-xubuntu904-v0vmguest-1.vmx >> >> I'm not sure where this is coming from, since /home/vm/vmware is not in >> your vmprofile table. >> Could this be one you manually fired up? >> Is /home/vm/vmware a symlink to /images/vmware? >> >> Anyway, when using the standalone mode(not recommended for anything >> production) please make sure to have a separate directory or partition for >> your stored vms and your running vms. >> >> Aaron >> >> >> On 4/26/10 11:18 AM, Mark Gardner wrote: >> >>> [Still looking for help with this.] >>> >>> I have obviously misconfigured something... >>> >>> I have been working on a standalone system and have been systematically >>> fixing errors I find in the logs. On the last attempt to make a >>> reservation, >>> the VMware Server virtual machine was unregistered and deleted. Needless >>> to >>> say it was definitely a surprise! >>> >>> I am enclosing vcld.log. The problem occurs at time 10:31:55. I am also >>> enclosing selects from related tables. Your help in correcting this >>> unexpected behavior would be greatly appreciated. >>> >>> == BEGIN vcld.log === >>> === >>> OUTPUT for vcld run on 2010-04-20 10:31:22 >>> === >>> 2010-04-20 10:31:22|25426|vcld:main(116)|vcld environment variable set to >>> 1 >>> for this process >>> 2010-04-20 10:31:22|25426|utils.pm:rename_vcld_process(7901)|renamed >>> process >>> to 'vcld vcld' >>> 2010-04-20 10:31:22|25426|utils.pm: >>> get_management_node_info(6815)|management >>> node info retrieved from database for localhost >>> 2010-04-20 10:31:22|25426|vcld:main(127)|retrieved management node >>> information from database >>> 2010-04-20 10:31:22|25426|vcld:main(140)|management_node_id environment >>> variable set: 1 >>> 2010-04-20 10:31:22|25426|vcld:main(148)|management node checkin interval >>> is >>> 5 seconds >>> 2010-04-20 10:31:22|25426|vcld:main(149)|vcld started on localhost >>> 2010-04-20 10:31:27|25426|vcld:main(165)|lastcheckin time updated for >>> management node 1: 2010-04-20 10:31:27 >>> 2010-04-20 10:31:32|25426|vcld:main(165)|lastcheckin time updated for >>> management node 1: 2010-04-20 10:31:32 >>> 2010-04-
Question about user.uid
It appears that my reservation is failing because the Linux guest already has a user with ID 101: 2010-05-03 15:06:08|7355|20:20|new|utils.pm:run_ssh_command(6180)|executing SSH command on vmguest-1: |7355|20:20|new| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x vmguest-1 '/usr/sbin/useradd -u 101 -d /home/admin -m admin -g vcl' 2>&1 2010-05-03 15:06:08|7355|20:20|new|utils.pm:run_ssh_command(6262)|run_ssh_command output: |7355|20:20|new| useradd: UID 101 is not unique It seems that the value comes from user.uid as shown below. mysql> select * from user where uid=101; ++--+-+---+---+--+---++--+--+--+--+---++-+---+---+-+---+---+-+ | id | uid | unityid | affiliationid | firstname | lastname | preferredname | email | emailnotices | IMtypeid | IMid | adminlevelid | width | height | bpp | audiomode | mapdrives | mapprinters | mapserial | showallgroups | lastupdated | ++--+-+---+---+--+---++--+--+--+--+---++-+---+---+-+---+---+-+ | 1 | 101 | admin | 1 | vcl | admin| | r...@localhost |0 |1 | NULL |3 | 1024 | 768 | 16 | local | 1 | 1 | 1 | 1 | 2007-05-17 09:58:39 | ++--+-+---+---+--+---++--+--+--+--+---++-+---+---+-+---+---+-+ Would it cause problems if I changed it to some other value that doesn't conflict with the guest's user IDs? Say 1001 perhaps? Mark -- Mark Gardner --
Re: Question about user.uid
Debian/Ubuntu at least starts user IDs at 1000. 101 conflicted with syslogd. Mark On Mon, May 3, 2010 at 3:41 PM, Aaron Peeler wrote: > It's safe, there are no problems to change it. > It used to be 1, we figured 101 would be safe - guess not :) > -A > > > On 5/3/10 3:36 PM, Mark Gardner wrote: > >> It appears that my reservation is failing because the Linux guest already >> has a user with ID 101: >> >> 2010-05-03 15:06:08|7355|20:20|new|utils.pm: >> run_ssh_command(6180)|executing >> SSH command on vmguest-1: >> |7355|20:20|new| /usr/bin/ssh -i /etc/vcl/vcl.key -l root -p 22 -x >> vmguest-1 '/usr/sbin/useradd -u 101 -d /home/admin -m admin -g vcl' 2>&1 >> 2010-05-03 15:06:08|7355|20:20|new|utils.pm: >> run_ssh_command(6262)|run_ssh_command >> output: >> |7355|20:20|new| useradd: UID 101 is not unique >> >> It seems that the value comes from user.uid as shown below. >> >> mysql> select * from user where uid=101; >> >> ++--+-+---+---+--+---++--+--+--+--+---++-+---+---+-+---+---+-+ >> | id | uid | unityid | affiliationid | firstname | lastname | >> preferredname >> | email | emailnotices | IMtypeid | IMid | adminlevelid | width | >> height | bpp | audiomode | mapdrives | mapprinters | mapserial | >> showallgroups | lastupdated | >> >> ++--+-+---+---+--+---++--+--+--+--+---++-+---+---+-+---+---+-+ >> | 1 | 101 | admin | 1 | vcl | admin| >> | r...@localhost |0 |1 | NULL |3 | 1024 >> | >> 768 | 16 | local | 1 | 1 | 1 | >> 1 >> | 2007-05-17 09:58:39 | >> >> ++--+-+---+---+--+---++--+--+--+--+---++-+---+---+-+---+---+-+ >> >> Would it cause problems if I changed it to some other value that doesn't >> conflict with the guest's user IDs? Say 1001 perhaps? >> >> Mark >> >> > > > -- > > Aaron Peeler > Program Manager > Virtual Computing Lab > NC State University > aaron_pee...@ncsu.edu > 919-513-4571 > > -- Mark Gardner --
utils.pm:1586 getdynamicaddress question
I am starting to look around at how to support IPv6. Specifically, I was
looking through the linux portion of the getdynamicaddress function in
utils.pm:1586 and wondered why the ssh call grabs all the network addresses
("ifconfig | grep inet") rather than directly asking for the public
interface's address ("ifconfig eth1 | grep inet")? It seems that being more
precise would be better.
Mark
--
Mark Gardner
--
Re: Reg: JIRA issue VCL-202
global > > > > > > variables > > > > > > > which store the values of these keyword based on mysql/derby. > > > >- Apart from this in the code there are some small changes like > > > >DATA_FORMAT() , UNIX_TIMESTAMP() functions is not recognized in > > > > derby. So they have been changed accordingly. I am working on a > > > > document to provide the complete list of changes between mysql and > > > > derby from the > > > > > > PHP > > > > > > > front end code perspective. > > > >- Regarding connecting PHP to Apache derby, db2 runtime client > with > > > >ibm_db2 extension is used. PDO_ODBC is the data access interface > for > > > > > > PHP > > > > > > >which compiles directly against DB2 librraries for native access > to > > > > > > DB2. > > > > > > > PHP is complied with ibm_db2 extension and configured accordingly. > > > > > > Please > > > > > > > refer to below links for better understanding. > > > > > > > > References: > > > > http://coffeecode.net/uploads/talks/phptropics-ibm_db2.pdf > > > > http://www.db2ude.com/?q=node/81 > > > > > > > > I am working on providing more explanatory documents which would help > > > > > > doing > > > > > > > the setup for testing and checking the connection of PHP with derby > but > > > > this is the initial idea that i shared. Presently, I have done the > > > > setup and working on the PHP front end code. I will be sharing that > > > > also with you probably sometime next week. > > > > Please provide me feedback and suggestions on this! Let me know for > any > > > > questions. > > > > > > - -- > > > - --- > > > Josh Thompson > > > Systems Programmer > > > Advanced Computing | VCL Developer > > > North Carolina State University > > > > > > josh_thomp...@ncsu.edu > > > 919-515-5323 > > > > > > my GPG/PGP key can be found at pgp.mit.edu > > > -BEGIN PGP SIGNATURE- > > > Version: GnuPG v2.0.14 (GNU/Linux) > > > > > > iEYEARECAAYFAkwFJs8ACgkQV/LQcNdtPQOqdACffPjcOW3GrgtDVDSdV27eGo4b > > > LIkAn1MJDxt2QWodgoYYK6ny3MMdwghu > > > =FrTq > > > -END PGP SIGNATURE- > > > - -- > - --- > Josh Thompson > Systems Programmer > Advanced Computing | VCL Developer > North Carolina State University > > josh_thomp...@ncsu.edu > 919-515-5323 > > my GPG/PGP key can be found at pgp.mit.edu > -BEGIN PGP SIGNATURE- > Version: GnuPG v2.0.14 (GNU/Linux) > > iEYEARECAAYFAkwGiNUACgkQV/LQcNdtPQPjHACfTAm65r0KI3iaEqxBKwUC/yQj > utUAmQFMnZic/6Y+5FObgYt9unC0CAa9 > =NlXI > -END PGP SIGNATURE- > -- Mark Gardner --
Re: auto image capturing for imaging reservations
Seems like a desirable feature to me. Mark On Wed, Feb 9, 2011 at 3:48 PM, Aaron Peeler wrote: > I'd like to add in a feature to automatically capture an image and at the > end of or at the timeout of image creation reservations. > > There have been some cases, where end-users have been in image creation > mode, made many changes, then lost everything due to their reservation being > timed out. This feature, would at the end of their imaging reservation > automatically start the image capture process instead of timing it out. > > The changes would be minor and would affect the front end and the backend > inuse module. > > frontend changes: > * add create image routines to available xmlrpc functions > * additionally the frontend would > 1 insert new image if it was a kickstart type image > 2 insert new image if end-user is not the image owner > 3 update the image if end-user is the image owner > > inuse.pm changes > - when end time is reached - 10 minute warning > - and if request has forimaging flag set > - send different message to end-user about automatically starting the > capture process > - call xmrpc_create_image with reservation/request id > - exit quietly from the insue.pm module (imaging process will take over) > > Note this would affect anyone here who is using image creation reservations > for long-term reservations to get around the check-user flag. As part of > service loads scheduled for the 2.3 release I think we had planned to extend > user and user group attributes to disable user checks on per reservation > using a user attribute in addition to the current image profile attribute. > > Unless anyone chimes in over the next days, I'll assume it's ok to move > forward on this change. > > Aaron > > -- > Aaron Peeler > Program Manager > Virtual Computing Lab > NC State University > -- Mark Gardner --
Re: recordings and slides from NCSU workshop
Josh, Have the Google Docs that went with the last session been posted also? Mark On Mon, Aug 1, 2011 at 8:29 AM, Josh Thompson wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > NCSU recently hosted a VCL workshop that consisted of two remote sessions > that > covered image creation and a 3 day on site portion that covered VCL > installation. > > The remote sessions were recorded and are available online to anyone that > would like to view them. Slides used for the onsite portion are available > at > the same location (though some are still being put online). Information is > available at the following URL: > > http://renoir.csc.ncsu.edu/VCL/Program/program.html > > Josh > - -- > - --- > Josh Thompson > VCL Developer > North Carolina State University > > my GPG/PGP key can be found at pgp.mit.edu > -BEGIN PGP SIGNATURE- > Version: GnuPG v2.0.17 (GNU/Linux) > > iEYEARECAAYFAk42nEEACgkQV/LQcNdtPQPWTQCaA31FvyRvDweqjY3eOtEOlNXF > ikMAnjxsCo9Q59ZUR7+NhAgx88UdrZom > =67Yy > -END PGP SIGNATURE- > -- Mark Gardner --
Re: recordings and slides from NCSU workshop
Never mind, I found them at http://renoir.csc.ncsu.edu/VCL/Program/Bootcamp%20Notes.pdf. Mark On Mon, Aug 1, 2011 at 3:46 PM, Mark Gardner wrote: > Josh, > > Have the Google Docs that went with the last session been posted also? > > Mark > > On Mon, Aug 1, 2011 at 8:29 AM, Josh Thompson wrote: > >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> NCSU recently hosted a VCL workshop that consisted of two remote sessions >> that >> covered image creation and a 3 day on site portion that covered VCL >> installation. >> >> The remote sessions were recorded and are available online to anyone that >> would like to view them. Slides used for the onsite portion are available >> at >> the same location (though some are still being put online). Information >> is >> available at the following URL: >> >> http://renoir.csc.ncsu.edu/VCL/Program/program.html >> >> Josh >> - -- >> - --- >> Josh Thompson >> VCL Developer >> North Carolina State University >> >> my GPG/PGP key can be found at pgp.mit.edu >> -BEGIN PGP SIGNATURE- >> Version: GnuPG v2.0.17 (GNU/Linux) >> >> iEYEARECAAYFAk42nEEACgkQV/LQcNdtPQPWTQCaA31FvyRvDweqjY3eOtEOlNXF >> ikMAnjxsCo9Q59ZUR7+NhAgx88UdrZom >> =67Yy >> -END PGP SIGNATURE- >> > > > > -- > Mark Gardner > -- > > -- Mark Gardner --
How to contribute documentation?
I attempted to edit https://cwiki.apache.org/confluence/display/VCL/VMware+Configuration to show how to use ssh-copy-id in the place of a sequence of commands to configure ESXi to use SSH identity key authentication but my regular Apache username and password don't seem to work. Thinking that Confluence is a separate authentication domain, I tried to create an account but was told that a user by that name already exists so obviously authentication isn't separate. How do I contribute to the documentation? Mark -- Mark Gardner --
Re: How to contribute documentation?
I thought I had done that. I am in now. Thanks Mark On Mon, Aug 15, 2011 at 11:04 AM, Aaron Peeler wrote: > Hi Mark, > > Actually you already have the CLA on file and you were included on the > original committer list when VCL was accepted into incubation. So you > have the paperwork in place to start becoming an active committer. > > Do you recall if you created an account in confluence? At one point > over the past year or so ASF did migrate to ldap authentication. I > don't think it included confluence, but might have. > > Did you try the "Forgot your password?" on the confluence page to > reset your password? > > Aaron > > > > On Mon, Aug 15, 2011 at 10:35 AM, Alan D. Cabrera > wrote: > > Yay! I think that you have to sign and submit a CLA and you're good. > > > > > > Regards, > > Alan > > > > On Aug 12, 2011, at 1:20 PM, Mark Gardner wrote: > > > >> I attempted to edit > >> https://cwiki.apache.org/confluence/display/VCL/VMware+Configuration to > show > >> how to use ssh-copy-id in the place of a sequence of commands to > configure > >> ESXi to use SSH identity key authentication but my regular Apache > username > >> and password don't seem to work. Thinking that Confluence is a separate > >> authentication domain, I tried to create an account but was told that a > user > >> by that name already exists so obviously authentication isn't separate. > >> > >> How do I contribute to the documentation? > >> > >> Mark > >> > >> -- > >> Mark Gardner > >> -- > > > > > > > > -- > Aaron Peeler > Program Manager > Virtual Computing Lab > NC State University > > All electronic mail messages in connection with State business which > are sent to or received by this account are subject to the NC Public > Records Law and may be disclosed to third parties. > -- Mark Gardner --
What is your work process?
Now that I have a working installation of 2.2.1, I am switching gears to add IPv6 support. In preparation for that, I would like to know what work process works best? Do you make modifications on a live (testing) instance? I suppose the answer will depend on whether the work is on the front-end or back-end. I believe IPv6 will touch both. Anyway, any advice for developing on VCL? Mark -- Mark Gardner --
Re: Graduation?
> >>> --kevan >>> >> >> The diversity issue has been my concern since we moved the codebase to >> ASF. I >> do think the community will eventually grow enough to not be dependent on >> a >> single institution's involvement. It's just a really slow process to get >> there. VCL is a large system, and it's not something a developer would >> just >> decide to jump in and start working on without having the infrastructure >> to >> run it and a set of users to use it. >> >> The community is slowly growing, first in users, and now in people >> contributing smaller bits of code. It's only a matter of time before the >> people that are contributing smaller bits of code start contributing >> larger >> stuff. At that time, we'll have enough support to graduate. To me, the >> only >> question is, how long is ASF willing to wait for this to happen? If >> that's >> another year, maybe 2, then I think we'll make it. If it's only a few >> more >> months, then I'm not so sure. >> >> Josh >> - -- >> - --**- >> Josh Thompson >> VCL Developer >> North Carolina State University >> >> my GPG/PGP key can be found at pgp.mit.edu >> -BEGIN PGP SIGNATURE- >> Version: GnuPG v2.0.17 (GNU/Linux) >> >> iEYEARECAAYFAk5o4PMACgkQV/**LQcNdtPQM3TACbB4pNqHsJ+**LpKCLME4Xz5nuZo >> DFQAniVW/**QHQE7OnNnBTzmwVGFraBgBw >> =oKdr >> -END PGP SIGNATURE- >> >> > Art Vandenberg > Account Manager/Research Function > Customer Relations, IS&T > Information Systems & Technology > Georgia State University > avandenb...@gsu.edu > +1 404 413 4743 > MS Information & Computer Science, Georgia Tech > MVA Painting & Drawing, Georgia State > Web page: > http://www.gsu.edu/ist/acs/**25735.html<http://www.gsu.edu/ist/acs/25735.html> > > > > -- Mark Gardner --
IPv4/IPv6 netmask
In extending the web front end to support IPv6, I came across the issue of how to specify the netmask. Currently, a bit mask, in dotted quad form e.g., 255.255.255.0, is expected to specify the netmask. IPv6 does not use a bit mask but instead uses a prefix size, e.g., ::1/128 which is the address for localhost. (Not only is a similar bit mask format not defined for IPv6, it is not practical either as the netmask for localhost if defined would be :::::::::::::::.) On the other hand, IPv4 can use either a bit mask or a prefix specification, with the later actually being preferred since the switch to CIDR. I propose we change the front-end (and back-end if needed) to switch to the prefix notation for specifying the bit mask as it is the current best practice for IPv4 and the only notation for IPv6. Any thoughts? Mark -- Mark Gardner --
Re: vcld test script
I think that is a great idea Aaron. Mark On Thu, Jan 12, 2012 at 9:45 AM, Aaron Coburn wrote: > Hi, Guys, > > The web front-end to the VCL has a "testsetup.php" script that tests a > variety of server settings so that the web code is easier to install. > > I am wondering if there might be interest in building a similar facility into > the vcld -setup script. It seems that many of the questions posed on this > (and the users') list relate to misconfigured networks and/or provisioning > module components. Clearly, the vcld logfile captures all of this, but even > that is often turned over to the list for interpretation. This could be a > sort of 'dry run' image capture. > > So here is a stab at what might be useful for such a script to check. My list > will be biased heavily in favor of the VMware provisioning modules, because > that's what we use in our installation. And I am assuming that the output > would be something easy to understand. > > Network: > 1. can vcld get an IP address from a vmhost 'short name' > 2. can vcld get an IP address from a given computer 'short name' > 3. can vcld reach to the running VM(s) > 4. can vcld reach to the VM host > 5. can vcld transfer a file to/from the vm host > 6. if the image library is enabled, is that accessible > > Computer: > 1. is cygwin installed and sshd running (for Windows) > 2. can vcld login successfully > 3. does the computer have network access > 4. do the computer's MAC addresses match what is expected in the database > > VM Host: > 1. can vcld login to the vm host > 2. are the paths listed in vmprofile available in the vmhost infrastructure > 3. are certain utilities and/or commands available to vcld from inside the > vmhost (i.e. copy virtual disk, create a vm, etc.) > > etc, etc. > > Thoughts? > > > Aaron > > > > > -- > Aaron Coburn > Systems Administrator and Programmer > Academic Technology Services, Amherst College > (413) 542-5451 acob...@amherst.edu > > > > > -- Mark Gardner --
Re: [jira] [Created] (VCL-543) OSX under ESXi 4.1
While I am glad to see OSX supported, I was under the impression that it was against Apple's license. Am I out of touch? Mark On Tue, Dec 6, 2011 at 7:44 PM, James O'Dell (Created) (JIRA) wrote: > OSX under ESXi 4.1 > -- > > Key: VCL-543 > URL: https://issues.apache.org/jira/browse/VCL-543 > Project: VCL > Issue Type: Improvement > Components: database, vcld (backend), web gui (frontend) > Affects Versions: 2.2.1 > Reporter: James O'Dell > Fix For: 2.2.1 > > > VCL needs OSX support. These files are my first attempt at doing so. > > -- > This message is automatically generated by JIRA. > If you think it was sent incorrectly, please contact your JIRA > administrators: > https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa > For more information on JIRA, see: http://www.atlassian.com/software/jira > > -- Mark Gardner --
Re: [jira] [Created] (VCL-543) OSX under ESXi 4.1
Thanks for letting me know. I am glad that Apple is allowing OSX to be virtualized. Mark On Fri, Feb 24, 2012 at 9:20 AM, Aaron Coburn wrote: > This is new with OS X 10.7 (Lion). > > There are also certain conditions on this. First of all, you need to be > running OS X VMs on Apple hardware, and there is a hard limit on the number > of virtualized instances that you can run on any machine. Second, the VMs > need to be run on a system that is already running Lion. > > The documents listed in this JIRA issue describe installing VMware ESX as a > hypervisor (on Mac Pro hardware) and then running three instances of Lion > inside that. I am not sure that entirely conforms to the EULA. My reading of > it, at least, is that you need to have an instance of OS X running directly > on the hardware. > > The EULA for Lion states (in section B): > B. License from Mac App Store. If you obtained a license for the Apple > Software from the Mac App Store, then subject to the terms and conditions of > this License and as permitted by the Mac App Store Usage Rules set forth in > the App Store Terms and Conditions (http://www.apple.com/legal/itunes/ww/) > (“Usage Rules”), you are granted a limited, non-transferable, non-exclusive > license: > > … > > (iii) to install, use and run up to two (2) additional copies or instances of > the Apple Software within virtual operating system environments on each Mac > Computer you own or control that is already running the Apple Software. > This is further qualified with the following: > > The grant set forth in Section 2B(iii) above does not permit you to use the > virtualized copies or instances of the Apple Software in connection with > service bureau, time-sharing, terminal sharing or other similar types of > services. > > This last clause also potentially conflicts with what the VCL is doing, > namely "terminal sharing or other similar types of services". > > Or is there another way to read this? > > Aaron > > > > -- > Aaron Coburn > Systems Administrator and Programmer > Academic Technology Services, Amherst College > (413) 542-5451 acob...@amherst.edu > > > > > > On Feb 24, 2012, at 8:29 AM, Mark Gardner wrote: > >> While I am glad to see OSX supported, I was under the impression that >> it was against Apple's license. Am I out of touch? >> >> Mark >> >> On Tue, Dec 6, 2011 at 7:44 PM, James O'Dell (Created) (JIRA) >> wrote: >>> OSX under ESXi 4.1 >>> -- >>> >>> Key: VCL-543 >>> URL: https://issues.apache.org/jira/browse/VCL-543 >>> Project: VCL >>> Issue Type: Improvement >>> Components: database, vcld (backend), web gui (frontend) >>> Affects Versions: 2.2.1 >>> Reporter: James O'Dell >>> Fix For: 2.2.1 >>> >>> >>> VCL needs OSX support. These files are my first attempt at doing so. >>> >>> -- >>> This message is automatically generated by JIRA. >>> If you think it was sent incorrectly, please contact your JIRA >>> administrators: >>> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa >>> For more information on JIRA, see: http://www.atlassian.com/software/jira >>> >>> >> >> >> >> -- >> Mark Gardner >> -- > -- Mark Gardner --
Re: Benchmarking Software's on VCL
Just curious, has anyone tried using VNC to see if it helps. If I remember correctly, VNC has the capability to refresh a subset of the screen and hence may perform better. Mark On Mon, Apr 16, 2012 at 12:05 PM, Alexander Patterson wrote: > We have the same issue here with the GIS software. It's due to RDP has to > refresh the whole screen shot. The GIS software works much better with like > a Cirtix or VMware VDI that doesVmware PCoip that only needs to fresh the > parts thats being used. > > RDP does has it's down faults. > > -Alex > > On Mon, Apr 16, 2012 at 6:56 AM, Mike Haudenschild wrote: > >> Hi Amit, >> >> There will definitely be delays in screen refresh rates as a result of the >> RDP connection, so if, for example, you're dragging a map or other objects >> you may notice some lag. You might try adjusting Windows visual settings >> for "best performance" from the System control panel. >> >> There are also "performance" settings on the RDP client itself. Try >> opening Remote Desktop Connection and manually entering the connection >> information -- depending upon your platform, the RDP client settings for >> performance will be in a different tab. >> >> GIS software can also be doing a lot of number crunching. (Confirm the >> specs in Windows System control panel on the client VM if you haven't >> already to make sure the proper resources are assigned by VCL.) Have you >> run any other applications in the VM/VCL environment that experience >> similar issues? >> >> Regards, >> Mike >> >> -- >> *Mike Haudenschild* >> Education Systems Manager >> Longsight Group >> (740) 599-5005 x809 >> m...@longsight.com >> www.longsight.com >> >> >> >> On Mon, Apr 16, 2012 at 09:40, Kumar, Amit H. wrote: >> >> > Dear All, >> > >> > I have run into issues of software(GIS) being slower on VCL as opposed to >> > Laptop. Although I have 8GB RAM and 2 vCPU assigned for this VM, >> comparison >> > of few tests resulted in poor performance on VCL. It could be the nature >> of >> > GIS and RDP or something else. >> > >> > I have tried to isolate GIS vm's onto one blade and no other vm's end up >> > on this blade. >> > >> > Any ideas or options on how could I track this down to identify what >> could >> > cause this. >> > >> > Thank you, >> > Amit >> > >> > >> > > > > -- > Thanks, > Alex Patterson > User Support Services > Operating System Analyst > California State University, East Bay -- Mark Gardner --
Re: Cloud Broker tool for VCL
Karuna, I think this is a great idea. I wonder if the idea should be broadened a bit though. Right now, the only thing that distinguishes one image from another is the name. We should provide some kind of mechanism in which the user can query and receive suggestions as to which image should be used. In your use case, the query parameters would relate to selecting which cloud provider to use. In another case, it may be querying which software is installed in an image. There are undoubtedly other types of queries that are desirable as well. (The NC State folks probably have some suggestions since their image list is quite long.) The goal would be to make it easier for someone to select an appropriate image even when they don't know much about the images. A general mechanism should allow your use case to be served as well as others we have yet to define. Mark -- Mark Gardner --
Re: VCL running on Dell Hardware
Arbin, My development platform is a Dell Optiplex 760 desktop. So it is likely that the servers you have will work. As Dmitri said, a greater limitation is that ESX needs to run on it. I am working on a server currently that does not have a supported RAID card and hence ESX will not run on it. Note: the upcoming VCL 2.3 release supports other virtualization options, such as KVM, that will relax the constraints on ESX-supported hardware. Mark On Tue, May 1, 2012 at 12:49 PM, Sanders, Arbin D wrote: > Has anyone been able to get this working? I am looking at creating a test > bed with some older Dell Servers we have. > > ** ** > > *Arbin Darren Sanders* > > > > IT Manager – Academic Computing > > North Carolina Central University > > 712 Cecil Street > > Suite 3014 > > Durham, NC 27707 > > 919.530.6307 > > 919.530.5097 (Fax) > > ** ** > > *For the Latest ITS Updates and Tips Join Us Online** ** **[image: > Description: Description: Description: Description: > cid:image003.png@01CB6AD0.97665900]*<http://www.facebook.com/profile.php?id=66100342#!/pages/Durham-NC/NCCU-Eagle-Technical-Assistance-Center-ETAC/249508718552?v=info> > * *[image: Description: Description: Description: Description: > cid:image004.png@01CB6AD0.97665900] <http://twitter.com/NCCUETAC> > > > > CONFIDENTIALITY: This email (including any attachments) may contain > confidential, proprietary and privileged information, and unauthorized > disclosure or use is prohibited. If you received this email in error, > please notify the sender and delete this e-mail from your system. > > ** ** > > __ > This email has been scanned by the Symantec Email Security.cloud service. > For more information please visit http://www.symanteccloud.com > __ > -- Mark Gardner --
Re: VCL running on Dell Hardware
I created a second network that is only within ESX that the VMs use to communicate with the management node (which is also a VM). Mark -- Mark Gardner --
Logo?
Many/most of the Apache projects have logos. Does the Apache VCL have a logo? If so, I can't seem to find it. If not, perhaps we should have a contest. Mark -- Mark Gardner --
Re: Logo?
Thanks Josh. I wonder why I (and Google) couldn't find it. Mark On Wed, May 2, 2012 at 2:43 PM, Josh Thompson wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Mark, > > If you go to the editable version of the wiki: > > https://cwiki.apache.org/confluence/display/VCL/Apache+VCL > > you'll see the logo (black "C" circle with red V on top and L to the right). > There's been a long standing problem with how what is displayed at that URL is > exported to > > http://cwiki.apache.org/VCL > > which keeps some things such as the left nav area from getting exported > correctly. We haven't really pursued fixing it lately since we need to > migrate away from confluence anyway. > > Josh > > On Wednesday, May 02, 2012 2:23:06 PM Mark Gardner wrote: >> Many/most of the Apache projects have logos. Does the Apache VCL have >> a logo? If so, I can't seem to find it. If not, perhaps we should have >> a contest. >> >> Mark > - -- > - --- > Josh Thompson > VCL Developer > North Carolina State University > > my GPG/PGP key can be found at pgp.mit.edu > > All electronic mail messages in connection with State business which > are sent to or received by this account are subject to the NC Public > Records Law and may be disclosed to third parties. > -BEGIN PGP SIGNATURE- > Version: GnuPG v2.0.17 (GNU/Linux) > > iEYEARECAAYFAk+hgFIACgkQV/LQcNdtPQPA2ACfaUuLIwfYTis/MeU2wkW0Eyhp > H9wAnRkqZbKC5FcOynTD2HxcqhjNbsqs > =38kS > -END PGP SIGNATURE- > -- Mark Gardner --
Re: Other Uses for VCL
I am considering using it as a platform for custom portals for various research and department projects. Mark On Wed, May 9, 2012 at 8:19 PM, Sanders, Arbin D wrote: > All, > > ** ** > > I am apologize in advance for posting to both groups but I think each one > has its own unique info and opinions. As NCCU goes into the new fiscal > year, I am looking at acquiring more hardware and software for NCCU VCL > project. Do any of you all have other uses for VCL other than HPC and > Virtual Desktops? > > ** ** > > Thanks in advance! > > ** ** > > *Arbin Darren Sanders* > > > > IT Manager – Academic Computing > > North Carolina Central University > > 712 Cecil Street > > Suite 3014 > > Durham, NC 27707 > > 919.530.6307 > > 919.530.5097 (Fax) > > ** ** > > *For the Latest ITS Updates and Tips Join Us Online** ** **[image: > Description: Description: Description: Description: > cid:image003.png@01CB6AD0.97665900]*<http://www.facebook.com/profile.php?id=66100342#!/pages/Durham-NC/NCCU-Eagle-Technical-Assistance-Center-ETAC/249508718552?v=info> > * *[image: Description: Description: Description: Description: > cid:image004.png@01CB6AD0.97665900] <http://twitter.com/NCCUETAC> > > > > CONFIDENTIALITY: This email (including any attachments) may contain > confidential, proprietary and privileged information, and unauthorized > disclosure or use is prohibited. If you received this email in error, > please notify the sender and delete this e-mail from your system. > > ** ** > > __ > This email has been scanned by the Symantec Email Security.cloud service. > For more information please visit http://www.symanteccloud.com > __ > -- Mark Gardner --
Re: [VOTE] Apache VCL Ready to Graduate
+1 On Thu, May 10, 2012 at 11:01 AM, Andy Kurth wrote: > This vote is to determine if the Apache VCL community believes the > project is ready to graduate from the incubator to a top level > project. Everyone in the community is encouraged to vote. Please > reply expressing one of the following: > > +1 : yes, Apache VCL is ready to graduate to a top level project > 0 : ambivalent > -1 : no, Apache VCL is not ready to graduate to a top level project > > This vote will be closed on Tuesday, May 15, 2012 at 5:00 pm EST. If > this vote passes, the community will draft a board resolution and > present it to the IPMC. > > Thank You, > Andy Kurth -- Mark Gardner --
Re: [DISCUSS] Graduation - Prepare Board Resolution
Andy, I believe one of the strengths of VCL is in its ability to manage software license issues and use roles to manage who has access to what. Is this something that should be included or should we save that for a later and longer description further down the page. Mark On Fri, May 18, 2012 at 10:06 AM, Andy Kurth wrote: > I have created a Confluence page which we can use to work out the > board resolution: > https://cwiki.apache.org/confluence/display/VCL/Graduation+Board+Resolution > > Once we are comfortable with the resolution, one of the PPMC members > will propose it on the general incubator list. The areas we need to > work on are in bold. We need to define the project description and > scope. I wrote this as "dynamically provisioning and brokering remote > access to compute resources". Thoughts? > > Please check the list of initial members to make sure I didn't leave > anyone out. This list includes both PPMC members and committers, > correct? If we are in agreement that the list will be the committers > after graduation, should the status file be changed now? > > The PPMC members also need to appoint a chair for the project. I > would be willing to do this. Anyone else interested? > > Also, 2 more issues regarding the status file: > The stock bullets under "Project info" should be removed. > > The description is currently "VCL is a management framework for > building, dispensing and managing virtual machine images across a set > of bare metal machines or systems with an installed virtual machine > hypervisor." I don't think this is quite accurate. How about "VCL is > a modular cloud computing platform which dynamically provisions and > brokers remote access to compute resources."? > > Thanks, > Andy -- Mark Gardner --
Re: 2.3 release status and proposed road map
Aaron, At some point I would like to put IPv6 and NAPT on the list but I am still working on the code. (I would prefer to follow in the footsteps of the others and have something working to back it up so maybe we don't want to put it on the schedule yet.) Mark On Tue, May 22, 2012 at 9:50 AM, Aaron Peeler wrote: > Looks good to me. > > Anyone else? This is a community decision :) > > Aaron > > On Tue, May 22, 2012 at 9:30 AM, Josh Thompson wrote: >> -BEGIN PGP SIGNED MESSAGE- >> Hash: SHA1 >> >> That ends up making the list of feature for 2.4 pretty long. How about >> splitting them up into two releases as follows: >> >> VCL 2.3 (this release) >> * Service deployments >> * Allow for additional access methods for environments (port, other >> protocols, etc) >> * Added framework support for libvirt and specifically for KVM >> * Added support for OS X under ESX >> * Added support for VMware VCenter >> * Added multilingualization to frontend >> >> VCL 2.4 >> * Power management >> * Improve additional access methods >> * Support for Spice remote display protocol >> * Scripted installation >> * Support for ESX OS for end users >> * Initial support for EC2 API and OpenStack >> * Initial support for Libcloud >> >> VCL 2.5 >> * Improve cluster reservations >> * Service deployment configuration management >> >> VCL 2.6 >> * develop tools for managing both system and user storage >> >> The list for 2.4 is a little long, but several of the items have a >> significant >> amount of the work already completed (largely by newer people in the >> community >> - - yay!). >> >> Josh >> >> On Monday, May 21, 2012 4:02:11 PM Aaron Peeler wrote: >>> Looks good. >>> >>> I would also like to see added to 2.4: >>> * support for ESX OS for end users - the work that Dmitri has done >>> * initial support for EC2 api, openstack, this could likely include >>> the code that Cameron and Young have are working on >>> * initial support for libcloud >>> >>> Aaron >>> >>> On Mon, May 21, 2012 at 3:53 PM, Josh Thompson >> wrote: >>> > -BEGIN PGP SIGNED MESSAGE- >>> > Hash: SHA1 >>> > >>> > Previously, I had stated that I'd like to get a release candidate cut by >>> > Wednesday of last week. We've been doing lots of testing and finding >>> > small >>> > bugs here and there that have kept me from cutting the RC. As soon as we >>> > stop finding bugs, I should be able to cut the RC. >>> > >>> > In each release, we include a road map of where we want to go with the >>> > next >>> > few releases. The following is a starting point of what to include. >>> > Please let me know if there are any notable features that I left off of >>> > 2.3. Also, let me know what you think of the future features. >>> > >>> > VCL 2.3 (this release) >>> > * Service deployments >>> > * Allow for additional access methods for environments (port, other >>> > protocols, etc) >>> > * Added framework support for libvirt and specifically for KVM >>> > * Added support for OS X under ESX >>> > * Added support for VMware VCenter >>> > * Added multilingualization to frontend >>> > >>> > VCL 2.4 >>> > * Power management >>> > * Improve cluster reservations >>> > * Service deployment configuration management >>> > * Support for Spice remote display protocol >>> > * Scripted installation >>> > >>> > VCL 2.5 >>> > * develop tools for managing both system and user storage >>> > >>> > Josh >>> > - -- >>> > - --- >>> > Josh Thompson >>> > VCL Developer >>> > North Carolina State University >>> > >>> > my GPG/PGP key can be found at pgp.mit.edu >>> > >>> > All electronic mail messages in connection with State business which >>> > are sent to or received by this account are subject to the NC Public >>> > Records Law and may be disclosed to third parties. >>> > -BEGIN PGP SIGNATURE- >>> > Version: GnuPG v2.0.17 (GNU/Linux) >>> > >>> > iEYEARECAAYFAk+6nUgACgkQV/LQcNdtPQPexACfceYBzdJ5mqvmOTbK+PKckIig >>> > IrQAnAzC3JQGSpc76uxH8eCvp6KHebo+ >>> > =t8CA >>> > -END PGP SIGNATURE- >> - -- >> - --- >> Josh Thompson >> VCL Developer >> North Carolina State University >> >> my GPG/PGP key can be found at pgp.mit.edu >> >> All electronic mail messages in connection with State business which >> are sent to or received by this account are subject to the NC Public >> Records Law and may be disclosed to third parties. >> -BEGIN PGP SIGNATURE- >> Version: GnuPG v2.0.17 (GNU/Linux) >> >> iEYEARECAAYFAk+7lPcACgkQV/LQcNdtPQOz6gCfWvwf/ETFbxmwN6D1HdwYovDo >> cZwAnjxVK8dR2q49ZNYc0oRQUQl5nQh4 >> =yN0Q >> -END PGP SIGNATURE- >> > > > > -- > Aaron Peeler > Program Manager > Virtual Computing Lab > NC State University > > All electronic mail messages in connection with State business which > are sent to or received by this account are subject to the NC Public > Records Law and may be disclosed to third parties. -- Mark Gardner --
Re: [VOTE] Andy Kurth as PMC chair after graduation
+1 On Thu, May 24, 2012 at 11:20 AM, Waldron, Michael H wrote: > +1 > > > Mike Waldron > Systems Specialist > ITS Research Computing > University of North Carolina at Chapel Hill > CB #3420, ITS Manning, Rm 2509 > 919-962-9778 > > From: Aaron Coburn [acob...@amherst.edu] > Sent: Thursday, May 24, 2012 11:03 AM > To: vcl-dev@incubator.apache.org > Subject: [VOTE] Andy Kurth as PMC chair after graduation > > All, > > I would like to nominate Andy Kurth as the first VCL chair. This is a > position that is responsible for the proper operation of the VCL project. > Selecting someone for this position is also a necessary step in the process > of graduating from incubator status to a top-level Apache project. > > For those of you interested in the details, they can be found here: > > http://incubator.apache.org/guides/graduation.html#tlp-resolution > > The process is like so: anyone can nominate a person to serve in this role, > and these nominations are discussed and voted upon in the community. Based on > the consensus from the community, the PPMC (Podling Project Management > Committee) makes a recommendation to the ASF Board, which actually appoints > the chair. > > -Aaron Coburn > > > -- > Aaron Coburn > Systems Administrator and Programmer > Academic Technology Services, Amherst College > acob...@amherst.edu<mailto:acob...@amherst.edu> > > > > > > -- Mark Gardner --
Re: "Preferred Password" under User Preferences ?
In general, I would rather keep things as they are. But if that capability is added, I would prefer to have it be an option as the current one-time random password is much more secure. (Our experience is that users generally pick poor passwords. Perhaps this can be a development-only option?) Mark On Fri, May 25, 2012 at 11:25 AM, Dmitri Chebotarov wrote: > Hi > > Would it be possible, and is it good idea in general due to possible security > risks, to add "Preferred Password" field on User Preferences page (under RDP > File Preferences or Personal Information?) to allow user to provide a > password for all his/her reservations? > > Then VCL would use this password (if it's there) for reservations instead of > auto-generated password. > > This is not an auto-connect option, but at least it will make it easier to > use VCL. > For the last couple days I've been using VCL for some testing and it would be > nice to have the same password for all my reservations. > > -- > Thank you, > > Dmitri Chebotarov > Virtual Computing Lab Systems Engineer, TSD - Ent Servers & Messaging > 223 Aquia Building, Ffx, MSN: 1B5 > Phone: (703) 993-6175 > Fax: (703) 993-3404 > -- Mark Gardner --
Re: [VOTE] release VCL 2.3
+1 On Wed, May 30, 2012 at 9:07 AM, Miller, Tony wrote: > +1 > > -- > Tony Miller > Technology Consultant, ITCS > Austin 106N /\ 737-1515 /\ mill...@ecu.edu /\ http://blog.ecu.edu/techtips > > -Original Message- > From: Josh Thompson [mailto:josh_thomp...@ncsu.edu] > Sent: Tuesday, May 29, 2012 4:36 PM > To: vcl-dev@incubator.apache.org > Subject: [VOTE] release VCL 2.3 > > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > We've finally reached a point where we do not seem to be finding any more > bugs. > > I created a release artifact based off of trunk. I copied trunk to a tag > under the tags area of the repo that is named release-2.3-RC1: > > http://svn.apache.org/repos/asf/incubator/vcl/tags/release-2.3-RC1/ > > The artifact is an export from that tag with the addition of Dojo Toolkit > version 1.6.1 with a custom VCL profile bundled in the web code. The > artifact, MD5 and SHA1 sums, and my GPG signature of it are available from my > space on people.a.o: > > http://people.apache.org/~jfthomps/apache-VCL-2.3-RC1-incubating/ > > The list of resolved JIRA issues associated with this release can be found > under Change Log on the VCL 2.3 release page: > > https://cwiki.apache.org/VCL/vcl-23.html#VCL2.3-ChangeLog > > Installation instructions are on the Confluence site and in the INSTALLATION > file included in the artifact. > > I was able to successfully do a test install, including image deploying and > capture. > > The directory created by extracting the RC1 artifact is > "apache-VCL-2.3-RC1-incubating" (after extracting, you may want to rename it > to "apache-VCL-2.3-incubating" so you can copy and paste all of the commands > in the installation guide). Licensing information about perl and its > required modules, php and its required modules, and mysql are stated as > "system requirements" according to the information under "System > Requirements" on http://www.apache.org/legal/3party.html. > > Please vote by the end of the day on Friday, June 1st to publish this release > (this allows for 3 business days to vote). Please note that anyone in the > VCL community is allowed to vote. > > [ ] +1 yes, release VCL 2.3 > [ ] 0 dunno > [ ] -1 no, don't release VCL 2.3 (provide reasons if this is your vote) > > Josh > - -- > - --- > Josh Thompson > VCL Developer > North Carolina State University > > my GPG/PGP key can be found at pgp.mit.edu > > All electronic mail messages in connection with State business which are sent > to or received by this account are subject to the NC Public Records Law and > may be disclosed to third parties. > -BEGIN PGP SIGNATURE- > Version: GnuPG v2.0.17 (GNU/Linux) > > iEYEARECAAYFAk/FMzYACgkQV/LQcNdtPQNOIwCfVwta+LYh0W+7tj9B39j5Owb0 > LPsAn29HkFQmU3lV2U54VrGsx2C4hZrg > =8DZ2 > -END PGP SIGNATURE- > -- Mark Gardner --
Re: copy of dojo in the repo?
I would vote that we not include code for which we are not responsible. However, it may be good to keep tarballs of the versions of each external package that we depend upon just in case something unexpected happens. Mark On Wed, May 30, 2012 at 3:03 PM, Josh Thompson wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Recently, the idea of maintaining a copy of the Dojo Toolkit in the subversion > repository has been brought up. I've avoided maintaining dojo in subversion > both to keep the repo a little cleaner and to avoid the problem of ending up > with an old copy in there that never gets updated. However, the decision to > have it in the repo is really up to the community - not just up to me. Would > others prefer for it to be there? Not having it there requires the extra step > of downloading it from another location and installing it if you want to try > to install VCL from subversion. This only takes a few minutes, but it is > still a few extra steps. > > Additionally, installing VCL from subversion may or may not work, depending on > the state of development. We don't typically check in things that are > unfinished, causing trunk to be broken, but there's always the possibility of > that happening. > > Josh > - -- > - --- > Josh Thompson > VCL Developer > North Carolina State University > > my GPG/PGP key can be found at pgp.mit.edu > > All electronic mail messages in connection with State business which > are sent to or received by this account are subject to the NC Public > Records Law and may be disclosed to third parties. > -BEGIN PGP SIGNATURE- > Version: GnuPG v2.0.17 (GNU/Linux) > > iEYEARECAAYFAk/Gbx0ACgkQV/LQcNdtPQPY/gCfUmyf0Lpi/w0DRtj9xBO5DgSj > 3nsAnjMWSDkIx4QPIcqljMviAJNbef41 > =t5rH > -END PGP SIGNATURE- > -- Mark Gardner --
Re: Network Setup
Arbin, I have a little VCL playground set up on a Dell desktop configured similarly to what you described. The public network is on a vSwitch that routes through eth0, but it has a single static IP assigned to it so I don't use DHCP. The private network is only connected via a (different) vSwitch. I think the challenge will come in with the DHCP part. I believe the VCL software expects to manage the assignment of external IP addresses to VMs. In other words, it assumes a block of routable IPv4 addresses are assigned to it to manage. Hence a DHCP server on the external network would conflict with the VCL management of those addresses. Someone with more experience setting things up could tell you for sure but that is how I understand it to work. Mark On Fri, Jun 1, 2012 at 7:10 PM, Sanders, Arbin D wrote: > All, > > ** ** > > From the documentation, VCL has to have two networks, Private and Public. > My question is can they be setup within VMware where the public IP can > routed through the eth0 and get a DHCP address and the private IP can be > routed through a vSwitch? > > ** ** > > Do all of you have two vlans provided by a physical switch? > > ** ** > > Any info would be helpful. > > ** ** > > *Arbin Darren Sanders* > > > > IT Manager – Academic Computing > > North Carolina Central University > > 712 Cecil Street > > Suite 3014 > > Durham, NC 27707 > > 919.530.6307 > > 919.530.5097 (Fax) > > ** ** > > *For the Latest ITS Updates and Tips Join Us Online** ** **[image: > Description: Description: Description: Description: > cid:image003.png@01CB6AD0.97665900]*<http://www.facebook.com/profile.php?id=66100342#!/pages/Durham-NC/NCCU-Eagle-Technical-Assistance-Center-ETAC/249508718552?v=info> > * *[image: Description: Description: Description: Description: > cid:image004.png@01CB6AD0.97665900] <http://twitter.com/NCCUETAC> > > > > CONFIDENTIALITY: This email (including any attachments) may contain > confidential, proprietary and privileged information, and unauthorized > disclosure or use is prohibited. If you received this email in error, > please notify the sender and delete this e-mail from your system. > > ** ** > > __ > This email has been scanned by the Symantec Email Security.cloud service. > For more information please visit http://www.symanteccloud.com > __ > -- Mark Gardner --
Re: graduation proposal?
I agree. On Jun 6, 2012 3:56 PM, "fapee...@ncsu.edu" wrote: I agree. Aaron - Reply message - From: "Josh Thompson" Date: Wed, Jun 6, 2012 3:0...
Re: [VOTE] release VCL 2.3 (based on RC3)
+1 -- Mark Gardner --
Re: [VOTE][CANCELED] release VCL 2.3 (based on RC3)
Given the need to move the svn, website, etc. I prefer to go with Aaron's suggestion. Let's get the release out and then concentrate on moving things. Mark On Wed, Jun 13, 2012 at 8:57 AM, Aaron Peeler wrote: > ok right, since it will take time to move the svn, website, etc. > > I would like to push to get 2.3 out before graduation and then target > a minor release (2.3.1) post graduation in August time frame. > > What do others think? > > Aaron > > On Tue, Jun 12, 2012 at 6:37 PM, Kevan Miller wrote: >> >> On Jun 12, 2012, at 4:23 PM, Josh Thompson wrote: >> >>> -BEGIN PGP SIGNED MESSAGE- >>> Hash: SHA1 >>> >>> It sounds like the general consensus is that it would be okay to wait until >>> after the board votes on our graduation before releasing 2.3 as long as >>> there >>> is little delay after the board vote. >>> >>> Mentors - Do you know if we can start a vote before the board meeting and >>> close it afterward? The idea here being not to wait another 72 hours after >>> the board meeting to get the release out. I know for me, it would be nice >>> to >>> get it out by the end of next week. I'll be on vacation the last week of >>> June >>> and would prefer not to work on cutting the release during that time. >> >> Hmm. I'm not sure that would be possible… A PMC votes on (and is responsible >> for) releases. Before graduation, the PMC is the Incubator PMC. Afterwards >> it's the VCL PMC. BTW, there are legal reasons why releases are operations >> of a PMC. Seems simpler to wait and release as a true PMC. But you can check >> with the IPMC/Board to see if it would be feasible… >> >> BTW, note that there will be some time required to move the mailing lists, >> web site, etc… svn moves, also… >> >> --kevan > > > > -- > Aaron Peeler > Program Manager > Virtual Computing Lab > NC State University > > All electronic mail messages in connection with State business which > are sent to or received by this account are subject to the NC Public > Records Law and may be disclosed to third parties. -- Mark Gardner --
Re: Re: [VOTE][RESULT] graduation of VCL as a TLP
+1 -- Mark Gardner --
