Thanks for your tips
Juan José Zamanillo -----Original Message----- From: Aaron Peeler <aaron_pee...@ncsu.edu> Date: Fri, 13 Apr 2012 09:06:59 To: <vcl-user@incubator.apache.org> Reply-To: vcl-user@incubator.apache.org Subject: Re: HPC cluster setup On Thu, Apr 12, 2012 at 4:28 PM, <jjzam...@itesm.mx> wrote: > Thanks, and you do not have put the name of the cluster_info file in any part > of VCL? Basically cluster_info only gets added to each node by vcld if there is an image with subimages defined. > > Sorry is the first time I am instaling a HPC enviroment, if you have a good > guide let me know:) An HPC environment is typically using a parallel batch processing job scheduler, like LSF (Load Sharing Facility), or MOAB for commercial schedulers, open-src schedulers Condor, Maui, Torque. Here is a link for overviews: http://hpc-opinion.blogspot.com/2011/07/job-schedulers-overview.html So you may want to check out each of those related sites for guides, etc. We use LSF here at NCSU with ~850 nodes. As far as clusters within VCL, one could really build anything, but what we've seen the most are researchers building hadoop clusters, a distributed LAMP stack for a class, or SAS BI environment. Hope this info helps. Aaron > > Thanks > > Juan José Zamanillo > > -----Original Message----- > From: Aaron Peeler <aaron_pee...@ncsu.edu> > Date: Thu, 12 Apr 2012 09:29:20 > To: <vcl-user@incubator.apache.org>; <jjzam...@itesm.mx> > Reply-To: aaron_pee...@ncsu.edu > Subject: Re: HPC cluster setup > > Currently the only cluster configuration that is done is a > cluster_info file is populated on each node (parent and children) with > the IP addresses and their level. > something like: > > 123.45.67.890=parent > 123.45.67.891=child > 123.45.67.892=child > etc > > This cluster_info file is either in /etc for linux or C: for windows > > So with that info an image creator can use that file from and init > scripts and start their cluster. We have several hadoop clusters here > at NCSU using this method, it's simple but seems to work well. > > In the future we would be better served using configuration managers > like puppet, chef, bcfg2, etc. (We should put this on the roadmap.. :) > ) > > Hope this helps. > Aaron > > On Wed, Apr 11, 2012 at 4:56 PM, <jjzam...@itesm.mx> wrote: >> How you define the configuration of the parent node machine and the >> subimages machines? >> Thanks >> >> >> Juan José Zamanillo >> >> -----Original Message----- >> From: Josh Thompson <josh_thomp...@ncsu.edu> >> Date: Wed, 11 Apr 2012 16:09:43 >> To: <vcl-user@incubator.apache.org> >> Reply-To: vcl-user@incubator.apache.org >> Subject: Re: HPC cluster setup >> >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> Al, >> >> Pick an image to be the "parent". Then, edit that image's profile by going >> to >> Manage Images and clicking Edit for the image. Click the "Advanced Options" >> section to expand it. Click the Manage Subimages button. Add any images you >> want to be part of the cluster (note that these changes are immediate; you >> don't click a save button or anything). Now, when you make a reservation for >> the parent image, you will get the whole cluster. Subimages are not >> recursive >> - - i.e. if you add a subimage that has subimages assigned to it, you only >> get >> the one subimage, not the subimage's subimages as well. >> >> Josh >> >> On Wednesday, April 11, 2012 7:39:08 PM Evelio Quiros wrote: >>> Hello, >>> >>> Now that I have VCL working to provide single virtual machines, how do I >>> setup a cluster of machines in VCL ? How do I setup the situation where a >>> user can reserve a small cluster out of a group of resources (a head node >>> and child compute nodes) ? >>> >>> Thanks, >>> Al Quiros >> - -- >> - ------------------------------- >> Josh Thompson >> VCL Developer >> North Carolina State University >> >> my GPG/PGP key can be found at pgp.mit.edu >> >> All electronic mail messages in connection with State business which >> are sent to or received by this account are subject to the NC Public >> Records Law and may be disclosed to third parties. >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v2.0.17 (GNU/Linux) >> >> iEYEARECAAYFAk+F5Q0ACgkQV/LQcNdtPQMZnwCfYlKTdwQmtySQV4Kb29ms/s+K >> neAAnArGLL4qs93a1qRssL9PibtRid5w >> =bhO6 >> -----END PGP SIGNATURE----- >> > > > > -- > Aaron Peeler > Program Manager > Virtual Computing Lab > NC State University > > All electronic mail messages in connection with State business which > are sent to or received by this account are subject to the NC Public > Records Law and may be disclosed to third parties. -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties.
