Re: HPC cluster setup
On Thu, Apr 12, 2012 at 4:28 PM, jjzam...@itesm.mx wrote: Thanks, and you do not have put the name of the cluster_info file in any part of VCL? Basically cluster_info only gets added to each node by vcld if there is an image with subimages defined. Sorry is the first time I am instaling a HPC enviroment, if you have a good guide let me know:) An HPC environment is typically using a parallel batch processing job scheduler, like LSF (Load Sharing Facility), or MOAB for commercial schedulers, open-src schedulers Condor, Maui, Torque. Here is a link for overviews: http://hpc-opinion.blogspot.com/2011/07/job-schedulers-overview.html So you may want to check out each of those related sites for guides, etc. We use LSF here at NCSU with ~850 nodes. As far as clusters within VCL, one could really build anything, but what we've seen the most are researchers building hadoop clusters, a distributed LAMP stack for a class, or SAS BI environment. Hope this info helps. Aaron Thanks Juan José Zamanillo -Original Message- From: Aaron Peeler aaron_pee...@ncsu.edu Date: Thu, 12 Apr 2012 09:29:20 To: vcl-user@incubator.apache.org; jjzam...@itesm.mx Reply-To: aaron_pee...@ncsu.edu Subject: Re: HPC cluster setup Currently the only cluster configuration that is done is a cluster_info file is populated on each node (parent and children) with the IP addresses and their level. something like: 123.45.67.890=parent 123.45.67.891=child 123.45.67.892=child etc This cluster_info file is either in /etc for linux or C: for windows So with that info an image creator can use that file from and init scripts and start their cluster. We have several hadoop clusters here at NCSU using this method, it's simple but seems to work well. In the future we would be better served using configuration managers like puppet, chef, bcfg2, etc. (We should put this on the roadmap.. :) ) Hope this helps. Aaron On Wed, Apr 11, 2012 at 4:56 PM, jjzam...@itesm.mx wrote: How you define the configuration of the parent node machine and the subimages machines? Thanks Juan José Zamanillo -Original Message- From: Josh Thompson josh_thomp...@ncsu.edu Date: Wed, 11 Apr 2012 16:09:43 To: vcl-user@incubator.apache.org Reply-To: vcl-user@incubator.apache.org Subject: Re: HPC cluster setup -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Al, Pick an image to be the parent. Then, edit that image's profile by going to Manage Images and clicking Edit for the image. Click the Advanced Options section to expand it. Click the Manage Subimages button. Add any images you want to be part of the cluster (note that these changes are immediate; you don't click a save button or anything). Now, when you make a reservation for the parent image, you will get the whole cluster. Subimages are not recursive - - i.e. if you add a subimage that has subimages assigned to it, you only get the one subimage, not the subimage's subimages as well. Josh On Wednesday, April 11, 2012 7:39:08 PM Evelio Quiros wrote: Hello, Now that I have VCL working to provide single virtual machines, how do I setup a cluster of machines in VCL ? How do I setup the situation where a user can reserve a small cluster out of a group of resources (a head node and child compute nodes) ? Thanks, Al Quiros - -- - --- Josh Thompson VCL Developer North Carolina State University my GPG/PGP key can be found at pgp.mit.edu All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) iEYEARECAAYFAk+F5Q0ACgkQV/LQcNdtPQMZnwCfYlKTdwQmtySQV4Kb29ms/s+K neAAnArGLL4qs93a1qRssL9PibtRid5w =bhO6 -END PGP SIGNATURE- -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties.
Re: HPC cluster setup
Thanks for your tips Juan José Zamanillo -Original Message- From: Aaron Peeler aaron_pee...@ncsu.edu Date: Fri, 13 Apr 2012 09:06:59 To: vcl-user@incubator.apache.org Reply-To: vcl-user@incubator.apache.org Subject: Re: HPC cluster setup On Thu, Apr 12, 2012 at 4:28 PM, jjzam...@itesm.mx wrote: Thanks, and you do not have put the name of the cluster_info file in any part of VCL? Basically cluster_info only gets added to each node by vcld if there is an image with subimages defined. Sorry is the first time I am instaling a HPC enviroment, if you have a good guide let me know:) An HPC environment is typically using a parallel batch processing job scheduler, like LSF (Load Sharing Facility), or MOAB for commercial schedulers, open-src schedulers Condor, Maui, Torque. Here is a link for overviews: http://hpc-opinion.blogspot.com/2011/07/job-schedulers-overview.html So you may want to check out each of those related sites for guides, etc. We use LSF here at NCSU with ~850 nodes. As far as clusters within VCL, one could really build anything, but what we've seen the most are researchers building hadoop clusters, a distributed LAMP stack for a class, or SAS BI environment. Hope this info helps. Aaron Thanks Juan José Zamanillo -Original Message- From: Aaron Peeler aaron_pee...@ncsu.edu Date: Thu, 12 Apr 2012 09:29:20 To: vcl-user@incubator.apache.org; jjzam...@itesm.mx Reply-To: aaron_pee...@ncsu.edu Subject: Re: HPC cluster setup Currently the only cluster configuration that is done is a cluster_info file is populated on each node (parent and children) with the IP addresses and their level. something like: 123.45.67.890=parent 123.45.67.891=child 123.45.67.892=child etc This cluster_info file is either in /etc for linux or C: for windows So with that info an image creator can use that file from and init scripts and start their cluster. We have several hadoop clusters here at NCSU using this method, it's simple but seems to work well. In the future we would be better served using configuration managers like puppet, chef, bcfg2, etc. (We should put this on the roadmap.. :) ) Hope this helps. Aaron On Wed, Apr 11, 2012 at 4:56 PM, jjzam...@itesm.mx wrote: How you define the configuration of the parent node machine and the subimages machines? Thanks Juan José Zamanillo -Original Message- From: Josh Thompson josh_thomp...@ncsu.edu Date: Wed, 11 Apr 2012 16:09:43 To: vcl-user@incubator.apache.org Reply-To: vcl-user@incubator.apache.org Subject: Re: HPC cluster setup -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Al, Pick an image to be the parent. Then, edit that image's profile by going to Manage Images and clicking Edit for the image. Click the Advanced Options section to expand it. Click the Manage Subimages button. Add any images you want to be part of the cluster (note that these changes are immediate; you don't click a save button or anything). Now, when you make a reservation for the parent image, you will get the whole cluster. Subimages are not recursive - - i.e. if you add a subimage that has subimages assigned to it, you only get the one subimage, not the subimage's subimages as well. Josh On Wednesday, April 11, 2012 7:39:08 PM Evelio Quiros wrote: Hello, Now that I have VCL working to provide single virtual machines, how do I setup a cluster of machines in VCL ? How do I setup the situation where a user can reserve a small cluster out of a group of resources (a head node and child compute nodes) ? Thanks, Al Quiros - -- - --- Josh Thompson VCL Developer North Carolina State University my GPG/PGP key can be found at pgp.mit.edu All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) iEYEARECAAYFAk+F5Q0ACgkQV/LQcNdtPQMZnwCfYlKTdwQmtySQV4Kb29ms/s+K neAAnArGLL4qs93a1qRssL9PibtRid5w =bhO6 -END PGP SIGNATURE- -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties.
Re: HPC cluster setup
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Juan, I'm not quite sure what you are asking. Can you give be more specific about what you are trying to do? Josh On Wednesday, April 11, 2012 8:56:55 PM jjzam...@itesm.mx wrote: How you define the configuration of the parent node machine and the subimages machines? Thanks Juan José Zamanillo -Original Message- From: Josh Thompson josh_thomp...@ncsu.edu Date: Wed, 11 Apr 2012 16:09:43 To: vcl-user@incubator.apache.org Reply-To: vcl-user@incubator.apache.org Subject: Re: HPC cluster setup - gpg control packet Al, Pick an image to be the parent. Then, edit that image's profile by going to Manage Images and clicking Edit for the image. Click the Advanced Options section to expand it. Click the Manage Subimages button. Add any images you want to be part of the cluster (note that these changes are immediate; you don't click a save button or anything). Now, when you make a reservation for the parent image, you will get the whole cluster. Subimages are not recursive - i.e. if you add a subimage that has subimages assigned to it, you only get the one subimage, not the subimage's subimages as well. Josh On Wednesday, April 11, 2012 7:39:08 PM Evelio Quiros wrote: Hello, Now that I have VCL working to provide single virtual machines, how do I setup a cluster of machines in VCL ? How do I setup the situation where a user can reserve a small cluster out of a group of resources (a head node and child compute nodes) ? Thanks, Al Quiros - -- - --- Josh Thompson VCL Developer North Carolina State University my GPG/PGP key can be found at pgp.mit.edu All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) iEYEARECAAYFAk+GzAAACgkQV/LQcNdtPQPPIACfePjOHU/HnoOFMOVgf8Ug4o1b 7fkAnjihcKpEV62RhJDIs3gnhxdwP31e =BNd4 -END PGP SIGNATURE-
Re: HPC cluster setup
Currently the only cluster configuration that is done is a cluster_info file is populated on each node (parent and children) with the IP addresses and their level. something like: 123.45.67.890=parent 123.45.67.891=child 123.45.67.892=child etc This cluster_info file is either in /etc for linux or C: for windows So with that info an image creator can use that file from and init scripts and start their cluster. We have several hadoop clusters here at NCSU using this method, it's simple but seems to work well. In the future we would be better served using configuration managers like puppet, chef, bcfg2, etc. (We should put this on the roadmap.. :) ) Hope this helps. Aaron On Wed, Apr 11, 2012 at 4:56 PM, jjzam...@itesm.mx wrote: How you define the configuration of the parent node machine and the subimages machines? Thanks Juan José Zamanillo -Original Message- From: Josh Thompson josh_thomp...@ncsu.edu Date: Wed, 11 Apr 2012 16:09:43 To: vcl-user@incubator.apache.org Reply-To: vcl-user@incubator.apache.org Subject: Re: HPC cluster setup -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Al, Pick an image to be the parent. Then, edit that image's profile by going to Manage Images and clicking Edit for the image. Click the Advanced Options section to expand it. Click the Manage Subimages button. Add any images you want to be part of the cluster (note that these changes are immediate; you don't click a save button or anything). Now, when you make a reservation for the parent image, you will get the whole cluster. Subimages are not recursive - - i.e. if you add a subimage that has subimages assigned to it, you only get the one subimage, not the subimage's subimages as well. Josh On Wednesday, April 11, 2012 7:39:08 PM Evelio Quiros wrote: Hello, Now that I have VCL working to provide single virtual machines, how do I setup a cluster of machines in VCL ? How do I setup the situation where a user can reserve a small cluster out of a group of resources (a head node and child compute nodes) ? Thanks, Al Quiros - -- - --- Josh Thompson VCL Developer North Carolina State University my GPG/PGP key can be found at pgp.mit.edu All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) iEYEARECAAYFAk+F5Q0ACgkQV/LQcNdtPQMZnwCfYlKTdwQmtySQV4Kb29ms/s+K neAAnArGLL4qs93a1qRssL9PibtRid5w =bhO6 -END PGP SIGNATURE- -- Aaron Peeler Program Manager Virtual Computing Lab NC State University All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties.
HPC cluster setup
Hello, Now that I have VCL working to provide single virtual machines, how do I setup a cluster of machines in VCL ? How do I setup the situation where a user can reserve a small cluster out of a group of resources (a head node and child compute nodes) ? Thanks, Al Quiros
Re: HPC cluster setup
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Al, Pick an image to be the parent. Then, edit that image's profile by going to Manage Images and clicking Edit for the image. Click the Advanced Options section to expand it. Click the Manage Subimages button. Add any images you want to be part of the cluster (note that these changes are immediate; you don't click a save button or anything). Now, when you make a reservation for the parent image, you will get the whole cluster. Subimages are not recursive - - i.e. if you add a subimage that has subimages assigned to it, you only get the one subimage, not the subimage's subimages as well. Josh On Wednesday, April 11, 2012 7:39:08 PM Evelio Quiros wrote: Hello, Now that I have VCL working to provide single virtual machines, how do I setup a cluster of machines in VCL ? How do I setup the situation where a user can reserve a small cluster out of a group of resources (a head node and child compute nodes) ? Thanks, Al Quiros - -- - --- Josh Thompson VCL Developer North Carolina State University my GPG/PGP key can be found at pgp.mit.edu All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) iEYEARECAAYFAk+F5Q0ACgkQV/LQcNdtPQMZnwCfYlKTdwQmtySQV4Kb29ms/s+K neAAnArGLL4qs93a1qRssL9PibtRid5w =bhO6 -END PGP SIGNATURE-
Re: HPC cluster setup
How you define the configuration of the parent node machine and the subimages machines? Thanks Juan José Zamanillo -Original Message- From: Josh Thompson josh_thomp...@ncsu.edu Date: Wed, 11 Apr 2012 16:09:43 To: vcl-user@incubator.apache.org Reply-To: vcl-user@incubator.apache.org Subject: Re: HPC cluster setup -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Al, Pick an image to be the parent. Then, edit that image's profile by going to Manage Images and clicking Edit for the image. Click the Advanced Options section to expand it. Click the Manage Subimages button. Add any images you want to be part of the cluster (note that these changes are immediate; you don't click a save button or anything). Now, when you make a reservation for the parent image, you will get the whole cluster. Subimages are not recursive - - i.e. if you add a subimage that has subimages assigned to it, you only get the one subimage, not the subimage's subimages as well. Josh On Wednesday, April 11, 2012 7:39:08 PM Evelio Quiros wrote: Hello, Now that I have VCL working to provide single virtual machines, how do I setup a cluster of machines in VCL ? How do I setup the situation where a user can reserve a small cluster out of a group of resources (a head node and child compute nodes) ? Thanks, Al Quiros - -- - --- Josh Thompson VCL Developer North Carolina State University my GPG/PGP key can be found at pgp.mit.edu All electronic mail messages in connection with State business which are sent to or received by this account are subject to the NC Public Records Law and may be disclosed to third parties. -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) iEYEARECAAYFAk+F5Q0ACgkQV/LQcNdtPQMZnwCfYlKTdwQmtySQV4Kb29ms/s+K neAAnArGLL4qs93a1qRssL9PibtRid5w =bhO6 -END PGP SIGNATURE-
