I think he was suggesting that you install OSCAR on one of your 64 bit compute nodes and build the image there, then copy that image to the head node.
On Thu, Jan 15, 2009 at 7:48 PM, RICHARD GREEN <gree...@u.washington.edu> wrote: > Thanks Dale for your response. > > So I can't create a 64bit image on my oscar 32bit installation? > Its seems like SI is independent of the OS its on when it creates an image. > It said in the documentation for SI that it starts out with a generic kernel > and then loads custom image on the compute node. I really cant take down my > whole system , reload it with 64 RHEL at this time, and I dont think its > possible to upgrade a RHEL4 32 bit install to RHEL564. I appreciate your > suggestion about using SI to extract an image from a compute node, but by > doing that would I prevent the oscar tools (SGE, C3, etc.) from being > installed on my compute nodes? Would oscar not be able to log all my new > compute node information into its mysql db? Any advice folks have is muchly > appreciated!! > > Thanks > -Rich > > > > I was in a similar situation a few months ago. I had a 32 bit head-node > and was trying to push a 64 bit image to compute nodes. I was trying to > create a 64bit image on the 32 bit head node. It isn't supported. > However, I think you can create a 64 bit image on one of the new compute > nodes and imprt it into your SI image server. There are options within SI > to "pull" an image from an existing system. It's not part of the OSCAR > wizard, but it's included with the SI tools. You first have to > prepare_client on the 64 bit compute node, then get_image from the client > to the image server. I don't recall the syntax or the exact names of the > commands, but the documentation is part of the SystemImager tools. > > The deal-breaker might be the installation kernel though. I don't > remember if a 32 bit installer kernel can write a 64 bit image onto a > compute node. In the end I decided to rebuild the head-node with a 64bit > OS, so I can't say I was ever successful pushing the 64 bit image from a > 32 bit server. > > > > On Thu, 15 Jan 2009 oscar-users-requ...@lists.sourceforge.net wrote: > >> Send Oscar-users mailing list submissions to >> oscar-users@lists.sourceforge.net >> >> To subscribe or unsubscribe via the World Wide Web, visit >> https://lists.sourceforge.net/lists/listinfo/oscar-users >> or, via email, send a message with subject or body 'help' to >> oscar-users-requ...@lists.sourceforge.net >> >> You can reach the person managing the list at >> oscar-users-ow...@lists.sourceforge.net >> >> When replying, please edit your Subject line so it is more specific >> than "Re: Contents of Oscar-users digest..." >> >> >> Today's Topics: >> >> 1. Re: OSCAR-6.0 is out (geoffroy.val...@free.fr) >> 2. Re: OSCAR-6.0 is out (Henrique Baggio) >> 3. Error:could not stat device /dev/sda - no such file or >> directory (RICHARD GREEN) >> 4. Re: Error:could not stat device /dev/sda - no such file or >> directory (Dale Schuster) >> >> >> ---------------------------------------------------------------------- >> >> Message: 1 >> Date: Thu, 15 Jan 2009 17:36:58 +0100 (CET) >> From: geoffroy.val...@free.fr >> Subject: Re: [Oscar-users] OSCAR-6.0 is out >> To: Henrique Baggio <hnrqbag...@gmail.com> >> Cc: oscar-users@lists.sourceforge.net >> Message-ID: >> >> <1898391007.2292311232037418957.javamail.r...@spooler1-g27.priv.proxad.net> >> >> Content-Type: text/plain; charset=utf-8 >> >> Hi, >> >> I released a new version of ODA and PackMan, it is supposed to fix the >> problem. The packages are available via our "unstable" repositories >> (repositories used for the preparation of oscar-6.0.1, which should be >> fairly stable today). >> >> Henrique, i think your system configuration does not use the unstable >> repositories: you are using http://bear.csm.ornl.gov/repos/rhel-5-i386, >> instead of http://bear.csm.ornl.gov/repos/unstable/rhel-5-i386. If you want >> to use the unstable repository, refer to >> http://svn.oscar.openclustergroup.org/trac/oscar/wiki/repoTesting. >> >> Regards, >> >> >> ----- Mail Original ----- >> De: "Henrique Baggio" <hnrqbag...@gmail.com> >> ?: "geoffroy vallee" <geoffroy.val...@free.fr> >> Cc: oscar-users@lists.sourceforge.net >> Envoy?: Mercredi 14 Janvier 2009 15:04:44 GMT -05:00 USA/Canada - ?tats de >> l'Est >> Objet: Re: [Oscar-users] OSCAR-6.0 is out >> >> >> On Wed, Jan 14, 2009 at 12:51 PM, < geoffroy.val...@free.fr > wrote: >> >> >> Henrique, >> >> I never saw that error, so could you, please, set PACKMAN_VERBOSE (e.g., >> "export PACKMAN_VERBOSE=1") and re-run "oscar-config --bootstrap"? With that >> i hope having more information so i will be able to fix the problem. >> >> Thanks, >> >> Hi, Geoffroy, >> >> I set the PACKMAN_VERBOSE=1, but did not hear significant output change. >> Even so, I'm sending the output. >> >> >> ----------------------- >> >> [r...@head ~]# oscar-config --bootstrap >> OSCAR bootstrap >> install_prereq found: /usr/bin/install_prereq >> Dealing with Prereq AppConfig ( /usr/share/oscar/prereqs/AppConfig, >> check_and_fix) >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/AppConfig): >> perl-AppConfig: already installed >> >> >> AppConfig is already installed, nothing to do. >> INFO: the /tftpboot/oscar/rhel-5-i386.url already exists, we do nothing at >> /usr/lib/perl5/vendor_perl/5.8.8/OSCAR/PackagePath.pm line 840. >> INFO: the /tftpboot/distro/centos-5-i386.url file already exists, we do >> nothing at /usr/lib/perl5/vendor_perl/5.8.8/OSCAR/PackagePath.pm line 882. >> Dealing with Prereq packman (/usr/share/oscar/prereqs/packman, check_and_fix) >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/packman): >> packman: already installed >> >> >> packman is already installed, nothing to do. >> Loading "fastestmirror" plugin >> Cleaning up Everything >> Cleaning up list of fastest mirrors >> Dealing with Prereq yume (/usr/share/oscar/prereqs/yume, check_and_fix) >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/yume): >> perl-IO-Tty: already installed >> python-urlgrabber: already installed >> python-elementtree: already installed >> yum: already installed >> createrepo: already installed >> yume: already installed >> >> >> yume is already installed, nothing to do. >> Pools to prepare for distro centos-5-i386: >> [ http://bear.csm.ornl.gov/repos/rhel-5-i386 >> http://isoredirect.centos.org/centos/5/os/i386/ ] >> Array: 2 element(s) >> Preparing pools: http://bear.csm.ornl.gov/repos/rhel-5-i386 >> http://isoredirect.centos.org/centos/5/os/i386/ >> Pool: http://bear.csm.ornl.gov/repos/rhel-5-i386 >> Pool: http://isoredirect.centos.org/centos/5/os/i386/ >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/ORM): >> orm: already installed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/OSCAR-Database): >> oda: already installed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/Selector): >> oscar-selector: already installed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/base): >> dhcp: already installed >> gd: already installed >> nfs-utils: already installed >> openssh: already installed >> openssh-clients: already installed >> openssh-server: already installed >> openssl: already installed >> tcpdump: already installed >> xinetd: already installed >> httpd: already installed >> php: already installed >> expat: already installed >> python: already installed >> zlib: already installed >> zlib-devel: already installed >> shadow-utils: already installed >> libcap: already installed >> ntp: already installed >> tftp-server.i?86: already removed >> lam: already removed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/perl-XML-Parser): >> perl-XML-Parser: already installed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/perl-XML-Simple): >> perl-XML-Simple: already installed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/perl-HTML-Tree): >> perl-HTML-Tree: already installed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/perl-Tk): >> perl-Tk: already installed >> >> >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/perl-Qt): >> perl-Qt: already installed >> >> >> Executing: /usr/bin/oda --init mysql >> Initializing ODA: mysql >> Prereq status for centos, 5, i386 >> Prereqs status (/usr/share/oscar/prereqs/oda): >> mysql: already installed >> perl-DBD-MySQL: already installed >> perl-DBI: already installed >> mysql-server: already installed >> >> >> Database Initialization >> >> ================================================================ >> Your MySQL has already setup the root password. >> To proceed, please enter your root password of MySQL: >> ================================================================ >> >> Database_status: 0 >> Checking for ODA database password file ... not found. >> Generating a random password for the OSCAR database. >> saved. >> --> Password ok, now creating the database >> >> ================================================================ >> Your MySQL has already setup the root password. >> To proceed, please enter your root password of MySQL: >> ================================================================ >> >> Starting the mysqld database server ... >> /etc/init.d/mysqld start >> Starting MySQL: [ OK ] >> Making sure that the mysqld database server starts on subsequent boots ... >> chkconfig mysqld on >> >> ================================================================ >> Your MySQL has already setup the root password. >> To proceed, please enter your root password of MySQL: >> ================================================================ >> >> Checking for database existence of node oscar_server ... >> Updating the hostname field in the oscar_server node to <head.centoscluster> >> ... >> DB_DEBUG>/usr/bin/create_and_populate_basic_node_info: >> ====> in Database::update_table SQL: UPDATE Nodes SET >> hostname='head.centoscluster' WHERE name='oscar_server' >> Updating the dns_domain field in the oscar_server node to <centoscluster> >> DB_DEBUG>/usr/bin/create_and_populate_basic_node_info: >> ====> in Database::update_table SQL: UPDATE Nodes SET >> dns_domain='centoscluster' WHERE name='oscar_server' >> >> ============================================================================= >> == Creating node group all ... >> ============================================================================= >> >> >> ============================================================================= >> == Creating node group Default_node ... >> ============================================================================= >> >> Detecting local distro... >> Connecting to ODA... >> Creating the list of packages to delete... >> Getting info on all opkgs available in the passed OS repositories... >> ERROR: Cannot recognized the OS at >> /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi/OSCAR/RepositoryManager.pm >> line 135 >> >> [INFO] Querying for available OSCAR packages. That may take a while, please >> be patient... >> >> Command to execute: /usr/bin/ptty_try yume --repo >> http://bear.csm.ornl.gov/repos/rhel-5-i386 --repo >> http://isoredirect.centos.org/centos/5/os/i386/ search ^opkg-.*-server >> [ ] >> Array: 0 element(s) >> >> [INFO] Querying details for all OPKGs we found... >> >> DEBUG>/usr/bin/populate_oda_packages_table: >> ====>print_hash >> -- OPKGs data: -> >> Checking for existence of package set <Default> >> Initializing package set <Default> >> >> Successfully initialized ODA >> >> Database Initialization >> >> ================================================================ >> Your MySQL has already setup the root password. >> To proceed, please enter your root password of MySQL: >> ================================================================ >> >> Database_status: 1 >> New interface: eth0 >> >> ============================================================================= >> == >/usr/bin/set_node_nics: Connecting to the database... >> ============================================================================= >> >> >> ============================================================================= >> == >/usr/bin/set_node_nics: Connecting to the database... >> ============================================================================= >> >> >> ============================================================================= >> == Installing server core packages >> ============================================================================= >> >> Identified core packages: yume sync-files switcher sis selinux sc3 rapt oda >> c3 base apitest[ yume sync-files switcher sis selinux sc3 rapt oda c3 base >> apitest ] >> Array: 11 element(s) >> Preparing pools: http://isoredirect.centos.org/centos/5/os/i386/ >> http://bear.csm.ornl.gov/repos/rhel-5-i386 >> Pool: http://isoredirect.centos.org/centos/5/os/i386/ >> Pool: http://bear.csm.ornl.gov/repos/rhel-5-i386 >> Need to install the following packages: opkg-yume-server.noarch, >> opkg-sync-files-server.noarch, opkg-switcher-server.noarch, >> opkg-sis-server.noarch, opkg-selinux-server.noarch, opkg-sc3-server.noarch, >> opkg-rapt-server.noarch, opkg-oda-server.noarch, opkg-c3-server.noarch, >> opkg-base-server.noarch, opkg-apitest-server.noarch >> Command to execute: /usr/bin/ptty_try yume --repo >> http://bear.csm.ornl.gov/repos/rhel-5-i386 --repo >> http://isoredirect.centos.org/centos/5/os/i386/ -y install >> opkg-yume-server.noarch opkg-sync-files-server.noarch >> opkg-switcher-server.noarch opkg-sis-server.noarch >> opkg-selinux-server.noarch opkg-sc3-server.noarch opkg-rapt-server.noarch >> opkg-oda-server.noarch opkg-c3-server.noarch opkg-base-server.noarch >> opkg-apitest-server.noarch >> Marking core packages as always selected... >> >> >> >> >> >> >> [r...@head ~]# oscar_wizard install >> Can't locate SystemInstaller/Tk/Common.pm in @INC (@INC contains: >> /usr/lib/systemconfig /usr/lib/systeminstaller /usr/lib/systemimager/perl >> /usr/lib/perl5/site_perl/5.8.8/i386-linux-thread-multi >> /usr/lib/perl5/site_perl/5.8.7/i386-linux-thread-multi >> /usr/lib/perl5/site_perl/5.8.6/i386-linux-thread-multi >> /usr/lib/perl5/site_perl/5.8.5/i386-linux-thread-multi >> /usr/lib/perl5/site_perl/5.8.8 /usr/lib/perl5/site_perl/5.8.7 >> /usr/lib/perl5/site_perl/5.8.6 /usr/lib/perl5/site_perl/5.8.5 >> /usr/lib/perl5/site_perl >> /usr/lib/perl5/vendor_perl/5.8.8/i386-linux-thread-multi >> /usr/lib/perl5/vendor_perl/5.8.7/i386-linux-thread-multi >> /usr/lib/perl5/vendor_perl/5.8.6/i386-linux-thread-multi >> /usr/lib/perl5/vendor_perl/5.8.5/i386-linux-thread-multi >> /usr/lib/perl5/vendor_perl/5.8.8 /usr/lib/perl5/vendor_perl/5.8.7 >> /usr/lib/perl5/vendor_perl/5.8.6 /usr/lib/perl5/vendor_perl/5.8.5 >> /usr/lib/perl5/vendor_perl /usr/lib/perl5/5.8.8/i386-linux-thread-multi >> /usr/lib/perl5/5.8.8 .) at /usr/lib/perl5/vend! > or! >> _perl/5.8.8/OSCAR/AddNode.pm line 34. >> BEGIN failed--compilation aborted at >> /usr/lib/perl5/vendor_perl/5.8.8/OSCAR/AddNode.pm line 34. >> Compilation failed in require at /usr/bin/oscar_wizard line 51. >> BEGIN failed--compilation aborted at /usr/bin/oscar_wizard line 51. >> >> >> >> >> >> ------------------------------ >> >> Message: 2 >> Date: Thu, 15 Jan 2009 14:48:02 -0200 >> From: "Henrique Baggio" <hnrqbag...@gmail.com> >> Subject: Re: [Oscar-users] OSCAR-6.0 is out >> To: geoffroy.val...@free.fr >> Cc: oscar-users@lists.sourceforge.net >> Message-ID: >> <4a11ba3b0901150848h4ece7725vc6c551f310657...@mail.gmail.com> >> Content-Type: text/plain; charset="iso-8859-1" >> >> On Thu, Jan 15, 2009 at 2:36 PM, <geoffroy.val...@free.fr> wrote: >> >>> Hi, >>> >>> I released a new version of ODA and PackMan, it is supposed to fix the >>> problem. The packages are available via our "unstable" repositories >>> (repositories used for the preparation of oscar-6.0.1, which should be >>> fairly stable today). >>> >>> Henrique, i think your system configuration does not use the unstable >>> repositories: you are using http://bear.csm.ornl.gov/repos/rhel-5-i386, >>> instead of http://bear.csm.ornl.gov/repos/unstable/rhel-5-i386. If you >>> want to use the unstable repository, refer to >>> http://svn.oscar.openclustergroup.org/trac/oscar/wiki/repoTesting. >> >> >> Thanks, Geoffroy! >> >> Really, the log that I sent does not refer to unstable repo, but I got to >> test it too. However, there was the same problem. >> >> I will test your changes and send you a feedback. >> >> Regards, >> -- >> Henrique Baggio >> -------------- next part -------------- >> An HTML attachment was scrubbed... >> >> ------------------------------ >> >> Message: 3 >> Date: Thu, 15 Jan 2009 09:01:26 -0800 (PST) >> From: RICHARD GREEN <gree...@u.washington.edu> >> Subject: [Oscar-users] Error:could not stat device /dev/sda - no such >> file or directory >> To: oscar-users@lists.sourceforge.net >> Message-ID: >> <pine.lnx.4.43.0901150901260.20...@hymn13.u.washington.edu> >> Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed >> >> Morning Oscar users, >> >> I have been running an Oscar5.0 installation for about a year. The Golden >> Node/head node is running RHEL4 with 5 updates i386. >> A year ago a colleague and I created an image (the same as the golden node) >> and pushed it to two compute nodes. The system >> has been running fine since. Recently I obtained 10 new nodes and I would >> like to create a RHEL5 64 bit image to push down to them. >> I know from the docs that RHEL5 is supported, but wasn't sure how to create >> a whole new 64bit image. So far this is what I did. >> >> I created a new directory: >> >> /tftpboot/distro/redhat-el-ws-5-x86_64 >> >> The previous directory is: >> >> /tftpboot/distro/redhat-el-ws-4-i386 >> >> and I copied all the rpms off all my RHEL64 discs into the directory: >> /tftpboot/distro/redhat-el-ws-5-x86_64 >> >> I made sure permissions were o.k. and then I pulled up the oscar create >> client image tool. I made sure to specify the new directory with rpms in the >> package file. >> I created a new image name. Iclicked on build image and at the end I >> receieved a green light, it said it created an image successfully. >> >> I went ahead to the next step and defined my new oscar clients, I submitted >> a listed on mac addresses, made sure all new nodes were set to PXE boot and >> then began to reboot the system. >> As the nodes began to boot up I see dhcp server coming on and it assigns >> them addresses. Then it fails. The failure happens with SI and reads: >> >> Partitioning /dev/sda >> old partition table for /dev/sda >> Error:could not stat device /dev/sda - no such file or directory >> >> I can ping these machines, but I have a feeling there is no boot kernel for >> the 64 bit image in /tftpboot I see: >> >> distro install-initrd-rhel-4-i386.img kernel >> memtest86 pxelinux.0 >> initrd.img install-kernel-i386 kernel-x >> memtest86+-1.26 pxelinux.cfg >> install-initrd-i386.img install-kernel-rhel-4-i386 localboot oscar >> rpm >> >> After it fails the screen goes to busy box. >> >> Can anyone suggest what steps I should take (or that I am missing) in >> creating the necessary 64 bit image for my nodes? Any advice you can provide >> is muchly appreciated. >> >> Thanks >> -Rich >> >> >> >> >> >> ------------------------------ >> >> Message: 4 >> Date: Thu, 15 Jan 2009 09:16:21 -0800 >> From: Dale Schuster <dale.schus...@sncorp.com> >> Subject: Re: [Oscar-users] Error:could not stat device /dev/sda - no >> such file or directory >> To: oscar-users@lists.sourceforge.net >> Cc: oscar-users@lists.sourceforge.net >> Message-ID: >> <of925770f5.1d423f4a-on8825753f.005e0f1d-8825753f.005ee...@sncorp.com> >> Content-Type: text/plain; charset="US-ASCII" >> >> RICHARD GREEN <gree...@u.washington.edu> wrote on 01/15/2009 09:01:26 AM: >> >>> Morning Oscar users, >>> >>> I have been running an Oscar5.0 installation for about a year. The >>> Golden Node/head node is running RHEL4 with 5 updates i386. >>> A year ago a colleague and I created an image (the same as the >>> golden node) and pushed it to two compute nodes. The system >>> has been running fine since. Recently I obtained 10 new nodes and I >>> would like to create a RHEL5 64 bit image to push down to them. >>> I know from the docs that RHEL5 is supported, but wasn't sure how to >> >> I was in a similar situation a few months ago. I had a 32 bit head-node >> and was trying to push a 64 bit image to compute nodes. I was trying to >> create a 64bit image on the 32 bit head node. It isn't supported. >> However, I think you can create a 64 bit image on one of the new compute >> nodes and imprt it into your SI image server. There are options within SI >> to "pull" an image from an existing system. It's not part of the OSCAR >> wizard, but it's included with the SI tools. You first have to >> prepare_client on the 64 bit compute node, then get_image from the client >> to the image server. I don't recall the syntax or the exact names of the >> commands, but the documentation is part of the SystemImager tools. >> >> The deal-breaker might be the installation kernel though. I don't >> remember if a 32 bit installer kernel can write a 64 bit image onto a >> compute node. In the end I decided to rebuild the head-node with a 64bit >> OS, so I can't say I was ever successful pushing the 64 bit image from a >> 32 bit server. >> >> >> >> ------------------------------ >> >> ------------------------------------------------------------------------------ >> This SF.net email is sponsored by: >> SourcForge Community >> SourceForge wants to tell your story. >> http://p.sf.net/sfu/sf-spreadtheword >> >> ------------------------------ >> >> _______________________________________________ >> Oscar-users mailing list >> Oscar-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/oscar-users >> >> >> End of Oscar-users Digest, Vol 32, Issue 11 >> ******************************************* >> > > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Oscar-users mailing list > Oscar-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/oscar-users > ------------------------------------------------------------------------------ This SF.net email is sponsored by: SourcForge Community SourceForge wants to tell your story. http://p.sf.net/sfu/sf-spreadtheword _______________________________________________ Oscar-users mailing list Oscar-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/oscar-users
