From : Jerome Lefevre Location : IRD (Institut de recherche et de Developpement) Noumea, New-Caledonia Oscar user since 2004 Scientific applications : CFD : roms, wrf, adcirc, fvcom Tyan Opteron Cluster, 34 cpus, 10 nodes http://www.ird.nc/cluster/ganglia
Hi Bernard, Michael and Oscar Folks, These past days, I have successfully installed Fedora Core 8 + Oscar 5.1 on my Tyan Opteron Cluster (Tyan S2885, opteron 285 + 246 Mix). To do the test, I use two nodes from my production cluster, which is operating with FC3 + oscar 4.2 since 2006. My colleague Augusto Ingunza from Lima (Peru) is performing the cluster deployment with me at Noumea, for learning. He will perform the same experience in March with FC8+Oscar 5.1 on a Dell PowerEdge quad core cluster next month. I have done some minor fix to get my new Oscar Cluster Up with the beta release, a short resume below : - My official DVD FC8 X86_64 come without "dhcp, tcsh, xinetd, php-pear, xmlstarlet, perl-XML-Simple, perl-HTML-Tree, libaio (lam),libaio-devel (lam) and rrdtool (ganglia)". Must to download these package from other repository (http://mirror.karneval.cz/pub/linux/fedora/linux/releases/8/Everything/x86_64/os/Packages) - Could not install jobmonarch : too many dependency unresolved. I don't find pbs_python and DRMAA-python. I drop out jobmonarch. - I apply the option acpi=off to the kernel boot (because acpi don't probe very well my Intel NIC and my Silicon Sata Controller), this is a hardware issue. - I must to add acpi=off to the SIS kernel boot too, for the same reason (SIS kernel boot failed in first stage with message "NO DHCPOFFERS received"). - With Oscar Wizard, i choice to add the kernel boot option "acpi=off vga=791". I look into the file /etc/systemconfig/systemconfig.conf, and the line "APPEND = ro root=LABEL=/ acpi=off vga=791" is in place. But finally, these options are not added in the grub "menu.lst" file on my node after Image installation with SIS. I suspect a bug with Systemconfigurator, perl module Boot.pm or Grub.pm ... ? Post installation and Test Cluster : - my headnode is not added inside the PBS file "nodes". However, i made choice to add the headnode in the computing node pool, at stage Oscar Package Configuration "Torque" ... ?. Finally, I edit the file "nodes" to add the headnode too. I restart the service pbs_mom too on my headnode and "chkconfig --level 5 pbs_mom" to permanently start this service after reboot. - "ntpd : Synchronizing with Time Server : FAILED" on my compute node. I check the trouble with "ntdpate -d <my_headnode>", tail /var/log/messages, ntpq> rv, ntpq> as, ntpq> pe. My headnode come with a high stratum, level 16. I think this is a FC8 issue, my headnode is not connected to the world, and the headnode Time Synchronization stratum see from nodes is too high : stratum 16 . I put these line from "http://www.brennan.id.au/09-Network_Time_Protocol.html"; in "ntp.conf" server 127.127.1.0 # local clock fudge 127.127.1.0 stratum 10 driftfile /var/lib/ntp/drift broadcastdelay 0.008 keys /etc/ntp/keys - when i load openmpi-1.2.4 (from oscar) with switcher, openmpi paths are not added in my ENV. Work well with mpich--ch_p4-gcc-1.2.7(oscar) and Lam-7.1.4 (oscar). Not a issue for me, cause i compile my own MPI Lib with intel and Pgi and add new module-files. - Few change in gmond.conf to suppress multicast, cause my 3com switch don't support multicast (or multicast is not enabled ). Feel ok to do the final deployment beginning of March on my production cluster ! Many thanks for your effort and positive energy in the Oscar Project. If you want more info about my troubles or performing check on my architecture, feel free to ask me, because my colleague will perform a new installation theses days for learning. Best regard, Jérôme Lefèvre ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Oscar-users mailing list Oscar-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/oscar-users
