Paul, I've set up IB on OSCAR clusters a few times; if you run into any problems, let me know, I may be able to offer some help. --Joe
________________________________ From: [EMAIL PROTECTED] on behalf of Paul Guermonprez Sent: Fri 3/7/2008 8:16 AM To: [email protected] Subject: [Oscar-devel] 5.1b1 on RHEL 5.1 x86_64 results hello, the hardware : 10 xeon servers, GEth plus voltaire IB. soft : rhel 5.1 x86_64 and oscar rhel-5-x86_64-5.1b1, using PBS and not SGE result : 1. missing detail in the doc : the hostname must not be localhost OK but if you have 2 interfaces you have to use as hostname the cluster interface name. it is causing PBS configuration errors. It is also important to have the short domain name / FQDN in the right order so that the reverse and hostname match (i guess). 2. had to create a rpm for network kernel drivers, and use UYOK even if the driver was present unused on the server machine. I would opt for a "choose drivers" step in the setup process to solve storage and network. I 've seen details on how to do that with sis, but not with oscar 3. using voltaire infiniband, added openib redhat rpms in the image, will have to make it work later. will publish a howto. ofed will be next step. 4. selinux was disabled but the script /opt/oscar/scripts/system-sanity.d/selinux-check.pl had a problem, i had to remove /usr/sbin/selinuxenabled to make it work. 5. cpush problem copying /etc/hosts, causing buggy too long filenames impossible to copy in /tmp like /tmp/192.168.2.109605192.168.2.108581192.168.2.107539192.168.2.106435192.168.2.105479192.168.2.104420192.168.2.103374192.168.2.102245192.168.2.101201192.168.2.1032688hosts using "cpush -b" (without rsync) works fine will update my howto in detail ASAP ... this time with infiniband setup nice software ! thanks, paul. ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Oscar-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/oscar-devel
<<winmail.dat>>
------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________ Oscar-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/oscar-devel
