I have IB on my ia64 cluster that I am working with. I have a Voltaire IB
Switch/Fibre Channel Router, and Voltaire provided me with some src RPMs that I
built and added to my rpmlist to handle iSCSI, iSER (both for the FCR), the IB
stack, and an IB aware MPI. I also installed Intel tools and libraries,
including Intel MPI (which is IB aware) into my client image before
installation of my nodes. I have a couple post-install scripts to handle the
fibre channel router configuration files as well as creating my IPoIB network
interface. When the compute nodes boot after install, they come up with my IB
interface up and running, and my IB stack, including an IB enabled MPI, is
installed and configured everywhere.
It was pretty straight-forward, in my experience.
--Joe
________________________________
From: [EMAIL PROTECTED] on behalf of Michael Edwards
Sent: Tue 2/27/2007 9:15 AM
To: oscar users
Subject: [Oscar-users] infiniband on OSCAR
I am in the process of racking and stacking a cluster with an infiniband
network and a gigE admin backbone.
I have used OSCAR in the past on GigE, so I think I can get everything deployed
ok (crosses fingers), but I am wondering how folks deal with infiniband via
OSCAR?
Various Details (probably not the ones of interest):
OS: RHEL 4U4 AS x86_64 (or something like that)
+ Oscar 5.0
HeadNode = Dell Poweredge 2950 connected only by GigE
Compute Nodes = 30x Dell Poweredge 1955 interconnected by GigE and IB
Switches: Cisco IB Switches (Topspin has been mentioned occasionally)
PowerConnect 5324 GigE
Everybody is running dual core Xeon procs, so that shouldn't be a complicating
factor I don't think.
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Oscar-users mailing list
Oscar-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/oscar-users
