Hi Roy,
Thanks for sharing your experiance, only
difference is you are using lustre-1.4.6.4 we
may need to try the same, what is your voltaire
stack version, we are using IBGD-1.8.2, here is the
steps we follow to setup lustre
1. Install the Lustre RPMS
#rpm -ivh
kernel-smp-2.6.9-34.EL_lustre.1.4.6.2.x86_64.rpm
kernel-source-2.6.9-34.EL_lustre.1.4.6.2.x86_64.rpm
lustre-source-1.4.6.2-2.6.9_34.EL_lustre.1.4.6.2smp.x86_64.rpm
2. Change the grub.conf to boot lustre kernel by
default and reboot
3. Build the lustre kernel with out infiniband support
4. Build the mellonax Gen1 src
#cd IBGD-1.8.2-srpt
#./install.sh
5. Install the mellonax Gen1 RPMS
6. Configure and install lustre modules
7. Update the config file
/etc/infiniband/ifcfg-ib0
8. set network parameters in /etc/modprobe.conf
#options lnet networks=openib0
9. Create lustre dir and put upcall script
#mkdir /etc/lustre
#mkdir /media/data1
#mkdir /media/data2
create a upcall script
/etc/lustre/lustre_upcall.sh
10. reboot the machines and mount the lustre
partitions
#lconf --node hostname02-ib0 /etc/lustre/config.xml
could you see any errors in above steps, or could you
mind passing us your steps to setup the lustre that
works fine.
In the same clustre we have machines with mem free IB
cards, those machines are no kernel panic issues, that
is the reason we are interested to see your
config/setup.
thanks,
-bala-
--- Roy Dragseth <[EMAIL PROTECTED]> wrote:
> Oh, I forgot to say specifically: We do use mem
> based ib-cards:
>
> 06:02.0 PCI bridge: Mellanox Technologies MT23108
> PCI Bridge (rev a1)
> 07:00.0 InfiniBand: Mellanox Technologies MT23108
> InfiniHost (rev a1)
>
> The cards is branded as Topspin cards, but we
> switched to the voltaire stack
> as it plays better with the voltaire switch
> monitoring capabilities.
>
> r.
>
> _______________________________________________
> Lustre-discuss mailing list
> [email protected]
>
https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
>
____________________________________________________________________________________
TV dinner still cooling?
Check out "Tonight's Picks" on Yahoo! TV.
http://tv.yahoo.com/
_______________________________________________
Lustre-discuss mailing list
[email protected]
https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
