Re: [Lustre-discuss] Lustre over two TCP interfaces

2013-06-26 Thread Michael Shuey
alfonso.pa...@ciemat.eswrote: oooh! Thanks for you reply! May be another way is a floating IP between two interfaces with IPVS (corosync). -Mensaje original- From: Brian O'Connor Sent: Wednesday, June 26, 2013 10:15 AM To: Alfonso Pardo Cc: 'Michael Shuey' ; 'WC-Discuss' ; lustre

Re: [Lustre-discuss] Lustre over two TCP interfaces

2013-06-25 Thread Michael Shuey
Different interfaces need to be declared with different LNET networks - something like networks=tcp0(eth0),tcp1(eth1). Of course, that assumes your clients are configured to use a mix of tcp0 and tcp1 for connections (with each client only using one of the two). This is really only useful in

Re: [Lustre-discuss] [HPDD-discuss] Disk array setup opinions

2013-03-09 Thread Michael Shuey
If you can, I'd advocate the route you suggest - multiple RAID groups, each group maps to a unique LUN, and each LUN is an OST. Note that you'll likely want the number of data disks in each RAID to be a power of 2 (e.g., 6- or 10-disk raid6, 5- or 9-disk raid5). Obviously, you'll be wasting more

Re: [Lustre-discuss] problem with installing lustre and ofed

2012-12-31 Thread Michael Shuey
RedHat's OFED tends to lag Mellanox's. They're pretty current on bugfixes, but support for the latest hardware is usually 3-6 months behind - it took about 4 months to bring in drivers for our most recent FDR system. Also, support for Mellanox's advanced features (e.g., MXM, FCA) is often

Re: [Lustre-discuss] ofed with FDR14 support Lustre

2012-05-30 Thread Michael Shuey
We're using 1.8.7.80-wc1 here. It's basically 1.8.7-wc1, but with a few fixes pulled in from git a few months back to build on rhel6.2. It's built on top of Mellanox's OFED 1.5.3-3.0.0, and is working just fine on our FDR14 cluster. -- Mike Shuey On Wed, May 30, 2012 at 3:41 PM, John White

Re: [Lustre-discuss] Could Client MGS or Client OSS running at one node together?

2012-03-07 Thread Michael Shuey
I've had success with LACP bonding, with an LACP-aware switch. You may also want to check your xmit_hash_policy (it's a kernel option to the linux bonding driver). I've had the best luck with layer3+4 bonding, using several OSSes with sequential IPs, and striping files at a multiple of the

Re: [Lustre-discuss] Mount 2 clusters, different networks - LNET tcp1-tcp2-o2ib

2011-06-14 Thread Michael Shuey
Is your ethernet FS in tcp1, or tcp0? Your config bits indicate the client is in tcp1 - do the servers agree? -- Mike Shuey On Tue, Jun 14, 2011 at 12:23 PM, Thomas Roth t.r...@gsi.de wrote: Hi all, I'd like to mount two Lustre filesystems on one client. Issues with more than one MGS set

Re: [Lustre-discuss] Mount 2 clusters, different networks - LNET tcp1-tcp2-o2ib

2011-06-14 Thread Michael Shuey
:00 PM, Michael Shuey wrote: Is your ethernet FS in tcp1, or tcp0? Your config bits indicate the client is in tcp1 - do the servers agree? -- Mike Shuey On Tue, Jun 14, 2011 at 12:23 PM, Thomas Roth t.r...@gsi.de wrote:   Hi all,     I'd like to mount two Lustre filesystems on one client

Re: [Lustre-discuss] Can one node mount more than one lustre cluster?

2011-03-15 Thread Michael Shuey
FYI, I'm using Lustre 1.8.5 to mount two filesystems from separate domains (one in Lafayette, IN, and one in Bloomington, IN, run by two different institutions) on 900+ nodes, and things just work. -- Mike Shuey On Tue, Mar 15, 2011 at 6:24 PM, Andreas Dilger adil...@whamcloud.com wrote: On

Re: [Lustre-discuss] status of lustre 2.0 on 2.6.18-194.17.1.0.1.el5 kernels

2011-01-11 Thread Michael Shuey
What does that imply for sites migrating from 1.8 to 2.1? Presumably some sites will have both 1.8 and 2.1 filesystems; will those sites need to run 2.0 on the clients to mount both FS versions concurrently? -- Mike Shuey On Tue, Jan 11, 2011 at 3:07 PM, Andreas Dilger adil...@whamcloud.com