[Lustre-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Pardo Diaz, Alfonso
Hi, I have migrated my Lustre 2.2 to 2.5.1 and I have equipped my OSS/MDS and clients with Infiniband QDR interfaces. I have compile lustre with OFED 3.2 and I have configured lnet module with: options lent networks=“o2ib(ib0),tcp(eth0)” But when I try to compare the lustre performance across

Re: [Lustre-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Vsevolod Nikonorov
What disks do your OSTs have? Maybe you have reached your disk performance limit, so Infiniband gives some speedup, but very small. Did you try to enable striping on your Lustre filesystem? For instance, you can type something like this: lfs setstripe -c count of stripes /mnt/lustre/somefolder

Re: [Lustre-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Hammitt, Charles Allen
...@lists.lustre.org] On Behalf Of Vsevolod Nikonorov Sent: Monday, May 19, 2014 6:54 AM To: lustre-discuss@lists.lustre.org Subject: Re: [Lustre-discuss] Same performance Infiniband and Ethernet What disks do your OSTs have? Maybe you have reached your disk performance limit, so Infiniband gives some speedup

Re: [Lustre-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Pardo Diaz, Alfonso
] On Behalf Of Vsevolod Nikonorov Sent: Monday, May 19, 2014 6:54 AM To: lustre-discuss@lists.lustre.org Subject: Re: [Lustre-discuss] Same performance Infiniband and Ethernet What disks do your OSTs have? Maybe you have reached your disk performance limit, so Infiniband gives some speedup

Re: [Lustre-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Andrew Holway
@lists.lustre.org Subject: Re: [Lustre-discuss] Same performance Infiniband and Ethernet What disks do your OSTs have? Maybe you have reached your disk performance limit, so Infiniband gives some speedup, but very small. Did you try to enable striping on your Lustre filesystem? For instance, you can

Re: [Lustre-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Sean Brisbane
, Alfonso Cc: lustre-discuss@lists.lustre.org Subject: Re: [Lustre-discuss] Same performance Infiniband and Ethernet dd if=/dev/zero of=test.dat bs=1M count=1000 oflag=direct oflag=direct forces directIO which is synchronous. On 19 May 2014 14:41, Pardo Diaz, Alfonso alfonso.pa