Re: [Lustre-discuss] Lustre featured on podcast (HT: Andreas Dilger)

2009-08-04 Thread Mag Gam
so, why options lnet networks=tcp What exactly does that do? On Mon, Aug 3, 2009 at 10:57 PM, Peter J Milanesepmilan...@nypl.org wrote: Yes, it hold up any packet that is less than the size of the header, and forwards multiple. - Original Message - From: Brock Palen

Re: [Lustre-discuss] Lustre and iSCSI

2009-08-04 Thread David Pratt
Hi. Many thanks for your responses. Generally, the qualities of Lustre appear great for a Storage Repository for virtual machine images in XenServer since you would get a combination of fault tolerance, a pretty much infinitely scalable distributed storage pool, speed and ability to

Re: [Lustre-discuss] Lustre and iSCSI

2009-08-04 Thread Andreas Dilger
On Aug 04, 2009 09:58 -0300, David Pratt wrote: Hi. Many thanks for your responses. Generally, the qualities of Lustre appear great for a Storage Repository for virtual machine images in XenServer since you would get a combination of fault tolerance, a pretty much infinitely scalable

[Lustre-discuss] Lustre v1.8.0.1 slower than expected large-file, sequential-buffered-file-read speed

2009-08-04 Thread Rick Rothstein
Hi - I'm new to Lustre (v1.8.0.1), and I've verified that I can get about 1000-megabytes-per-second aggregate throughput for large file sequential reads using direct-I/O. (only limited by the speed of my 10gb NIC with TCP offload engine). My simple I/O test has the client on a separate machine

Re: [Lustre-discuss] Clients frozen during pressure test

2009-08-04 Thread Andreas Dilger
On Aug 03, 2009 22:10 +0800, Lu Wang wrote: I am doing pressure test for a new 10-OSS Lustre file system using 70 client node. (each server has 10Gb Ethernet connection, each client has 1Gb Ethernet connection, there are 3 OST on 3 RAID6 volulme for one OSS) Each

Re: [Lustre-discuss] Lustre featured on podcast (HT: Andreas Dilger)

2009-08-04 Thread Andreas Dilger
On Aug 03, 2009 08:55 -0400, Brock Palen wrote: Thanks to Andreas for taking an hour out to talk with Jeff Squyres and myself (Brock Palen) about the Lustre cluster filesystem on our podcast www.rce-cast.com, You can find the whole show at:

Re: [Lustre-discuss] Lustre client memory usage very high

2009-08-04 Thread Guillaume Demillecamps
Hello again, Not sure if it is interesting to be noted, but if I use the following command, my memory is freed: sync; echo 3 /proc/sys/vm/drop_caches What is surprising, though, is that the cache never expires (at least it remains in memory for several days at the least). Regards,

[Lustre-discuss] 1.8 : recurrent LBUG's on clients

2009-08-04 Thread Guillaume Demillecamps
Hello, All servers and clients are having Lustre 1.8, on SLES 10 SP2. Clients use patchless kernels, using same base revision as the ones for the patched kernel servers. We recurrently encounter this error : Server log : Jul 30 06:11:47 BEESPBESXFIL27 kernel: LustreError:

Re: [Lustre-discuss] Lustre and iSCSI

2009-08-04 Thread Klaus Steden
Hi David, I did some experiments last year with Lustre 1.6.x and a Dell iSCSI enclosure. It was a little slow (proof of concept mainly) due to sharing MDT and OST traffic on a single GigE strand, but as long as the operating system presents a valid block device, Lustre works fine. hth Klaus On

Re: [Lustre-discuss] Lustre v1.8.0.1 slower than expected large-file, sequential-buffered-file-read speed

2009-08-04 Thread Andreas Dilger
On Aug 04, 2009 10:30 -0400, Rick Rothstein wrote: I'm new to Lustre (v1.8.0.1), and I've verified that I can get about 1000-megabytes-per-second aggregate throughput for large file sequential reads using direct-I/O. (only limited by the speed of my 10gb NIC with TCP offload engine). the

[Lustre-discuss] Fw: Re: Clients frozen during pressure test

2009-08-04 Thread Lu Wang
Hi, After modification of TCP statck on OSS, it seems that failed clients can reconnect again. The pressure test has persisted for 12 hours. You should check for error messages on the server that might indicate why it is having a problem. If all of the clients are

Re: [Lustre-discuss] Lustre featured on podcast (HT: Andreas Dilger)

2009-08-04 Thread Andreas Dilger
On Aug 04, 2009 14:35 -0400, Brian J. Murrell wrote: On Tue, 2009-08-04 at 11:17 -0600, Andreas Dilger wrote: To be more clear - TCP isn't used on IB, Elan, Myrinet, Cray networks. On the socklnd (TCP sockets over IP, called tcplnd on some platforms) tcplnd or socklnd? Generally it's the

Re: [Lustre-discuss] Lustre and iSCSI

2009-08-04 Thread David Pratt
Hi Andreas. NFS is fine for XenServer so think it is worth evaluating Lustre as a proof of concept for storage pool. First step I want to take is to setup a single node (everything on the one node as you have identified) to ensure XenServer can properly connect to NFS through Lustre.

Re: [Lustre-discuss] Lustre featured on podcast (HT: Andreas Dilger)

2009-08-04 Thread Mag Gam
Either way Andres. We appreciate the talk. My masters OS design class talked about this for 45 mins today :-) You are a celebrity. On Tue, Aug 4, 2009 at 2:35 PM, Brian J. Murrellbrian.murr...@sun.com wrote: On Tue, 2009-08-04 at 11:17 -0600, Andreas Dilger wrote: To be more clear - TCP isn't

Re: [Lustre-discuss] 1.8 : recurrent LBUG's on clients

2009-08-04 Thread Oleg Drokin
Hello! On Jul 31, 2009, at 3:15 AM, Guillaume Demillecamps wrote: All servers and clients are having Lustre 1.8, on SLES 10 SP2. Clients use patchless kernels, using same base revision as the ones for the patched kernel servers. We recurrently encounter this error : Chances are you are