[Lustre-discuss] Unbalanced OST--for discussion purposes

2010-03-03 Thread Ms. Megan Larko
Thanks to both Brian and Andreas for the timely responses. Brian posed the question as to whether or not the OSTs were more or less balanced a week ago. The answer is that I believe that they were. Usually all OSTs report a similar percentage of usage (between 1% and 3% of one another). I

[Lustre-discuss] Curious about iozone findings of new Lustre FS

2010-03-03 Thread Jagga Soorma
Hi Guys, (P.S. My apologies if this is a duplicate - Sent this email earlier today with an attachment and did not see it populate in google groups so was not sure if attachments were allowed) I have just deployed a new Lustre FS with 2 MDS servers, 2 active OSS servers (5x2TB OST's per OSS) and

Re: [Lustre-discuss] Curious about iozone findings of new Lustre FS

2010-03-03 Thread Andreas Dilger
On 2010-03-03, at 12:50, Jagga Soorma wrote: I have just deployed a new Lustre FS with 2 MDS servers, 2 active OSS servers (5x2TB OST's per OSS) and 16 compute nodes. Does this mean you are using 5 2TB disks in a single RAID-5 OST per OSS (i.e. total OST size is 8TB), or are you using 5

Re: [Lustre-discuss] Curious about iozone findings of new Lustre FS

2010-03-03 Thread Jagga Soorma
On Wed, Mar 3, 2010 at 2:30 PM, Andreas Dilger adil...@sun.com wrote: On 2010-03-03, at 12:50, Jagga Soorma wrote: I have just deployed a new Lustre FS with 2 MDS servers, 2 active OSS servers (5x2TB OST's per OSS) and 16 compute nodes. Does this mean you are using 5 2TB disks in a single

Re: [Lustre-discuss] Curious about iozone findings of new Lustre FS

2010-03-03 Thread Jagga Soorma
Or would it be better to increase the stripe count for my lustre filesystem to the max number of OST's? On Wed, Mar 3, 2010 at 3:27 PM, Jagga Soorma jagg...@gmail.com wrote: On Wed, Mar 3, 2010 at 2:30 PM, Andreas Dilger adil...@sun.com wrote: On 2010-03-03, at 12:50, Jagga Soorma wrote: I

Re: [Lustre-discuss] One or two OSS, no difference?

2010-03-03 Thread Oleg Drokin
Hello! On Mar 3, 2010, at 6:35 PM, Jeffrey Bennett wrote: We are building a very small Lustre cluster with 32 clients (patchless) and two OSS servers. Each OSS server has 1 OST with 1 TB of Solid State Drives. All is connected using dual-port DDR IB. For testing purposes, I am

[Lustre-discuss] LUN reassignment DDN and OSS

2010-03-03 Thread syed haider
All, I recently raised a question about unbalanced OSTs and received the right answer - increase the size of the OSTs. So I set forth to do this on our DDN controllers and rather than having 32 1TB LUNs i decided to go with 4 8TB LUNs instead. In doing this I learned our LUNs were created with the

[Lustre-discuss] Lustre reported No space left on device

2010-03-03 Thread xiaobao
Hi all, we are running lustre 1.8.1 on about 800 clients. Some days ago, we found a weird problem several times. When writing data, some clients reported LustreError: 11-0: an error occurred while communicating with xx.xx.xx...@o2ib. The ost_write operation failed with -28, where xx.xx.xx.xx is