[Lustre-discuss] OST failure, data recovery

2007-06-08 Thread Thomas Roth
Hi, I'm quite new to lustre, studying all the documentation. A question I have not found an answer to so far: If the user data gets spread out in chunks to a number of OSTs, and one of the OSTs fails completely - say, all the disks on the fileserver behind that OST are gone for good - how do

Re: [Lustre-discuss] OST failure, data recovery

2007-06-08 Thread Bernd Schubert
On Friday 08 June 2007 13:41:13 Thomas Roth wrote: > Hi, > > I'm quite new to lustre, studying all the documentation. A question I > have not found an answer to so far: > > If the user data gets spread out in chunks to a number of OSTs, and one > of the OSTs fails completely - say, all the disks on

[Lustre-discuss] MDT full?

2007-06-08 Thread John R. Dunning
I thought I had this written down someplace, but now can't find it: Is there a definitive way to tell whether an MDT is full? Alternatively, a particular OST? What's driving this is I'm trying to build some semi-automated tools to diagnose the dreaded "no space left on device" error. TIA... _

Re: [Lustre-discuss] MDT full?

2007-06-08 Thread Bernd Schubert
On Friday 08 June 2007 15:37:00 John R. Dunning wrote: > I thought I had this written down someplace, but now can't find it: Is > there a definitive way to tell whether an MDT is full? Alternatively, a > particular OST? > > What's driving this is I'm trying to build some semi-automated tools to >

Re: [Lustre-discuss] OST failure, data recovery

2007-06-08 Thread Andreas Dilger
On Jun 08, 2007 13:41 +0200, Thomas Roth wrote: > If the user data gets spread out in chunks to a number of OSTs, and one > of the OSTs fails completely - say, all the disks on the fileserver > behind that OST are gone for good - how does the cluster recover from that? This is of course possibl

Re: [Lustre-discuss] MDT full?

2007-06-08 Thread Andreas Dilger
On Jun 08, 2007 15:40 +0200, Bernd Schubert wrote: > On Friday 08 June 2007 15:37:00 John R. Dunning wrote: > > I thought I had this written down someplace, but now can't find it: Is > > there a definitive way to tell whether an MDT is full? Alternatively, a > > particular OST? > > > > What's dr

Re: [Lustre-discuss] MPI-IO for Lustre

2007-06-08 Thread Weikuan Yu
Which MPICH2 you are working with? I can probably send you one tweaked to work with MPICH2. Weikuan Florin Isaila wrote: Hi everybody, I would like to use MPI-IO with Lustre. Is there an ADIO driver for MPI-IO? I could find an old MPICH 1.2.5 patch, but it does not serve me. Is there an Lus

Re: [Lustre-discuss] MPI-IO for Lustre

2007-06-08 Thread Andreas Dilger
On Jun 08, 2007 14:04 -0400, Weikuan Yu wrote: > This is the MPICH2 patch I originally started as a base for some ROMIO > optimizations over Lustre. It should work fine for MPICH2-1.0.3 on > experimental systems. However, use it as your risk :) > > Given time, I will try to push out my optimiza

Re: [Lustre-discuss] MPI-IO for Lustre

2007-06-08 Thread Weikuan Yu
Would you object to me adding this patch to the lustre/contrib directory in the lustre distribution? Not at all. Please do so. We can also consider update it as it gets more mature. Also, are there any plans to include this into an MPICH distribution? I think a lot of Lustre users would be

Re: [Lustre-discuss] MPI-IO for Lustre

2007-06-08 Thread Lee Ward
On Fri, 2007-06-08 at 14:04 -0600, Andreas Dilger wrote: > On Jun 08, 2007 14:04 -0400, Weikuan Yu wrote: > > This is the MPICH2 patch I originally started as a base for some ROMIO > > optimizations over Lustre. It should work fine for MPICH2-1.0.3 on > > experimental systems. However, use it as

Re: [Lustre-discuss] MPI-IO for Lustre

2007-06-08 Thread Andreas Dilger
On Jun 08, 2007 17:21 -0400, Weikuan Yu wrote: > Andreas Dilger wrote: > >As an aside, it's too bad that the ADIO code is such a mess of #ifdefs. > >I suspect much of it could be cleaned up by having proper arch-specific > >macros/helper functions to wrap the internals. > > > >>+#ifdef HAVE_STATUS

Re: [Lustre-discuss] MPI-IO for Lustre

2007-06-08 Thread Andreas Dilger
On Jun 08, 2007 15:38 -0600, Lee Ward wrote: > > Other notes - in about Lustre 1.6.2 it will be possible to use the FIEMAP > > ioctl to help in efficiently preallocating space in the file for the > > ADIO_FCNTL_SET_DISKSPACE fcntl. That will avoid the need to read the > > whole file, and instead

Re: [Lustre-discuss] MPI-IO for Lustre

2007-06-08 Thread Weikuan Yu
> > There are no Lustre ioctl's of any kind implemented in liblustre. The > Lustre client driver takes them but just returns an error. Maybe my info > dated here? I admit it's been a coupe of months since I last looked at > this. Actually, it is possible for a catamount client to use llapi_file_c