On Fri, Mar 18, 2005 at 06:13:44PM -0500, Sonny Rao wrote: > On Thu, Mar 17, 2005 at 03:45:51PM -0500, Chris Penney wrote: > > > Hmm, I'll see if I can replicate this. So, the two clients were > > > writing two different 2.7GB files or they were overwriting the same > > > file? If it were two different files, I guess the filesystem would > > > eventually fill up :) > > > > Different files in the same directory. Both systems had the 2.7GB > > file in /tmp and one both I copied it in. You can see in the log that > > one was /s/nicfs2/cpenney/testfilelnx and the other wasy testfilenode. > > > > > > Also, what architecture machine was the server (IA32, IA64, PPC64 ?) > > > and how many nfsd threads were you running? > > > > 128 threads. > > > > The server is an IBM x345 (dual cpu p4, 2gb ram, dual qlogic 2340 > > hbas) running SLES 9 w/ SP1 (no other patches applied). It's > > connected to an LSI active/passive disk array and is presented four > > 1TB luns (two are active on hba1 and two on hba2). I'm using dm to > > see the luns (*) and tie them together with lvm2. When I built the > > lvm2 volume I used -i4 -I512 (each lun is raid5 8+1 w/ 64k segment > > size). I then did a mkfs.jfs with no options. > > > > Chris > > Hmm, How easy is this to reproduce for you ? > > I've tried to get our setup similar to yours and reproduce but I > haven't been able to over many many reboots with multiple client > writers to a 4 TB JFS volume over gig-E NFS connections. > > There are some important differences between your setup and ours: > > 1) I'm using an IBM p570 PPC64 4-way machine w/64 GB of RAM > I should cut down the amount of RAM to 2 GB and try again at some > point > 2) I'm using the EVMS tools to set up my logical block device and > using drive-linking instead of lvm2 striping. This also may be > important. > 3) My arrays are much smaller and more numerous, I'm using around 50 > 70GB logical block devices together. > > Can you alter your setup to not use LVM2 striping and just simple > drive linking and see if that makes any difference ? > > Also you might try taking the volume manager out of the picture and > just mounting up one of the raid arrays and see if you can reproduce > that way. (Good to eliminate variables, no?) > > I'll try a few more configs over the weekend.
FYI, I tried lowering ram to 2GB and using LVM2 to stripe the disks, still couldn't reproduce. Sonny ------------------------------------------------------- SF email is sponsored by - The IT Product Guide Read honest & candid reviews on hundreds of IT Products from real users. Discover which products truly live up to the hype. Start reading now. http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click _______________________________________________ Jfs-discussion mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/jfs-discussion
