I need step by step procedure of building patchless client for lustre file system.I referred wiki.lustre.org. But I have a doubt,For bulding patchless client, Is it required to patch and build kernel source first as given in wiki and then configure using [lustre]$ ./configure --with-linux=/unpatched/kernel/source or not? I have kernel version vanilla 2.6.22.14 and I'm trying to install lustre 1.6.4.2
Regards, Ashok Bharat -----Original Message----- From: [EMAIL PROTECTED] on behalf of [EMAIL PROTECTED] Sent: Mon 2/25/2008 2:02 PM To: [email protected] Subject: Lustre-discuss Digest, Vol 25, Issue 51 Send Lustre-discuss mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://lists.lustre.org/mailman/listinfo/lustre-discuss or, via email, send a message with subject or body 'help' to [EMAIL PROTECTED] You can reach the person managing the list at [EMAIL PROTECTED] When replying, please edit your Subject line so it is more specific than "Re: Contents of Lustre-discuss digest..." Today's Topics: 1. Re: Lustre and MPI-ROMIO, specifically ADIOI_Set_Lock and noncontiguous writing (Andreas Dilger) 2. Re: 2.6.23 client systems with any compatible server (Andreas Dilger) 3. Re: Help needed in building patchless client for lustre (ashok bharat bayana) 4. Re: Help needed in building patchless client for lustre (Tom.Wang) 5. Re: Help needed in building patchless client for lustre (ashok bharat bayana) ---------------------------------------------------------------------- Message: 1 Date: Sun, 24 Feb 2008 21:18:44 -0700 From: Andreas Dilger <[EMAIL PROTECTED]> Subject: Re: [Lustre-discuss] Lustre and MPI-ROMIO, specifically ADIOI_Set_Lock and noncontiguous writing To: Bill Wichser <[EMAIL PROTECTED]> Cc: Tom Wang <[EMAIL PROTECTED]>, [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii On Feb 22, 2008 08:47 -0500, Bill Wichser wrote: > I'm trying to do noncontiguous writes on a Lustre filesystem using > MPI-ROMIO routines. It is failing in ADIOI_Set_Lock with the message: > > File locking failed in ADIOI_Set_lock. If the file system is NFS, you > need to use NFS version 3, ensure that the lockd daemon is running on > all the machines, and mount the directory with the 'noac' option (no > attribute caching). > > Now I've searched the web for some solution but only seem to come across > similar problems. Is there some way to mount a lustre filesystem so > that it somehow does the right thing here and use the ufs kernel > interface? NFS mounted filesystems work fine as they provide the file > locking mechanism apparently. The default for Lustre is to _not_ support cluster-coherent flock locking, because it can cause problems in some cases (depending on locking mode). There are client mount options "-o localflock" which just pretends that flock locking is working (it is using only the local node's flock locking), and "-o flock" which enables real filesystem-wide flock. You can pick between the two, depending if you need real flock or not. Also, there have been improvements for the Lustre ADIO driver done at ORNL. Cheers, Andreas -- Andreas Dilger Sr. Staff Engineer, Lustre Group Sun Microsystems of Canada, Inc. ------------------------------ Message: 2 Date: Sun, 24 Feb 2008 21:19:27 -0700 From: Andreas Dilger <[EMAIL PROTECTED]> Subject: Re: [Lustre-discuss] 2.6.23 client systems with any compatible server To: Ron <[EMAIL PROTECTED]> Cc: [EMAIL PROTECTED], [EMAIL PROTECTED] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=us-ascii On Feb 22, 2008 10:59 -0800, Ron wrote: > I want to have a lustre client running on a system with 2.6.23.12 > kernel. (The reason is that there is a special patch that is required > for these 60+ Quad-Core AMD Opteron systems that we have and the patch > is currently only available for this 2.6.23.12 kernel). > > Does anyone have a recommendation of how I should get a client and > then a compatible server? > For the server, we only need minimal throughput, we just would like to > see if Lustre can manage a filesystem created on a 40 TB disk system > attached via a qlogic fibre channel adapter. We were planning to run > the mgs, mdt, and several OSTs on a single system. There are no kernel > constraints for the server. (We currently have a redhat base x86_64 > distribution loaded.) > > I have tried a lustre CVS client (20080116) for the 2.6.23.12, but > seem to have run into a compatibility issue with the 1.6.4.*- > vanilla_2.6.18.8 server. You should be able to build a "patchless" lustre client for kernels > 2.6.16, though I'm not sure if we have all of the kernel API changes for > 2.6.22 in the Lustre code. The issue is that even though Lustre clients no longer require kernel patches, the kernel APIs change without notice or documentation, so there is always _something_ broken when a new kernel is released. Could you also elaborate on the "1.6.4.* compatibility issue"? There shouldn't be any compatibility problems between 1.6 releases, though the current b1_6 development branch has a feature (adaptive timeouts) which is likely to be removed before the final release. I would suggest getting the specific Lustre release you want by CVS tag (v1_6_4_3 probably) instead of the CVS tip. Cheers, Andreas -- Andreas Dilger Sr. Staff Engineer, Lustre Group Sun Microsystems of Canada, Inc. ------------------------------ Message: 3 Date: Mon, 25 Feb 2008 13:10:51 +0530 From: "ashok bharat bayana" <[EMAIL PROTECTED]> Subject: Re: [Lustre-discuss] Help needed in building patchless client for lustre To: <[email protected]> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="iso-8859-1" hi! I tried to build lustre-1.6.4.2 in my system, but the following error occured, /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: error: too few arguments to function ?vfs_rename? make[6]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] Error 1 make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] Error 2 make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2 make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2 make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic' make[2]: *** [modules] Error 2 make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' make: *** [all] Error 2 my kernel version is 2.6.22.14. and I configured patchless client in my system using the following command [lustre]$ ./configure --with-linux=/unpatched/kernel/source and after that I tried to build, using make then the above error occured. can anyone help me in how to proceed building the patchless client for lustre. Thanks and Regards, Ashok Bharat -----Original Message----- From: [EMAIL PROTECTED] on behalf of [EMAIL PROTECTED] Sent: Tue 2/12/2008 10:30 PM To: [email protected] Subject: Lustre-discuss Digest, Vol 25, Issue 22 Send Lustre-discuss mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://lists.lustre.org/mailman/listinfo/lustre-discuss or, via email, send a message with subject or body 'help' to [EMAIL PROTECTED] You can reach the person managing the list at [EMAIL PROTECTED] When replying, please edit your Subject line so it is more specific than "Re: Contents of Lustre-discuss digest..." Today's Topics: 1. Re: Am I missing something? (Aaron Knister) 2. Re: rc -43: Identifier removed (Kit Westneat) ---------------------------------------------------------------------- Message: 1 Date: Tue, 12 Feb 2008 11:11:19 -0500 From: Aaron Knister <[EMAIL PROTECTED]> Subject: Re: [Lustre-discuss] Am I missing something? To: Timh Bergstr?m <[EMAIL PROTECTED]> Cc: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="iso-8859-1" The discrepancies between lfs df -h and df -h I think that largely have to do with the way GB are calculated. Ether based on 1000 or 1024. Remember you lose about 5% of each underlying volume due to the 5% reserved for root. Aaron On Feb 12, 2008, at 8:38 AM, Timh Bergstr?m wrote: > Hi, > > Just got a smaller Lustre system running with 1 mdt/mgs and 2 ost's. > On the osts i've added 1x10GB disk and 1x20GB disk > on each system and formatted and mounted them as /mnt/ost1-4 (ost1) > and /mnt/ost2-3 (ost2). I've also mounted the lustre system on the > mdt/mgs server with mount -t lustre [EMAIL PROTECTED]:/testfs /mnt/lustre. > So far so good, however df -h only reports 9/60GB avail where lsf df > -h reports 54.4G available. > > [EMAIL PROTECTED]:/testfs > 60G 50G 9.0G 85% /mnt/lustre > > vs > > filesystem summary: 59.1G 4.7G 54.4G 7% /mnt/lustre > > -- > > lustre-client:/mnt/lustre# du -hcs > 4.0K . > 4.0K total > > I cant find anything on this in the lists or manual, but do you > have to have equal size disks to get all the usable space available > to the system mounting lustre? Is this somehow connected to stripe- > size or some automatic failover settings. My original intent was to > create a large storage area using lustre for numerous clients to > mount and use as diskspace. > > -- > Timh Bergstr?m > System Administrator > Diino AB - www.diino.com > :wq _______________________________________________ > Lustre-discuss mailing list > [email protected] > http://lists.lustre.org/mailman/listinfo/lustre-discuss Aaron Knister Associate Systems Analyst Center for Ocean-Land-Atmosphere Studies (301) 595-7000 [EMAIL PROTECTED] -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080212/f41b7db3/attachment-0001.html ------------------------------ Message: 2 Date: Tue, 12 Feb 2008 11:27:27 -0500 From: Kit Westneat <[EMAIL PROTECTED]> Subject: Re: [Lustre-discuss] rc -43: Identifier removed To: Per Lundqvist <[EMAIL PROTECTED]> Cc: [EMAIL PROTECTED], Steden Klaus <[EMAIL PROTECTED]>, [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed What the group upcall does is get all the secondary groups for the client user. There isn't enough room in the LNET message to send them all, so the MDS has to look it up in the /etc/groups. If you don't care about secondary groups at all, there is no harm in clearing the group_upcall param. In theory, there also shouldn't be any harm in having different passwd and group files on the MDS and OSSes than on the clients. It's highly important, however, that all the clients have the same passwd and groups files. Otherwise the clients could interpret the same UID as different users, and people could go mucking around in each others files. - Kit Per Lundqvist wrote: > On Mon, 11 Feb 2008, Aaron Knister wrote: > > >> I had the same issue with my lustre setup. I think this should fix it -- >> >> tunefs.lustre --param mdt.group_upcall=NONE /dev/mdt/device >> > > Thanks Andreas and Aaron, but then I wonder why the MDS needs to have all > the users in its own passwd/group file? And what are the implications of > setting the above mdt.group_upcall=NONE on the MDT? > > /Per > > > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > [email protected] > http://lists.lustre.org/mailman/listinfo/lustre-discuss > ------------------------------ _______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss End of Lustre-discuss Digest, Vol 25, Issue 22 ********************************************** -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/ms-tnef Size: 6064 bytes Desc: not available Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080225/81e9e419/attachment-0001.bin ------------------------------ Message: 4 Date: Mon, 25 Feb 2008 02:54:30 -0500 From: "Tom.Wang" <[EMAIL PROTECTED]> Subject: Re: [Lustre-discuss] Help needed in building patchless client for lustre To: ashok bharat bayana <[EMAIL PROTECTED]> Cc: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; format=flowed; charset=windows-1252 ashok bharat bayana wrote: > hi! > I tried to build lustre-1.6.4.2 in my system, but the following error occured, > > /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: > error: too few arguments to function ?vfs_rename? > make[6]: *** > [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] > Error 1 > make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] > Error 2 > make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2 > make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2 > make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic' > make[2]: *** [modules] Error 2 > make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' > make[1]: *** [all-recursive] Error 1 > make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' > make: *** [all] Error 2 > > my kernel version is 2.6.22.14. > > and I configured patchless client in my system using the following command > > [lustre]$ ./configure --with-linux=/unpatched/kernel/source > > add --disable-server when you configure patchless client. > and after that I tried to build, using make then the above error occured. > > can anyone help me in how to proceed building the patchless client for lustre. > > Thanks and Regards, > Ashok Bharat > > > ------------------------------ Message: 5 Date: Mon, 25 Feb 2008 14:09:37 +0530 From: "ashok bharat bayana" <[EMAIL PROTECTED]> Subject: Re: [Lustre-discuss] Help needed in building patchless client for lustre To: "Tom.Wang" <[EMAIL PROTECTED]> Cc: [email protected] Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="iso-8859-1" Thanks for ur response but disabling server didn't help in uncovering the errors. the same errors came again /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:309: error: too few arguments to function ?vfs_mkdir? /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c: In function ?lustre_rename?: /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: warning: passing argument 3 of ?vfs_rename? from incompatible pointer type /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: warning: passing argument 4 of ?vfs_rename? from incompatible pointer type /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: error: too few arguments to function ?vfs_rename? make[6]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] Error 1 make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] Error 2 make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2 make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2 make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic' make[2]: *** [modules] Error 2 make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' make: *** [all] Error 2 Regards, Ashok Bharat -----Original Message----- From: Tom.Wang [mailto:[EMAIL PROTECTED] Sent: Mon 2/25/2008 1:24 PM To: ashok bharat bayana Cc: [email protected] Subject: Re: [Lustre-discuss] Help needed in building patchless client for lustre ashok bharat bayana wrote: > hi! > I tried to build lustre-1.6.4.2 in my system, but the following error occured, > > /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: > error: too few arguments to function 'vfs_rename' > make[6]: *** > [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] > Error 1 > make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] > Error 2 > make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2 > make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2 > make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic' > make[2]: *** [modules] Error 2 > make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' > make[1]: *** [all-recursive] Error 1 > make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2' > make: *** [all] Error 2 > > my kernel version is 2.6.22.14. > > and I configured patchless client in my system using the following command > > [lustre]$ ./configure --with-linux=/unpatched/kernel/source > > add --disable-server when you configure patchless client. > and after that I tried to build, using make then the above error occured. > > can anyone help me in how to proceed building the patchless client for lustre. > > Thanks and Regards, > Ashok Bharat > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080225/afcf6a04/attachment.html ------------------------------ _______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss End of Lustre-discuss Digest, Vol 25, Issue 51 **********************************************
_______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss
