Re: [Lustre-discuss] Configuration of lustre FS on single node

2008-02-29 Thread Amit Sharma
Ashok, If you are trying to setup lustre (with all the servers MDS, OSS.. etc) building only the patchless client wont help you. You will have to build lustre as described here : http://wiki.lustre.org/index.php?title=Lustre_Howto thanks, Amit. ashok bharat bayana wrote: Hi, the kernel

[Lustre-discuss] [Fwd: [ofa-general] Announcing the release of MVAPICH 1.0]

2008-02-29 Thread Weikuan Yu
Per the announcement from the MVAPICH team, I am pleased to let you know that the MPI-IO support for Lustre has been integrated into the new release of MVAPICH, version 1.0. - Optimized and high-performance ADIO driver for Lustre - This MPI-IO support is a contribution from Future

[Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Chris Worley
Lustre 1.6.4.2, OFED 1.2.5.5, RHEL kernel 2.6.9.67.0.4. Configured with: --with-o2ib --with-ldiskfs mgs.ko is built but not wrapped into modules rpm, with an undefined external that should be from the lvfs module (lvfs_check_rdonly). When ko2iblnd loads, it gets lots of disagrees about version

Re: [Lustre-discuss] lustre and small files overhead

2008-02-29 Thread Balagopal Pillai
Hi, Please read the i/o tunables in the proc section in the lustre manual. I tried that with the postmark benchmark to test improvement and there was some improvement after trying the suggestions in the Lustre manual. Regards Balagopal Joe Barjo wrote: Hi We have a (small) 30 node

Re: [Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Craig Prescott
Nod - we ran into this issue as well. Your Module.symvers file for probably has entries in it for the IB modules included with the RHEL kernel (and not from OFED). Here's what we do to avoid this issue (and others) when building a patched Lustre kernel with OFED: 1) Get the source for that

[Lustre-discuss] lustre and small files overhead

2008-02-29 Thread Joe Barjo
Hi We have a (small) 30 node sge based cluster with centos4 which will be growing to maximum 50 core duos. We use custom software that is based on gmake to launch parallel compilation and computations with lot of small files and some large files. We actualy use nfs and have a lot of problems with

Re: [Lustre-discuss] ptlrpcd

2008-02-29 Thread Nicholas Henke
Thomas Roth wrote: Hi all, anybody knows what ptlrpcd is good for, what it might be doing? I've seen it eating 100% CPU on OSS where I reformated an OST, but also in other circumstances. Check the syslog console logs - when we've seen this it was because Lustre had LBUG'd on that

Re: [Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Canon, Richard Shane
Yes. We also had to fix that. Sorry I left that off. In our case, we created a modified Module.symvers by grep'ing out anything with drivers/infiniband. Also, OFED will create a Module.symvers for its symbols. You can append that to the (fixed) Module.symvers so that the symbols will still

[Lustre-discuss] ptlrpcd

2008-02-29 Thread Thomas Roth
Hi all, anybody knows what ptlrpcd is good for, what it might be doing? I've seen it eating 100% CPU on OSS where I reformated an OST, but also in other circumstances. Regards, Thomas ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org

Re: [Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Canon, Richard Shane
The ko2ib build problem can be fixed by renaming {KERNEL SRC}/include/rdma/. I'm not sure about the mgs error. --Shane -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Chris Worley Sent: Friday, February 29, 2008 9:49 AM To:

Re: [Lustre-discuss] Configuration of lustre FS on single node

2008-02-29 Thread Andreas Dilger
On Feb 29, 2008 12:07 +0530, ashok bharat bayana wrote: I successfully build lustre(1.6.4.2) on my system for a patchless client But I dont know how to proceed in configuring the file system. I'm trying to build all MDS,client and MDT's on a single node. The patchless client is ONLY a

Re: [Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Chris Worley
On Fri, Feb 29, 2008 at 8:50 AM, Canon, Richard Shane [EMAIL PROTECTED] wrote: Yes. We also had to fix that. Sorry I left that off. In our case, we created a modified Module.symvers by grep'ing out anything with drivers/infiniband. Also, OFED will create a Module.symvers for its

Re: [Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Andreas Dilger
On Feb 29, 2008 07:49 -0700, Chris Worley wrote: Lustre 1.6.4.2, OFED 1.2.5.5, RHEL kernel 2.6.9.67.0.4. Configured with: --with-o2ib --with-ldiskfs mgs.ko is built but not wrapped into modules rpm, with an undefined external that should be from the lvfs module (lvfs_check_rdonly). This

Re: [Lustre-discuss] lustre and small files overhead

2008-02-29 Thread Andreas Dilger
On Feb 29, 2008 15:37 +0100, Joe Barjo wrote: We have a (small) 30 node sge based cluster with centos4 which will be growing to maximum 50 core duos. We use custom software that is based on gmake to launch parallel compilation and computations with lot of small files and some large files. We

Re: [Lustre-discuss] ptlrpcd

2008-02-29 Thread Paul Nowoczynski
Thomas, To my knowledge, 'ptlrpcd' is a thread that's responsible for pushing asynchronous rpc requests to various places. It is also tasked with receiving the replies to those requests. I imagine the OSS has a lot of outstanding async rpc's which need to be continually processed. It's just

Re: [Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Chris Worley
On Fri, Feb 29, 2008 at 12:48 PM, Andreas Dilger [EMAIL PROTECTED] wrote: On Feb 29, 2008 07:49 -0700, Chris Worley wrote: Lustre 1.6.4.2, OFED 1.2.5.5, RHEL kernel 2.6.9.67.0.4. Configured with: --with-o2ib --with-ldiskfs mgs.ko is built but not wrapped into modules rpm, with an

Re: [Lustre-discuss] Latest RHEL kernel: won't make mgs module, and ko2iblnd not built for right OFED modules

2008-02-29 Thread Chris Worley
On Fri, Feb 29, 2008 at 2:32 PM, Chris Worley [EMAIL PROTECTED] wrote: On Fri, Feb 29, 2008 at 12:48 PM, Andreas Dilger [EMAIL PROTECTED] wrote: On Feb 29, 2008 07:49 -0700, Chris Worley wrote: Lustre 1.6.4.2, OFED 1.2.5.5, RHEL kernel 2.6.9.67.0.4. Configured with: --with-o2ib