Hello Murali,
Many thanks for the reply. Regarding pvfs2 being too slow I figured out the
reason which was due to one of the IO servers going down. Now pvfs2 is
working fine. However, Im still interested in compiling the latest pvfs2
(1.5.1). Below is the db details am using (Centos 4.2).
In a related matter, Im trying to compile mpich 1.2.7p1 with romio support
for pvfs2. Without pvfs2, the configuration step will go through, but with
pvfs2 there is an error (I tried both Intel and gnu compilers). Im attaching
below as well the steps and the config.log.
Many thanks in advance and apologies for the long mail.
nasr
-------------------------------------------------------------------------------------------------------------------------------------------
# rpm -qi db4
Name : db4 Relocations: (not relocatable)
Version : 4.2.52 Vendor: CentOS
Release : 7.1 Build Date: Tue 22 Feb 2005
09:29:26 AM MYT
Install Date: Wed 13 Sep 2006 12:03:25 PM MYT Build Host:
guru.build.karan.org
Group : System Environment/Libraries Source RPM:
db4-4.2.52-7.1.src.rpm
Size : 3539304 License: GPL
Signature : DSA/SHA1, Sun 27 Feb 2005 04:33:32 AM MYT, Key ID
a53d0bab443e1821Packager : Karanbir Singh <[EMAIL PROTECTED]>
URL : http://www.sleepycat.com/
Summary : The Berkeley DB database library (version 4) for C.
Description :
...............
------------------------------------------------------------------------------------------------------------------------------------------
Compiling MPICH 1.2.7p1 with pvfs2 support.
# cp /root/Desktop/cluster/mpich1.2.7/mpich.tar.gz /usr/local/src
# cd /usr/local/src
# tar -zxf mpich.tar.gz
# mkdir -p /opt/mpich1/intel
# mkdir -p /tmp/mpich1/intel
# export RSHCOMMAND=ssh
# export LDFLAGS="-L/opt/pvfs2/lib"
# export CFLAGS="-I/opt/pvfs2/include"
# export LIBS="-lpvfs2"
# export CC="/opt/intel/cc/9.1/bin/icc"
# export CXX="/opt/intel/cc/9.1/bin/icpc"
# export FC="/opt/intel/fc/9.1/bin/ifort"
# export F90="/opt/intel/fc/9.1/bin/ifort"
# cd /tmp/mpich1/intel
# /usr/local/src/mpich-1.2.7p1/configure --prefix=/opt/mpich1/intel
--with-device=ch_p4:-socksize=1048576 --with-comm=shared --enable-sharedlib
--enable-romio --with-file-system=pvfs2+nfs+ufs -opt=-O3
------------------------------------------------------------------------------------------------------------------------------------------
CONFIG.LOG FILE
configure:/opt/intel/cc/9.1/bin/icc -I/opt/pvfs2/include conftest.c -o
conftest -lpvfs2
configure: failed program was:
#define MPE_USE_EXTENSIONS 1
#include "confdefs.h"
int f(double a){return 0;}
int main() { exit(0); }
int t() { }
conftest.c(4): warning #1011: missing return statement at end of non-void
function "t"
int t() { }
^
configure:gcc -I/opt/pvfs2/include conftest.c -o conftest -lpvfs2
configure: failed program was:
#define MPE_USE_EXTENSIONS 1
#include "confdefs.h"
int main() { exit(0); }
int t() { return 0; }
----------------------------------------------------------------------------------------------------------------------------------------
I tried configuring without mpe but no success.
From: Murali Vilayannur <[EMAIL PROTECTED]>
To: "Nasr Y.M.J.O." <[EMAIL PROTECTED]>
CC: [email protected]
Subject: Re: [Pvfs2-users] PVFS2 Too Slow
Date: Sun, 17 Sep 2006 10:14:21 -0500 (CDT)
Hi Nasr,
> This is my first experience with parallel filesystems. I compiled PVFS2
> 1.3.2 into a Rocks 4.1 cluster (Centos 4.2) following the quick start
guide.
> No errors encountered and all tests passed. My cluster is 1 frontend + 7
> compute nodes. I did the configuration so the frontend will act as a
meta
> data server as well as a client. All the 7 compute nodes act as IO
servers
> and clients.
>
> When I tried to test the kernel space by making a directory (e.g., mkdir
> /pvfs2/user) it tooks around 5 minutes to do that and the desktop panic.
> Similarly, when I ssh to one of the compute nodes and I run any command
> (e.g., ls, mkdir...).
>
> Is there any way to improve the performance? Im attaching below the
steps
> and configuration I followed in case I missed something. Apologies for
the
> long email.
>
> PS: I chose pvfs2 1.3.2 since I had an error when installing 1.5.1
> complaining about db (invalid argument). No changes in the configuration
> files generated by genconfig were made.
All the steps that you did look ok. However, pvfs2-1.3.2 is fairly old
and a lot of performance and stability fixes have gone in to our releases
since then.
Let's try to figure out why pvfs2 1.5.1 does not build for you
and then diagnose performance/stability issues from there..
Can you find out what version of berk db is installed on your cluster?
Perhaps our configure checks need to be tweaked on your setup to detect
things correctly..
thanks for the reports!
Murali
_________________________________________________________________
Get an advanced look at the new version of MSN Messenger.
http://messenger.msn.com.my/Beta/Default.aspx
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
