On Sat, Nov 5, 2011 at 7:07 PM, nachiappan arumugam <[email protected] > wrote:
> Hi Michael, > > Thanks for the clarifying my doubt, I had a another basic question, I > compile my MPI program on one machine. > So where should I place the executable ? Because all other nodes should be > able to access the executable for running. > Should I place the program in pvfs mounted directory ? I am using mpirun > command directly to run the program. If I use schedulers like Bsub or > Torque, will it take care of copying the executable to all the client nodes > before running ? > > When I tried placing the executable on local disk of all the nodes, my > program worked fine. But when I tried placing the executable on the pvfs2 > mounted directory, I got an error saying the executable was not found in > the client nodes, even though the file was visible when I do a ./pvfs2-ls. > But when I tried using NFS instead of PVFS2 I did not face this issue. > > Any clue on what is going behind ? > Two things: 1. To use PVFS2 for the shared storage space (similar to what you did with NFS) that holds the executable you want to run you'll need to use the kernel module and have the file system mounted on the client nodes. Specifically, you'll need to be able to run `ls` and see the executable not `pvfs2-ls`. 2. Compiling PVFS2 support into MPICH2 doesn't mean it can run executables on a PVFS2 file system to run. It provides an MPI-IO interface to a PVFS2 file system. I hope that helps get you headed in the right direction. Michael > -- > Thanks, > Nachiappan A > > On Sat, Nov 5, 2011 at 5:36 PM, Michael Moore <[email protected]>wrote: > >> Sorry I was not more clear. I think the installation order you're >> following is correct. What I would recommend is making sure the MPICH2 >> environment works first by running a simple MPI program and then trying to >> do MPI-IO with PVFS2. The reason for compiling PVFS2 support into MPICH2 is >> to do MPI-IO to PVFS2. If a simple, non-MPI-IO MPI program doesn't work >> then I would assume there is an issue with the MPICH2 installation that >> needs to get resolved. >> >> Michael >> >> >> On Sat, Nov 5, 2011 at 4:48 PM, nachiappan arumugam < >> [email protected]> wrote: >> >>> Hi Michael, >>> >>> Do you recommend installing MPICH2 and then install PVFS2 over it ? >>> But then the PVFS2 guide says I need to add the option --with-pvfs2 >>> while configuring MPICH2. >>> Is my understanding on this point correct ? I install PVFS2, then while >>> installing MPICH2, I add the option >>> ./configure --with-prefix=<path of the PVFS2> >>> >>> On Sat, Nov 5, 2011 at 9:34 AM, Michael Moore <[email protected]>wrote: >>> >>>> Hi Nachiappan, >>>> >>>> I don't believe there is a full guide explaining PVFS with MPICH2. A >>>> first step may be to take PVFS2 out of the equation and make sure you have >>>> a working MPICH2 environment and then add PVFS2 back. It appears you're >>>> following the right install guides so your setup may just need a little >>>> tweaking. I know there are several people on the list with lots of >>>> MPICH2/PVFS experience who may be able to provide some more specific >>>> pointers. >>>> >>>> Michael >>>> >>>> On Sat, Nov 5, 2011 at 12:13 AM, nachiappan arumugam < >>>> [email protected]> wrote: >>>> >>>>> Hi All, >>>>> >>>>> I am a newbie to PVFS and I am trying to setup a cluster using Amazon >>>>> EC2 nodes. >>>>> I followed the steps mentioned in >>>>> http://www.pvfs.org/cvs/pvfs-2-8-branch-docs/doc//pvfs2-quickstart.pdfto >>>>> setup PVFS2. >>>>> I verified the setup using ./pvfs2-ping and ./pvfs2-cp and it worked >>>>> fine - so my assumption here is that PVFS has started working. >>>>> In my setup I have four IO server of which one also acts as metadata >>>>> server and all 4 act as compute nodes as well. >>>>> >>>>> With this assumption I proceeded with the installation of MPICH2, for >>>>> this I followed the instructions mentioned in >>>>> >>>>> http://www.mcs.anl.gov/research/projects/mpich2/documentation/files/mpich2-1.4.1-installguide.pdf >>>>> >>>>> In the PVFS guide it was mentioned that if MPI has to talk to PVFS I >>>>> need to add --with-pvfs2=PVFS PREFIX while doing ./configure of MPICH. >>>>> Is this the right way to do ? After doing this I wrote a simple MPI >>>>> program, compiled it and tried running on all the 4 nodes and I >>>>> got an error message saying the executable is not available on the >>>>> other three nodes, so the execution failed. I tried placing the executable >>>>> on PVFS and as well as on the local disk of the machine where I >>>>> compiled it. And still I wasnt able to run the program on all the nodes. >>>>> >>>>> I am not sure where I am going wrong so looking for help or pointers. >>>>> Is there a guide which explains the complete steps to setup a cluster with >>>>> PVFS2 and MPICH2? >>>>> >>>>> Thanks, >>>>> Nachiappan A >>>>> >>>>> _______________________________________________ >>>>> Pvfs2-users mailing list >>>>> [email protected] >>>>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users >>>>> >>>>> >>>> >>> >>> >>> -- >>> Thanks, >>> Nachiappan A >>> >>> >> > >
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
