Hi Michael, Thanks for the clarifying my doubt, I had a another basic question, I compile my MPI program on one machine. So where should I place the executable ? Because all other nodes should be able to access the executable for running. Should I place the program in pvfs mounted directory ? I am using mpirun command directly to run the program. If I use schedulers like Bsub or Torque, will it take care of copying the executable to all the client nodes before running ?
When I tried placing the executable on local disk of all the nodes, my program worked fine. But when I tried placing the executable on the pvfs2 mounted directory, I got an error saying the executable was not found in the client nodes, even though the file was visible when I do a ./pvfs2-ls. But when I tried using NFS instead of PVFS2 I did not face this issue. Any clue on what is going behind ? -- Thanks, Nachiappan A On Sat, Nov 5, 2011 at 5:36 PM, Michael Moore <[email protected]> wrote: > Sorry I was not more clear. I think the installation order you're > following is correct. What I would recommend is making sure the MPICH2 > environment works first by running a simple MPI program and then trying to > do MPI-IO with PVFS2. The reason for compiling PVFS2 support into MPICH2 is > to do MPI-IO to PVFS2. If a simple, non-MPI-IO MPI program doesn't work > then I would assume there is an issue with the MPICH2 installation that > needs to get resolved. > > Michael > > > On Sat, Nov 5, 2011 at 4:48 PM, nachiappan arumugam < > [email protected]> wrote: > >> Hi Michael, >> >> Do you recommend installing MPICH2 and then install PVFS2 over it ? >> But then the PVFS2 guide says I need to add the option --with-pvfs2 while >> configuring MPICH2. >> Is my understanding on this point correct ? I install PVFS2, then while >> installing MPICH2, I add the option >> ./configure --with-prefix=<path of the PVFS2> >> >> On Sat, Nov 5, 2011 at 9:34 AM, Michael Moore <[email protected]>wrote: >> >>> Hi Nachiappan, >>> >>> I don't believe there is a full guide explaining PVFS with MPICH2. A >>> first step may be to take PVFS2 out of the equation and make sure you have >>> a working MPICH2 environment and then add PVFS2 back. It appears you're >>> following the right install guides so your setup may just need a little >>> tweaking. I know there are several people on the list with lots of >>> MPICH2/PVFS experience who may be able to provide some more specific >>> pointers. >>> >>> Michael >>> >>> On Sat, Nov 5, 2011 at 12:13 AM, nachiappan arumugam < >>> [email protected]> wrote: >>> >>>> Hi All, >>>> >>>> I am a newbie to PVFS and I am trying to setup a cluster using Amazon >>>> EC2 nodes. >>>> I followed the steps mentioned in >>>> http://www.pvfs.org/cvs/pvfs-2-8-branch-docs/doc//pvfs2-quickstart.pdfto >>>> setup PVFS2. >>>> I verified the setup using ./pvfs2-ping and ./pvfs2-cp and it worked >>>> fine - so my assumption here is that PVFS has started working. >>>> In my setup I have four IO server of which one also acts as metadata >>>> server and all 4 act as compute nodes as well. >>>> >>>> With this assumption I proceeded with the installation of MPICH2, for >>>> this I followed the instructions mentioned in >>>> >>>> http://www.mcs.anl.gov/research/projects/mpich2/documentation/files/mpich2-1.4.1-installguide.pdf >>>> >>>> In the PVFS guide it was mentioned that if MPI has to talk to PVFS I >>>> need to add --with-pvfs2=PVFS PREFIX while doing ./configure of MPICH. >>>> Is this the right way to do ? After doing this I wrote a simple MPI >>>> program, compiled it and tried running on all the 4 nodes and I >>>> got an error message saying the executable is not available on the >>>> other three nodes, so the execution failed. I tried placing the executable >>>> on PVFS and as well as on the local disk of the machine where I >>>> compiled it. And still I wasnt able to run the program on all the nodes. >>>> >>>> I am not sure where I am going wrong so looking for help or pointers. >>>> Is there a guide which explains the complete steps to setup a cluster with >>>> PVFS2 and MPICH2? >>>> >>>> Thanks, >>>> Nachiappan A >>>> >>>> _______________________________________________ >>>> Pvfs2-users mailing list >>>> [email protected] >>>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users >>>> >>>> >>> >> >> >> -- >> Thanks, >> Nachiappan A >> >> >
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
