For OrangeFS 2.9, the default filesystem name has been changed from
pvfs2-fs to orangefs, which changes the URL in the pvfs2tab file

Jim

On Wed, Feb 4, 2015 at 1:02 PM, Mike Marshall <[email protected]> wrote:

> $ sudo /bin/sh -c 'echo "tcp://localhost:3334/pvfs2-fs /mnt/pvfs2
> pvfs2 defaults,noauto 0 0" >> /etc/pvfs2tab'
>
> I think the above step should have, instead, been:
>
> $ sudo /bin/sh -c 'echo "tcp://localhost:3334/orangefs /mnt/pvfs2
> pvfs2 defaults,noauto 0 0" >> /etc/pvfs2tab'
>
> -Mike
>
> On Wed, Feb 4, 2015 at 4:51 AM, Prof. Dr. Christian Baun
> <[email protected]> wrote:
> > Sorry for the delay. With the SVN update I was able to compile it. The
> > PVS2 server starts but it is not functional up to now. Maybe I made a
> > mistake at some point. I played around a bit with the fstab entry and
> > with different server configurations but I was not able to fix this
> > issue up to now. These are the steps I did:
> >
> > $ svn update
> > Updating '.':
> > U    src/apps/kernel/linux/pvfs2-client-core.c
> > Updated to revision 11687.
> >
> > $ ./prepare
> > configure script successfully regenerated
> >
> > $ ./configure --enable-fuse
> > ...
> > ***** Displaying PVFS Configuration Information *****
> > ------------------------------------------------------
> > PVFS2 configured to build karma gui               :  no
> > PVFS2 configured to build visualization tools     :  no
> > PVFS2 configured to perform coverage analysis     :  no
> > PVFS2 configured for aio threaded callbacks       : yes
> > PVFS2 configured to use FUSE                      : yes
> > PVFS2 configured for the 2.6/3 kernel module      :  no
> > PVFS2 configured for the 2.4.x kernel module      :  no
> > PVFS2 configured for using the mmap-ra-cache      :  no
> > PVFS2 configured for resetting file position      :  no
> > PVFS2 will use workaround for redhat 2.4 kernels  :  no
> > PVFS2 will use workaround for buggy NPTL          :  no
> > PVFS2 server capability cache enabled             : yes
> > PVFS2 server credential cache enabled             :  no
> > PVFS2 server certificate cache enabled            :  no
> > PVFS2 configured with key-based security          :  no
> > PVFS2 configured with certificate-based security  :  no
> > PVFS2 server will be built                        : yes
> > PVFS2 configured with profiling enabled           :  no
> > PVFS2 user interface libraries will be built      : yes
> > PVFS2 symbolic libraries will be built            :  no
> > PVFS2 user environment variables enabled          :  no
> > PVFS2 user interface library cache enabled        :  no
> > Malloc will be redefined                          : yes
> > PVFS2 client JNI enabled                          :  no
> >
> > PVFS2 version string: 2.9.0-orangefs-2015-02-03-183255
> >
> > $ make
> > ...
> >  LD src/apps/fuse/pvfs2fuse
> >   GENCONFIG     src/server/simple.conf
> >   GENCONFIG     examples/fs.conf
> >
> > $ sudo make install
> > ...
> > install -d /usr/local/sbin
> > install -m 755 ./src/apps/admin/pvfs2-start-all /usr/local/sbin
> > install -m 755 ./src/apps/admin/pvfs2-stop-all /usr/local/sbin
> > install -m 755 src/apps/admin/pvfs2-mkspace
> > src/apps/admin/pvfs2-migrate-collection
> > src/apps/admin/pvfs2-change-fsid src/apps/admin/pvfs2-showcoll
> > /usr/local/bin
> > install -m 755 src/apps/kernel/linux/pvfs2-client
> > src/apps/kernel/linux/pvfs2-client-core  /usr/local/sbin
> > install -m 755 src/server/pvfs2-server /usr/local/sbin
> > rm -f /usr/local/bin/.pvfs2-genconfig-* &> /dev/null
> > # create etc dir under install dir
> > install -d /usr/local/etc
> >
> > $ sudo mkdir /pvfs2-storage-space
> >
> > $ sudo pvfs2-genconfig --protocol tcp --tcpport 3334 --storage
> > /pvfs2-storage-space --logfile /tmp/pvfs2-server.log --ioservers pi81
> > --metaservers pi81 /etc/pvfs2-fs.conf --quiet
> >
> >
> > $ sudo pvfs2-server /etc/pvfs2-fs.conf -f[S 02/04/2015 10:18:34] PVFS2
> > Server on node pi81 version 2.9.0-orangefs-2015-02-03-183255
> > starting...
> > *** WARNING *** *** WARNING *** *** WARNING ***
> > *The MetadataStorageSpace path /pvfs2-storage-space appears
> >       to be on the root device.
> > *It is recommended that the meta data be
> >       stored on a dedicated partition.
> > *If you have a dedicated partition setup,
> >       please be sure it is mounted.
> >
> > *** WARNING *** *** WARNING *** *** WARNING ***
> > *The DataStorageSpace path /pvfs2-storage-space appears
> >       to be on the root device.
> > *It is recommended that the data be
> >       stored on a dedicated partition.
> > *If you have a dedicated partition setup,
> >       please be sure it is mounted.
> >
> > [D 02/04/2015 10:18:34] PVFS2 Server: storage space created. Exiting.
> >
> > $ sudo pvfs2-server /etc/pvfs2-fs.conf
> > [S 02/04/2015 10:18:47] PVFS2 Server on node pi81 version
> > 2.9.0-orangefs-2015-02-03-183255 starting...
> >
> > $ ps xa | grep pvfs2-server
> >  6522 ?        Ssl    0:07 pvfs2-server /etc/pvfs2-fs.conf
> >
> > $ cat /tmp/pvfs2-server.log
> > [D 02/04/2015 10:18:47] PVFS2 Server version
> > 2.9.0-orangefs-2015-02-03-183255 starting.
> >
> > $ sudo mkdir /mnt/pvfs2
> >
> > $ sudo /bin/sh -c 'echo "tcp://localhost:3334/pvfs2-fs /mnt/pvfs2
> > pvfs2 defaults,noauto 0 0" >> /etc/pvfs2tab'
> >
> > $ cat /etc/fstab | grep pvfs
> > tcp://localhost:3334/pvfs2-fs /mnt/pvfs2 pvfs2 defaults,noauto 0 0
> >
> > $ pvfs2-ping -m /mnt/pvfs2
> > (1) Parsing tab file...
> >
> > (2) Initializing system interface...
> >
> > (3) Initializing each file system found in tab file: /etc/fstab...
> >
> >    PVFS2 servers: tcp://localhost:3334
> >    Storage name: pvfs2-fs
> >    Local mount point: /mnt/pvfs2
> > [E 10:48:25.392599] Warning:
> >  Cannot retrieve information about filesystem pvfs2-fs at tab entry:
> > tcp://localhost:3334
> > [E 10:48:25.399835]
> > HINTS: If you're sure that your pvfstab file contains valid information,
> >  please make sure that you are not out of disk space and that you have
> >  write permissions in the current directory or in the /tmp directory
> >
> >    /mnt/pvfs2: FAILURE!
> >
> > Failure: could not initialze at least one of the target file systems.
> >
> > (4) Searching for /mnt/pvfs2 in pvfstab...
> > [E 10:48:25.402664] Error: /mnt/pvfs2 resides on a PVFS2 file system
> > that has not yet been initialized.
> > Failure: could not find filesystem for /mnt/pvfs2 in pvfs2tab /etc/fstab
> > Entry 0: /mnt/pvfs2
> >
> >
> > At this point I'm stuck now.
> >
> > Best Regards
> >    Christian
> >
> >
> >
> > 2015-02-03 16:39 GMT+01:00 James Burton <[email protected]>:
> >> Mike,
> >>
> >> Is the kernel module supposed to be compiling after the SVN update or is
> >> that still not working?
> >>
> >> Jim
> >>
> >> On Mon, Feb 2, 2015 at 4:35 PM, Mike Marshall <[email protected]>
> wrote:
> >>>
> >>> Hello Prof. Baun...
> >>>
> >>> I think I fixed what is causing your problem, so if you do an svn
> update,
> >>> you can give it a try.
> >>>
> >>> I inadvertently put the pvfs2_khandle_from_handle function inside of an
> >>> ifdef, and one of your --disables made it disappear.
> >>>
> >>> -Mike
> >>>
> >>> On Sat, Jan 31, 2015 at 3:53 PM, Prof. Dr. Christian Baun
> >>> <[email protected]> wrote:
> >>> > Hello
> >>> >
> >>> > when I understood Jims reply correct, it should be possible to
> compile
> >>> > the server and maybe the FUSE client on arm. I tried it this way with
> >>> > the latest SVN revision and now I'm stuck at this point.
> >>> >
> >>> > $ mkdir /home/pi/orangefs_svn
> >>> > $ cd /home/pi/orangefs_svn
> >>> > $ svn checkout http://www.orangefs.org/svn/orangefs/trunk
> >>> > /home/pi/orangefs_svn
> >>> > $ ./prepare
> >>> > configure script successfully regenerated
> >>> > $ ./configure --enable-fuse
> >>> > ...
> >>> > ***** Displaying PVFS Configuration Information *****
> >>> > ------------------------------------------------------
> >>> > PVFS2 configured to build karma gui               :  no
> >>> > PVFS2 configured to build visualization tools     :  no
> >>> > PVFS2 configured to perform coverage analysis     :  no
> >>> > PVFS2 configured for aio threaded callbacks       : yes
> >>> > PVFS2 configured to use FUSE                      : yes
> >>> > PVFS2 configured for the 2.6/3 kernel module      :  no
> >>> > PVFS2 configured for the 2.4.x kernel module      :  no
> >>> > PVFS2 configured for using the mmap-ra-cache      :  no
> >>> > PVFS2 configured for resetting file position      :  no
> >>> > PVFS2 will use workaround for redhat 2.4 kernels  :  no
> >>> > PVFS2 will use workaround for buggy NPTL          :  no
> >>> > PVFS2 server capability cache enabled             : yes
> >>> > PVFS2 server credential cache enabled             :  no
> >>> > PVFS2 server certificate cache enabled            :  no
> >>> > PVFS2 configured with key-based security          :  no
> >>> > PVFS2 configured with certificate-based security  :  no
> >>> > PVFS2 server will be built                        : yes
> >>> > PVFS2 configured with profiling enabled           :  no
> >>> > PVFS2 user interface libraries will be built      : yes
> >>> > PVFS2 symbolic libraries will be built            :  no
> >>> > PVFS2 user environment variables enabled          :  no
> >>> > PVFS2 user interface library cache enabled        :  no
> >>> > Malloc will be redefined                          : yes
> >>> > PVFS2 client JNI enabled                          :  no
> >>> >
> >>> > PVFS2 version string: 2.9.0-orangefs-2015-01-31-084642
> >>> >
> >>> > $ make
> >>> > ...
> >>> >  CC src/apps/kernel/linux/pvfs2-client.o
> >>> >  LD src/apps/kernel/linux/pvfs2-client
> >>> >  CC src/apps/kernel/linux/pvfs2-client-core.o
> >>> > src/apps/kernel/linux/pvfs2-client-core.c: In function
> >>> > ‘package_downcall_members’:
> >>> > src/apps/kernel/linux/pvfs2-client-core.c:2931:17: warning: implicit
> >>> > declaration of function ‘pvfs2_khandle_from_handle’
> >>> > [-Wimplicit-function-declaration]
> >>> >  LD src/apps/kernel/linux/pvfs2-client-core
> >>> > src/apps/kernel/linux/pvfs2-client-core.o: In function
> >>> > `package_downcall_members':
> >>> > /home/pi/orangefs_svn/src/apps/kernel/linux/pvfs2-client-core.c:3057:
> >>> > undefined reference to `pvfs2_khandle_from_handle'
> >>> > /home/pi/orangefs_svn/src/apps/kernel/linux/pvfs2-client-core.c:3114:
> >>> > undefined reference to `pvfs2_khandle_from_handle'
> >>> > /home/pi/orangefs_svn/src/apps/kernel/linux/pvfs2-client-core.c:3222:
> >>> > undefined reference to `pvfs2_khandle_from_handle'
> >>> > collect2: ld returned 1 exit status
> >>> > Makefile:1058: recipe for target
> >>> > 'src/apps/kernel/linux/pvfs2-client-core' failed
> >>> > make: *** [src/apps/kernel/linux/pvfs2-client-core] Error 1
> >>> >
> >>> > The same result is when I try to build just the fuse client via
> >>> >
> >>> > $ ./configure --disable-server --disable-usrint --disable-opt
> >>> > --enable-fuse
> >>> > $ make
> >>> >
> >>> > What I can try to solve this issue?
> >>> >
> >>> > Best Regards and thanks for any help.
> >>> >    Christian
> >>> >
> >>> > ---
> >>> > Prof. Dr. Christian Baun
> >>> > http://www.christianbaun.de
> >>> > Frankfurt University of Applied Sciences
> >>> > Nibelungenplatz 1, 60318 Frankfurt am Main
> >>> >
> >>> >
> >>> >
> >>> > 2015-01-30 23:52 GMT+01:00 James Burton <[email protected]>:
> >>> >> OrangeFS is not supported and has not been tested on Raspian.
> >>> >>
> >>> >> That being said, we have gotten some inquiries about this and there
> was
> >>> >> a
> >>> >> recent change in SVN that fixes this problem and allows OrangeFS to
> >>> >> build.
> >>> >> (The problem was caused by a function call that is implemented for
> >>> >> Intel
> >>> >> processors, but not for ARM. See
> http://linux.die.net/man/2/fadvise64)
> >>> >>
> >>> >> You can get the most recent version from the following svn
> repository
> >>> >>
> >>> >> http://www.orangefs.org/svn/orangefs/trunk
> >>> >>
> >>> >> Currently, the kernel module will not compile on Raspian, but you
> may
> >>> >> be
> >>> >> able to mount the filesystem via fuse.
> >>> >>
> >>> >> Good luck!
> >>> >>
> >>> >> Jim Burton
> >>> >>
> >>> >> On Fri, Jan 30, 2015 at 5:40 PM, Prof. Dr. Christian Baun
> >>> >> <[email protected]> wrote:
> >>> >>>
> >>> >>> Hello,
> >>> >>>
> >>> >>> I try to install OrangeFS from source on a Raspberry Pi with
> Raspbian
> >>> >>> as operating system. During the make step, an error occurs at this
> >>> >>> point I'm stuck now. My steps are:
> >>> >>>
> >>> >>> $ uname -r
> >>> >>> 3.12.35+
> >>> >>>
> >>> >>> $ sudo wget -P /usr/src/
> >>> >>>
> http://www.orangefs.org/downloads/LATEST/source/orangefs-2.9.0.tar.gz
> >>> >>>
> >>> >>> $ sudo tar -xvzf /usr/src/orangefs-2.9.0.tar.gz -C /usr/src/
> >>> >>> $ sudo /bin/sh -c 'cd /usr/src/orangefs-2.9.0; ./configure
> >>> >>> -with-kernel=/usr/src/linux-source-3.12'
> >>> >>> …
> >>> >>> ***** Displaying PVFS Configuration Information *****
> >>> >>> ------------------------------------------------------
> >>> >>> PVFS2 configured to build karma gui               :  no
> >>> >>> PVFS2 configured to build visualization tools     :  no
> >>> >>> PVFS2 configured to perform coverage analysis     :  no
> >>> >>> PVFS2 configured for aio threaded callbacks       : yes
> >>> >>> PVFS2 configured to use FUSE                      :  no
> >>> >>> PVFS2 configured for the 2.6/3 kernel module      : yes
> >>> >>> PVFS2 configured for the 2.4.x kernel module      :  no
> >>> >>> PVFS2 configured for using the mmap-ra-cache      :  no
> >>> >>> PVFS2 configured for resetting file position      :  no
> >>> >>> PVFS2 will use workaround for redhat 2.4 kernels  :  no
> >>> >>> PVFS2 will use workaround for buggy NPTL          :  no
> >>> >>> PVFS2 server capability cache enabled             : yes
> >>> >>> PVFS2 server credential cache enabled             :  no
> >>> >>> PVFS2 server certificate cache enabled            :  no
> >>> >>> PVFS2 configured with key-based security          :  no
> >>> >>> PVFS2 configured with certificate-based security  :  no
> >>> >>> PVFS2 server will be built                        : yes
> >>> >>> PVFS2 configured with profiling enabled           :  no
> >>> >>> PVFS2 user interface libraries will be built      : yes
> >>> >>> PVFS2 symbolic libraries will be built            :  no
> >>> >>> PVFS2 user environment variables enabled          :  no
> >>> >>> PVFS2 user interface library cache enabled        :  no
> >>> >>> Malloc will be redefined                          : yes
> >>> >>> PVFS2 client JNI enabled                          :  no
> >>> >>>
> >>> >>> PVFS2 version string: 2.9.0-
> >>> >>>
> >>> >>> $ sudo make
> >>> >>> ...
> >>> >>>  CC src/io/dev/pint-dev.o
> >>> >>>  RANLIB lib/libpvfs2.a
> >>> >>>  CC src/client/usrint/pvfs-path.o
> >>> >>>  CC src/client/usrint/mmap.o
> >>> >>>  CC src/client/usrint/openfile-util.o
> >>> >>> src/client/usrint/openfile-util.c: In function
> ‘my_glibc_fadvise64’:
> >>> >>> src/client/usrint/openfile-util.c:292:20: error: ‘SYS_fadvise64’
> >>> >>> undeclared (first use in this function)
> >>> >>> src/client/usrint/openfile-util.c:292:20: note: each undeclared
> >>> >>> identifier is reported only once for each function it appears in
> >>> >>> src/client/usrint/openfile-util.c:293:1: warning: control reaches
> end
> >>> >>> of non-void function [-Wreturn-type]
> >>> >>> Makefile:1082: recipe for target
> 'src/client/usrint/openfile-util.o'
> >>> >>> failed
> >>> >>> make: *** [src/client/usrint/openfile-util.o] Error 1
> >>> >>>
> >>> >>>
> >>> >>> What can I do to handle this issue?
> >>> >>>
> >>> >>> Thanks for any help.
> >>> >>>
> >>> >>>     Christian
> >>> >>>
> >>> >>> ---
> >>> >>> Prof. Dr. Christian Baun
> >>> >>> http://www.christianbaun.de
> >>> >>> Frankfurt University of Applied Sciences
> >>> >>> Nibelungenplatz 1, 60318 Frankfurt am Main
> >>> >>>
> >>> >>> _______________________________________________
> >>> >>> Pvfs2-users mailing list
> >>> >>> [email protected]
> >>> >>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
> >>> >>
> >>> >>
> >>> >
> >>> > ---
> >>> > Prof. Dr. Christian Baun
> >>> > http://www.christianbaun.de
> >>> > Frankfurt University of Applied Sciences
> >>> > Nibelungenplatz 1, 60318 Frankfurt am Main
> >>> > Büro: +49-69-1533-3196
> >>> > Privat: +49-6235-9591351
> >>> > Mobil: +49-170-2817531
> >>> >
> >>> > Die 2. Auflage von "Computernetze kompakt" ist erschienen.
> >>> > ISBN 978-3-642-41652-1. Springer Vieweg. Februar 2014
> >>> >
> >>> >
> >>> > 2015-01-30 23:52 GMT+01:00 James Burton <[email protected]>:
> >>> >> OrangeFS is not supported and has not been tested on Raspian.
> >>> >>
> >>> >> That being said, we have gotten some inquiries about this and there
> was
> >>> >> a
> >>> >> recent change in SVN that fixes this problem and allows OrangeFS to
> >>> >> build.
> >>> >> (The problem was caused by a function call that is implemented for
> >>> >> Intel
> >>> >> processors, but not for ARM. See
> http://linux.die.net/man/2/fadvise64)
> >>> >>
> >>> >> You can get the most recent version from the following svn
> repository
> >>> >>
> >>> >> http://www.orangefs.org/svn/orangefs/trunk
> >>> >>
> >>> >> Currently, the kernel module will not compile on Raspian, but you
> may
> >>> >> be
> >>> >> able to mount the filesystem via fuse.
> >>> >>
> >>> >> Good luck!
> >>> >>
> >>> >> Jim Burton
> >>> >>
> >>> >> On Fri, Jan 30, 2015 at 5:40 PM, Prof. Dr. Christian Baun
> >>> >> <[email protected]> wrote:
> >>> >>>
> >>> >>> Hello,
> >>> >>>
> >>> >>> I try to install OrangeFS from source on a Raspberry Pi with
> Raspbian
> >>> >>> as operating system. During the make step, an error occurs at this
> >>> >>> point I'm stuck now. My steps are:
> >>> >>>
> >>> >>> $ uname -r
> >>> >>> 3.12.35+
> >>> >>>
> >>> >>> $ sudo wget -P /usr/src/
> >>> >>>
> http://www.orangefs.org/downloads/LATEST/source/orangefs-2.9.0.tar.gz
> >>> >>>
> >>> >>> $ sudo tar -xvzf /usr/src/orangefs-2.9.0.tar.gz -C /usr/src/
> >>> >>> $ sudo /bin/sh -c 'cd /usr/src/orangefs-2.9.0; ./configure
> >>> >>> -with-kernel=/usr/src/linux-source-3.12'
> >>> >>> …
> >>> >>> ***** Displaying PVFS Configuration Information *****
> >>> >>> ------------------------------------------------------
> >>> >>> PVFS2 configured to build karma gui               :  no
> >>> >>> PVFS2 configured to build visualization tools     :  no
> >>> >>> PVFS2 configured to perform coverage analysis     :  no
> >>> >>> PVFS2 configured for aio threaded callbacks       : yes
> >>> >>> PVFS2 configured to use FUSE                      :  no
> >>> >>> PVFS2 configured for the 2.6/3 kernel module      : yes
> >>> >>> PVFS2 configured for the 2.4.x kernel module      :  no
> >>> >>> PVFS2 configured for using the mmap-ra-cache      :  no
> >>> >>> PVFS2 configured for resetting file position      :  no
> >>> >>> PVFS2 will use workaround for redhat 2.4 kernels  :  no
> >>> >>> PVFS2 will use workaround for buggy NPTL          :  no
> >>> >>> PVFS2 server capability cache enabled             : yes
> >>> >>> PVFS2 server credential cache enabled             :  no
> >>> >>> PVFS2 server certificate cache enabled            :  no
> >>> >>> PVFS2 configured with key-based security          :  no
> >>> >>> PVFS2 configured with certificate-based security  :  no
> >>> >>> PVFS2 server will be built                        : yes
> >>> >>> PVFS2 configured with profiling enabled           :  no
> >>> >>> PVFS2 user interface libraries will be built      : yes
> >>> >>> PVFS2 symbolic libraries will be built            :  no
> >>> >>> PVFS2 user environment variables enabled          :  no
> >>> >>> PVFS2 user interface library cache enabled        :  no
> >>> >>> Malloc will be redefined                          : yes
> >>> >>> PVFS2 client JNI enabled                          :  no
> >>> >>>
> >>> >>> PVFS2 version string: 2.9.0-
> >>> >>>
> >>> >>> $ sudo make
> >>> >>> ...
> >>> >>>  CC src/io/dev/pint-dev.o
> >>> >>>  RANLIB lib/libpvfs2.a
> >>> >>>  CC src/client/usrint/pvfs-path.o
> >>> >>>  CC src/client/usrint/mmap.o
> >>> >>>  CC src/client/usrint/openfile-util.o
> >>> >>> src/client/usrint/openfile-util.c: In function
> ‘my_glibc_fadvise64’:
> >>> >>> src/client/usrint/openfile-util.c:292:20: error: ‘SYS_fadvise64’
> >>> >>> undeclared (first use in this function)
> >>> >>> src/client/usrint/openfile-util.c:292:20: note: each undeclared
> >>> >>> identifier is reported only once for each function it appears in
> >>> >>> src/client/usrint/openfile-util.c:293:1: warning: control reaches
> end
> >>> >>> of non-void function [-Wreturn-type]
> >>> >>> Makefile:1082: recipe for target
> 'src/client/usrint/openfile-util.o'
> >>> >>> failed
> >>> >>> make: *** [src/client/usrint/openfile-util.o] Error 1
> >>> >>>
> >>> >>>
> >>> >>> What can I do to handle this issue?
> >>> >>>
> >>> >>> Thanks for any help.
> >>> >>>
> >>> >>>     Christian
> >>> >>>
> >>> >>> ---
> >>> >>> Prof. Dr. Christian Baun
> >>> >>> http://www.christianbaun.de
> >>> >>> Frankfurt University of Applied Sciences
> >>> >>> Nibelungenplatz 1, 60318 Frankfurt am Main
> >>> >>>
> >>> >>> _______________________________________________
> >>> >>> Pvfs2-users mailing list
> >>> >>> [email protected]
> >>> >>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
> >>> >>
> >>> >>
> >>> >
> >>> > _______________________________________________
> >>> > Pvfs2-users mailing list
> >>> > [email protected]
> >>> > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
> >>>
> >>> _______________________________________________
> >>> Pvfs2-users mailing list
> >>> [email protected]
> >>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
> >>
> >>
>
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

Reply via email to