I've recompiled BerkeleyDB using the following:

cd db-4.8.30/build_unix && ../dist/configure -C --prefix=/usr/local/db4.8.30 
--enable-shared  --enable-java --enable-static --enable-test --enable-cxx 
--enable-tcl --with-tcl=/usr/lib64/ && make

I'm still getting the same errors.

Thanks for your help BTW!!

_______________
Marcus Jackson
IT Specialist - Economics
Phone: (202) 649-5439
Fax: (571) 918-6970

This message is intended for designated recipients only. If you have received 
this message in error, please delete the original and all copies and notify the 
sender immediately. Federal law prohibits the disclosure or other use of this 
information.

From: [email protected] [mailto:[email protected]] On Behalf Of Becky Ligon
Sent: Friday, March 28, 2014 5:12 PM
To: Jackson, Marcus
Cc: [email protected]
Subject: Re: [Pvfs2-users] Storage Create Failed; Aborting

Marcus:

Here is how we build the Berkeley DB within an rpm that we created just for 
this purpose:
cd build_unix
../dist/configure -C --prefix=/opt/db4 --enable-shared --enable-static  
--enable-java --enable-test --enable-cxx
make install -C build_unix DESTDIR=${RPM_BUILD_ROOT}
After installing the files, we issue a /sbin/ldconfig


Seems like you may need the --enable-shared option, so a shareable library is 
created.  Then, before running pvfs2-server, make sure you have the correct db4 
path listed in LD_LIBRARY_PATH.   Otherwise, the code will look in the default 
locations for Berkeley DB, and I think that it what's happening.

Becky

On Fri, Mar 28, 2014 at 4:32 PM, Becky Ligon 
<[email protected]<mailto:[email protected]>> wrote:
Marcus:
Set the following environment variables, recompile OrangeFS, and install.  
Then, try running pvfs2-server with the -f option:

1.  Replace /opt/db4 with /usr/local/db4.8.30
export LIBRARY_PATH=/opt/db4/lib:$LIBRARY_PATH
export C_INCLUDE_PATH=/opt/db4/include:$C_INCLUDE_PATH
export LD_LIBRARY_PATH=/opt/db4/lib:$LD_LIBRARY_PATH



2.  CD to /opt/orangefs/orangefs-2.8.8
3.  make clean
4. make install
5. make kmod_prefix=/opt/orangefs kmod_install
6. CD /opt/orangefs
7.  before trying to create the storage directories, make sure they have no 
files defined and that you have appropriate permissions

bin/pvfs2-server -f etc/orangefs-server.conf


Becky


On Fri, Mar 28, 2014 at 3:08 PM, Jackson, Marcus 
<[email protected]<mailto:[email protected]>> wrote:
Thanks. Here is the output of the env command:

[root@master01 ~]# env | grep LD_L
LD_LIBRARY_PATH=/usr/local/db4.8.30/lib:

_______________
Marcus Jackson
IT Specialist - Economics
Phone: (202) 649-5439<tel:%28202%29%20649-5439>
Fax: (571) 918-6970<tel:%28571%29%20918-6970>

This message is intended for designated recipients only. If you have received 
this message in error, please delete the original and all copies and notify the 
sender immediately. Federal law prohibits the disclosure or other use of this 
information.

From: [email protected]<mailto:[email protected]> 
[mailto:[email protected]<mailto:[email protected]>] On Behalf Of Becky 
Ligon
Sent: Friday, March 28, 2014 3:07 PM
To: Jackson, Marcus
Cc: 
[email protected]<mailto:[email protected]>
Subject: Re: [Pvfs2-users] Storage Create Failed; Aborting

Marcus:
Make sure LD_LIBRARY_PATH includes the location of the db4 libraries in your 
environment before calling pvfs2-server.  In your case, I assume the location 
is /usr/local/db4.8.30/lib.
Becky

On Fri, Mar 28, 2014 at 2:53 PM, Jackson, Marcus 
<[email protected]<mailto:[email protected]>> wrote:
Environment:
CentOS
Kernel 2.6.32-431.11.2.el6.x86_64

BerkeleyDB 4.8.30
OrangeFS 2.8.8

I've run through the setup steps as outlined at 
http://www.omnibond.com/orangefs/docs/v_2_8_8/index.htm


How I installed BerkeleyDB:

cd /opt && tar xvf ~/db-4.8.30.tar.gz
cd db-4.8.30/build_unix && ../dist/configure --prefix=/usr/local/db4.8.30 
--enable-compat185 --enable-dbm --disable-static --enable-cxx && make
make install
make docdir=/usr/share/doc/db-4.8.30 install &&
chown -v -R root:root                        \
      /usr/bin/db_*                          \
      /usr/include/db{,_185,_cxx}.h          \
      /usr/lib/libdb*.{so,la}                \
      /usr/share/doc/db-4.8.30

How I installed OrangeFS:

cd /opt && rm -rf orangefs && mkdir orangefs && cd orangefs && tar xvf 
~/orangefs-2.8.8.tar.gz
cd orangefs-2.8.8
./configure --prefix=/opt/orangefs 
--with-kernel=/usr/src/kernels/2.6.32-431.11.2.el6.x86_64 
--with-db=/usr/local/db4.8.30 && make
make install
cd /opt/orangefs/orangefs-2.8.8
make kmod
make kmod_prefix=/opt/orangefs kmod_install



When using the following command, I receive this error message:

[root@master01 orangefs]# pvfs2-server -f /opt/orangefs/etc/orangefs-server.conf
[S 03/28/2014 14:37:57] PVFS2 Server on node master01 version 2.8.8-orangefs 
starting...
DB->compact: method not permitted before handle's open method
[E 03/28/2014 14:37:57] src/io/trove/trove-dbpf/dbpf-mgmt.c line 2273: 
db_close: Invalid argument
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(db_close+0x3e) [0x4663de]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server() [0x46977a]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(dbpf_storage_create+0x115) 
[0x46a395]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(trove_storage_create+0x1f) 
[0x45646f]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(pvfs2_mkspace+0x1fb) 
[0x441b5b]
[E 03/28/2014 14:37:57]         [bt] 
pvfs2-server(PINT_config_pvfs2_mkspace+0x1d8) [0x43c8c8]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(main+0xbba) [0x41628a]
[E 03/28/2014 14:37:57]         [bt] /lib64/libc.so.6(__libc_start_main+0xfd) 
[0x3fcf81ed1d]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server() [0x4126c9]
[E 03/28/2014 14:37:57] src/io/trove/trove-dbpf/dbpf-mgmt.c line 2309: 
dbpf_storage_create: Invalid argument
[E 03/28/2014 14:37:57]         [bt] pvfs2-server() [0x469815]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(dbpf_storage_create+0x115) 
[0x46a395]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(trove_storage_create+0x1f) 
[0x45646f]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(pvfs2_mkspace+0x1fb) 
[0x441b5b]
[E 03/28/2014 14:37:57]         [bt] 
pvfs2-server(PINT_config_pvfs2_mkspace+0x1d8) [0x43c8c8]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server(main+0xbba) [0x41628a]
[E 03/28/2014 14:37:57]         [bt] /lib64/libc.so.6(__libc_start_main+0xfd) 
[0x3fcf81ed1d]
[E 03/28/2014 14:37:57]         [bt] pvfs2-server() [0x4126c9]
[E 03/28/2014 14:37:57] error: storage create failed; aborting!

Configuration File:
--------------------------------------
<Defaults>
        UnexpectedRequests 50
        EventLogging none
        EnableTracing no
        LogStamp datetime
        BMIModules bmi_tcp
        FlowModules flowproto_multiqueue
        PerfUpdateInterval 1000
        ServerJobBMITimeoutSecs 30
        ServerJobFlowTimeoutSecs 30
        ClientJobBMITimeoutSecs 300
        ClientJobFlowTimeoutSecs 300
        ClientRetryLimit 5
        ClientRetryDelayMilliSecs 2000
        PrecreateBatchSize 0,32,512,32,32,32,0
        PrecreateLowThreshold 0,16,256,16,16,16,0
        DataStorageSpace /dist-fs/data
        MetadataStorageSpace /dist-fs/meta
        LogFile /var/log/orangefs-server.log
</Defaults>

<Aliases>
        Alias master01 tcp://master01:3334
        Alias master02 tcp://master02:3334
        Alias slave01 tcp://slave01:3334
        Alias slave02 tcp://slave02:3334
        Alias slave03 tcp://slave03:3334
        Alias slave04 tcp://slave04:3334
        Alias slave05 tcp://slave05:3334
        Alias slave06 tcp://slave06:3334
        Alias slave07 tcp://slave07:3334
        Alias slave08 tcp://slave08:3334
</Aliases>

<Filesystem>
        Name pvfs2-fs
        ID 1337569378
        RootHandle 1048576
        FileStuffing yes
        <MetaHandleRanges>
                Range master01 3-922337203685477582
                Range master02 922337203685477583-1844674407370955162
        </MetaHandleRanges>
        <DataHandleRanges>
                Range slave01 1844674407370955163-2767011611056432742
                Range slave02 2767011611056432743-3689348814741910322
                Range slave03 3689348814741910323-4611686018427387902
                Range slave04 4611686018427387903-5534023222112865482
                Range slave05 5534023222112865483-6456360425798343062
                Range slave06 6456360425798343063-7378697629483820642
                Range slave07 7378697629483820643-8301034833169298222
                Range slave08 8301034833169298223-9223372036854775802
        </DataHandleRanges>
        <StorageHints>
                TroveSyncMeta yes
                TroveSyncData no
                TroveMethod alt-aio
        </StorageHints>
</Filesystem>
--------------------------------------------------

[root@master01 orangefs]# df -h /dist-fs
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/hdp_meta-lv_meta
                      119G   33M  119G   1% /dist-fs

Please help.


This message is intended for designated recipients only. If you have received 
this message in error, please delete the original and all copies and notify the 
sender immediately. Federal law prohibits the disclosure or other use of this 
information.


_______________________________________________
Pvfs2-users mailing list
[email protected]<mailto:[email protected]>
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users



_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

Reply via email to