Marcus:
Here is how we build the Berkeley DB within an rpm that we created just for
this purpose:
cd build_unix
../dist/configure -C --prefix=/opt/db4 --enable-shared --enable-static
--enable-java --enable-test --enable-cxx
make install -C build_unix DESTDIR=${RPM_BUILD_ROOT}
After installing the files, we issue a /sbin/ldconfig
Seems like you may need the --enable-shared option, so a shareable library
is created. Then, before running pvfs2-server, make sure you have the
correct db4 path listed in LD_LIBRARY_PATH. Otherwise, the code will look
in the default locations for Berkeley DB, and I think that it what's
happening.
Becky
On Fri, Mar 28, 2014 at 4:32 PM, Becky Ligon <[email protected]> wrote:
> Marcus:
>
> Set the following environment variables, recompile OrangeFS, and install.
> Then, try running pvfs2-server with the -f option:
>
> 1. Replace /opt/db4 with /usr/local/db4.8.30
>
> export LIBRARY_PATH=/opt/db4/lib:$LIBRARY_PATH
> export C_INCLUDE_PATH=/opt/db4/include:$C_INCLUDE_PATH
> export LD_LIBRARY_PATH=/opt/db4/lib:$LD_LIBRARY_PATH
>
>
>
>
> 2. CD to /opt/orangefs/orangefs-2.8.8
>
> 3. make clean
>
> 4. make install
>
> 5. make kmod_prefix=/opt/orangefs kmod_install
>
> 6. CD /opt/orangefs
>
> 7. before trying to create the storage directories, make sure they have
> no files defined and that you have appropriate permissions
>
> bin/pvfs2-server -f etc/orangefs-server.conf
>
>
>
> Becky
>
>
>
>
> On Fri, Mar 28, 2014 at 3:08 PM, Jackson, Marcus <
> [email protected]> wrote:
>
>> Thanks. Here is the output of the env command:
>>
>>
>>
>> [root@master01 ~]# env | grep LD_L
>>
>> LD_LIBRARY_PATH=/usr/local/db4.8.30/lib:
>>
>>
>>
>> _______________
>>
>> Marcus Jackson
>>
>> IT Specialist - Economics
>>
>> Phone: (202) 649-5439
>>
>> Fax: (571) 918-6970
>>
>>
>>
>> This message is intended for designated recipients only. If you have
>> received this message in error, please delete the original and all copies
>> and notify the sender immediately. Federal law prohibits the disclosure or
>> other use of this information.
>>
>>
>>
>> *From:* [email protected] [mailto:[email protected]] *On Behalf Of *Becky
>> Ligon
>> *Sent:* Friday, March 28, 2014 3:07 PM
>> *To:* Jackson, Marcus
>> *Cc:* [email protected]
>> *Subject:* Re: [Pvfs2-users] Storage Create Failed; Aborting
>>
>>
>>
>> Marcus:
>>
>> Make sure LD_LIBRARY_PATH includes the location of the db4 libraries in
>> your environment before calling pvfs2-server. In your case, I assume the
>> location is /usr/local/db4.8.30/lib.
>>
>> Becky
>>
>>
>>
>> On Fri, Mar 28, 2014 at 2:53 PM, Jackson, Marcus <
>> [email protected]> wrote:
>>
>> Environment:
>>
>> CentOS
>>
>> Kernel 2.6.32-431.11.2.el6.x86_64
>>
>>
>>
>> BerkeleyDB 4.8.30
>>
>> OrangeFS 2.8.8
>>
>>
>>
>> I've run through the setup steps as outlined at
>> http://www.omnibond.com/orangefs/docs/v_2_8_8/index.htm
>>
>>
>>
>>
>>
>> How I installed BerkeleyDB:
>>
>>
>>
>> cd /opt && tar xvf ~/db-4.8.30.tar.gz
>>
>> cd db-4.8.30/build_unix && ../dist/configure --prefix=/usr/local/db4.8.30
>> --enable-compat185 --enable-dbm --disable-static --enable-cxx && make
>>
>> make install
>>
>> make docdir=/usr/share/doc/db-4.8.30 install &&
>>
>> chown -v -R root:root \
>>
>> /usr/bin/db_* \
>>
>> /usr/include/db{,_185,_cxx}.h \
>>
>> /usr/lib/libdb*.{so,la} \
>>
>> /usr/share/doc/db-4.8.30
>>
>>
>>
>> How I installed OrangeFS:
>>
>>
>>
>> cd /opt && rm -rf orangefs && mkdir orangefs && cd orangefs && tar xvf
>> ~/orangefs-2.8.8.tar.gz
>>
>> cd orangefs-2.8.8
>>
>> ./configure --prefix=/opt/orangefs
>> --with-kernel=/usr/src/kernels/2.6.32-431.11.2.el6.x86_64
>> --with-db=/usr/local/db4.8.30 && make
>>
>> make install
>>
>> cd /opt/orangefs/orangefs-2.8.8
>>
>> make kmod
>>
>> make kmod_prefix=/opt/orangefs kmod_install
>>
>>
>>
>>
>>
>>
>>
>> When using the following command, I receive this error message:
>>
>>
>>
>> [root@master01 orangefs]# pvfs2-server -f
>> /opt/orangefs/etc/orangefs-server.conf
>>
>> [S 03/28/2014 14:37:57] PVFS2 Server on node master01 version
>> 2.8.8-orangefs starting...
>>
>> DB->compact: method not permitted before handle's open method
>>
>> [E 03/28/2014 14:37:57] src/io/trove/trove-dbpf/dbpf-mgmt.c line 2273:
>> db_close: Invalid argument
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server(db_close+0x3e)
>> [0x4663de]
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x46977a]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> pvfs2-server(dbpf_storage_create+0x115) [0x46a395]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> pvfs2-server(trove_storage_create+0x1f) [0x45646f]
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server(pvfs2_mkspace+0x1fb)
>> [0x441b5b]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> pvfs2-server(PINT_config_pvfs2_mkspace+0x1d8) [0x43c8c8]
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server(main+0xbba) [0x41628a]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> /lib64/libc.so.6(__libc_start_main+0xfd) [0x3fcf81ed1d]
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x4126c9]
>>
>> [E 03/28/2014 14:37:57] src/io/trove/trove-dbpf/dbpf-mgmt.c line 2309:
>> dbpf_storage_create: Invalid argument
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x469815]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> pvfs2-server(dbpf_storage_create+0x115) [0x46a395]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> pvfs2-server(trove_storage_create+0x1f) [0x45646f]
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server(pvfs2_mkspace+0x1fb)
>> [0x441b5b]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> pvfs2-server(PINT_config_pvfs2_mkspace+0x1d8) [0x43c8c8]
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server(main+0xbba) [0x41628a]
>>
>> [E 03/28/2014 14:37:57] [bt]
>> /lib64/libc.so.6(__libc_start_main+0xfd) [0x3fcf81ed1d]
>>
>> [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x4126c9]
>>
>> [E 03/28/2014 14:37:57] error: storage create failed; aborting!
>>
>>
>>
>> Configuration File:
>>
>> --------------------------------------
>>
>> <Defaults>
>>
>> UnexpectedRequests 50
>>
>> EventLogging none
>>
>> EnableTracing no
>>
>> LogStamp datetime
>>
>> BMIModules bmi_tcp
>>
>> FlowModules flowproto_multiqueue
>>
>> PerfUpdateInterval 1000
>>
>> ServerJobBMITimeoutSecs 30
>>
>> ServerJobFlowTimeoutSecs 30
>>
>> ClientJobBMITimeoutSecs 300
>>
>> ClientJobFlowTimeoutSecs 300
>>
>> ClientRetryLimit 5
>>
>> ClientRetryDelayMilliSecs 2000
>>
>> PrecreateBatchSize 0,32,512,32,32,32,0
>>
>> PrecreateLowThreshold 0,16,256,16,16,16,0
>>
>> DataStorageSpace /dist-fs/data
>>
>> MetadataStorageSpace /dist-fs/meta
>>
>> LogFile /var/log/orangefs-server.log
>>
>> </Defaults>
>>
>>
>>
>> <Aliases>
>>
>> Alias master01 tcp://master01:3334
>>
>> Alias master02 tcp://master02:3334
>>
>> Alias slave01 tcp://slave01:3334
>>
>> Alias slave02 tcp://slave02:3334
>>
>> Alias slave03 tcp://slave03:3334
>>
>> Alias slave04 tcp://slave04:3334
>>
>> Alias slave05 tcp://slave05:3334
>>
>> Alias slave06 tcp://slave06:3334
>>
>> Alias slave07 tcp://slave07:3334
>>
>> Alias slave08 tcp://slave08:3334
>>
>> </Aliases>
>>
>>
>>
>> <Filesystem>
>>
>> Name pvfs2-fs
>>
>> ID 1337569378
>>
>> RootHandle 1048576
>>
>> FileStuffing yes
>>
>> <MetaHandleRanges>
>>
>> Range master01 3-922337203685477582
>>
>> Range master02 922337203685477583-1844674407370955162
>>
>> </MetaHandleRanges>
>>
>> <DataHandleRanges>
>>
>> Range slave01 1844674407370955163-2767011611056432742
>>
>> Range slave02 2767011611056432743-3689348814741910322
>>
>> Range slave03 3689348814741910323-4611686018427387902
>>
>> Range slave04 4611686018427387903-5534023222112865482
>>
>> Range slave05 5534023222112865483-6456360425798343062
>>
>> Range slave06 6456360425798343063-7378697629483820642
>>
>> Range slave07 7378697629483820643-8301034833169298222
>>
>> Range slave08 8301034833169298223-9223372036854775802
>>
>> </DataHandleRanges>
>>
>> <StorageHints>
>>
>> TroveSyncMeta yes
>>
>> TroveSyncData no
>>
>> TroveMethod alt-aio
>>
>> </StorageHints>
>>
>> </Filesystem>
>>
>> --------------------------------------------------
>>
>>
>>
>> [root@master01 orangefs]# df -h /dist-fs
>>
>> Filesystem Size Used Avail Use% Mounted on
>>
>> /dev/mapper/hdp_meta-lv_meta
>>
>> 119G 33M 119G 1% /dist-fs
>>
>>
>>
>> Please help.
>>
>>
>>
>>
>>
>> This message is intended for designated recipients only. If you have
>> received this message in error, please delete the original and all copies
>> and notify the sender immediately. Federal law prohibits the disclosure or
>> other use of this information.
>>
>>
>>
>>
>> _______________________________________________
>> Pvfs2-users mailing list
>> [email protected]
>> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>>
>>
>>
>
>
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
