Fantastic! Becky
On Tue, Apr 1, 2014 at 5:29 PM, Jackson, Marcus < [email protected]> wrote: > Sam, Becky, > > > > You two are awesome. You've helped me immensely. > > > > Thanks so much! I'm in business now! > > > > > > > > _______________ > > Marcus Jackson > > IT Specialist - Economics > > Phone: (202) 649-5439 > > Fax: (571) 918-6970 > > > > This message is intended for designated recipients only. If you have > received this message in error, please delete the original and all copies > and notify the sender immediately. Federal law prohibits the disclosure or > other use of this information. > > > > *From:* [email protected] [mailto: > [email protected]] *On Behalf Of *Sam Sampson > *Sent:* Tuesday, April 01, 2014 4:58 PM > *To:* [email protected] > > *Subject:* RE: [Pvfs2-users] Storage Create Failed; Aborting > > > > Try: > > > > orangefs-2.8.8 # make clean > > orangefs-2.8.8 # ./configure ... [options you used before] > > orangefs-2.8.8 # make install > > orangefs-2.8.8 # ldd /opt/orangefs/sbin/pvfs2-server > > > > Does ldd indicate the correct db libs? > > > > If not, you might put the db lib path in /etc/ld.so.conf and run > /sbin/ldconfig. Then do the above commands again. > > > > Thanks, > > Sam Sampson > > Omnibond Systems LLC > > > > > > *From:* [email protected] [ > mailto:[email protected]<[email protected]>] > *On Behalf Of *Jackson, Marcus > *Sent:* Tuesday, April 01, 2014 3:51 PM > *To:* 'Becky Ligon' > *Cc:* [email protected] > *Subject:* RE: [Pvfs2-users] Storage Create Failed; Aborting > > > > I've recompiled BerkeleyDB using the following: > > > > cd db-4.8.30/build_unix && ../dist/configure -C > --prefix=/usr/local/db4.8.30 --enable-shared --enable-java --enable-static > --enable-test --enable-cxx --enable-tcl --with-tcl=/usr/lib64/ && make > > > > I'm still getting the same errors. > > > > Thanks for your help BTW!! > > > > _______________ > > Marcus Jackson > > IT Specialist - Economics > > Phone: (202) 649-5439 > > Fax: (571) 918-6970 > > > > This message is intended for designated recipients only. If you have > received this message in error, please delete the original and all copies > and notify the sender immediately. Federal law prohibits the disclosure or > other use of this information. > > > > *From:* [email protected] [mailto:[email protected]<[email protected]>] > *On Behalf Of *Becky Ligon > *Sent:* Friday, March 28, 2014 5:12 PM > *To:* Jackson, Marcus > *Cc:* [email protected] > *Subject:* Re: [Pvfs2-users] Storage Create Failed; Aborting > > > > Marcus: > > Here is how we build the Berkeley DB within an rpm that we created just > for this purpose: > > cd build_unix > > ../dist/configure -C --prefix=/opt/db4 --enable-shared --enable-static > --enable-java --enable-test --enable-cxx > > make install -C build_unix DESTDIR=${RPM_BUILD_ROOT} > > After installing the files, we issue a /sbin/ldconfig > > > > Seems like you may need the --enable-shared option, so a shareable library > is created. Then, before running pvfs2-server, make sure you have the > correct db4 path listed in LD_LIBRARY_PATH. Otherwise, the code will look > in the default locations for Berkeley DB, and I think that it what's > happening. > > Becky > > > > On Fri, Mar 28, 2014 at 4:32 PM, Becky Ligon <[email protected]> wrote: > > Marcus: > > Set the following environment variables, recompile OrangeFS, and install. > Then, try running pvfs2-server with the -f option: > > > > 1. Replace /opt/db4 with /usr/local/db4.8.30 > > export LIBRARY_PATH=/opt/db4/lib:$LIBRARY_PATH > export C_INCLUDE_PATH=/opt/db4/include:$C_INCLUDE_PATH > export LD_LIBRARY_PATH=/opt/db4/lib:$LD_LIBRARY_PATH > > 2. CD to /opt/orangefs/orangefs-2.8.8 > > 3. make clean > > 4. make install > > 5. make kmod_prefix=/opt/orangefs kmod_install > > 6. CD /opt/orangefs > > 7. before trying to create the storage directories, make sure they have > no files defined and that you have appropriate permissions > > bin/pvfs2-server -f etc/orangefs-server.conf > > Becky > > > > > > On Fri, Mar 28, 2014 at 3:08 PM, Jackson, Marcus < > [email protected]> wrote: > > Thanks. Here is the output of the env command: > > > > [root@master01 ~]# env | grep LD_L > > LD_LIBRARY_PATH=/usr/local/db4.8.30/lib: > > > > _______________ > > Marcus Jackson > > IT Specialist - Economics > > Phone: (202) 649-5439 > > Fax: (571) 918-6970 > > > > This message is intended for designated recipients only. If you have > received this message in error, please delete the original and all copies > and notify the sender immediately. Federal law prohibits the disclosure or > other use of this information. > > > > *From:* [email protected] [mailto:[email protected]] *On Behalf Of *Becky > Ligon > *Sent:* Friday, March 28, 2014 3:07 PM > *To:* Jackson, Marcus > *Cc:* [email protected] > *Subject:* Re: [Pvfs2-users] Storage Create Failed; Aborting > > > > Marcus: > > Make sure LD_LIBRARY_PATH includes the location of the db4 libraries in > your environment before calling pvfs2-server. In your case, I assume the > location is /usr/local/db4.8.30/lib. > > Becky > > > > On Fri, Mar 28, 2014 at 2:53 PM, Jackson, Marcus < > [email protected]> wrote: > > Environment: > > CentOS > > Kernel 2.6.32-431.11.2.el6.x86_64 > > > > BerkeleyDB 4.8.30 > > OrangeFS 2.8.8 > > > > I've run through the setup steps as outlined at > http://www.omnibond.com/orangefs/docs/v_2_8_8/index.htm > > > > > > How I installed BerkeleyDB: > > > > cd /opt && tar xvf ~/db-4.8.30.tar.gz > > cd db-4.8.30/build_unix && ../dist/configure --prefix=/usr/local/db4.8.30 > --enable-compat185 --enable-dbm --disable-static --enable-cxx && make > > make install > > make docdir=/usr/share/doc/db-4.8.30 install && > > chown -v -R root:root \ > > /usr/bin/db_* \ > > /usr/include/db{,_185,_cxx}.h \ > > /usr/lib/libdb*.{so,la} \ > > /usr/share/doc/db-4.8.30 > > > > How I installed OrangeFS: > > > > cd /opt && rm -rf orangefs && mkdir orangefs && cd orangefs && tar xvf > ~/orangefs-2.8.8.tar.gz > > cd orangefs-2.8.8 > > ./configure --prefix=/opt/orangefs > --with-kernel=/usr/src/kernels/2.6.32-431.11.2.el6.x86_64 > --with-db=/usr/local/db4.8.30 && make > > make install > > cd /opt/orangefs/orangefs-2.8.8 > > make kmod > > make kmod_prefix=/opt/orangefs kmod_install > > > > > > > > When using the following command, I receive this error message: > > > > [root@master01 orangefs]# pvfs2-server -f > /opt/orangefs/etc/orangefs-server.conf > > [S 03/28/2014 14:37:57] PVFS2 Server on node master01 version > 2.8.8-orangefs starting... > > DB->compact: method not permitted before handle's open method > > [E 03/28/2014 14:37:57] src/io/trove/trove-dbpf/dbpf-mgmt.c line 2273: > db_close: Invalid argument > > [E 03/28/2014 14:37:57] [bt] pvfs2-server(db_close+0x3e) [0x4663de] > > [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x46977a] > > [E 03/28/2014 14:37:57] [bt] > pvfs2-server(dbpf_storage_create+0x115) [0x46a395] > > [E 03/28/2014 14:37:57] [bt] > pvfs2-server(trove_storage_create+0x1f) [0x45646f] > > [E 03/28/2014 14:37:57] [bt] pvfs2-server(pvfs2_mkspace+0x1fb) > [0x441b5b] > > [E 03/28/2014 14:37:57] [bt] > pvfs2-server(PINT_config_pvfs2_mkspace+0x1d8) [0x43c8c8] > > [E 03/28/2014 14:37:57] [bt] pvfs2-server(main+0xbba) [0x41628a] > > [E 03/28/2014 14:37:57] [bt] > /lib64/libc.so.6(__libc_start_main+0xfd) [0x3fcf81ed1d] > > [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x4126c9] > > [E 03/28/2014 14:37:57] src/io/trove/trove-dbpf/dbpf-mgmt.c line 2309: > dbpf_storage_create: Invalid argument > > [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x469815] > > [E 03/28/2014 14:37:57] [bt] > pvfs2-server(dbpf_storage_create+0x115) [0x46a395] > > [E 03/28/2014 14:37:57] [bt] > pvfs2-server(trove_storage_create+0x1f) [0x45646f] > > [E 03/28/2014 14:37:57] [bt] pvfs2-server(pvfs2_mkspace+0x1fb) > [0x441b5b] > > [E 03/28/2014 14:37:57] [bt] > pvfs2-server(PINT_config_pvfs2_mkspace+0x1d8) [0x43c8c8] > > [E 03/28/2014 14:37:57] [bt] pvfs2-server(main+0xbba) [0x41628a] > > [E 03/28/2014 14:37:57] [bt] > /lib64/libc.so.6(__libc_start_main+0xfd) [0x3fcf81ed1d] > > [E 03/28/2014 14:37:57] [bt] pvfs2-server() [0x4126c9] > > [E 03/28/2014 14:37:57] error: storage create failed; aborting! > > > > Configuration File: > > -------------------------------------- > > <Defaults> > > UnexpectedRequests 50 > > EventLogging none > > EnableTracing no > > LogStamp datetime > > BMIModules bmi_tcp > > FlowModules flowproto_multiqueue > > PerfUpdateInterval 1000 > > ServerJobBMITimeoutSecs 30 > > ServerJobFlowTimeoutSecs 30 > > ClientJobBMITimeoutSecs 300 > > ClientJobFlowTimeoutSecs 300 > > ClientRetryLimit 5 > > ClientRetryDelayMilliSecs 2000 > > PrecreateBatchSize 0,32,512,32,32,32,0 > > PrecreateLowThreshold 0,16,256,16,16,16,0 > > DataStorageSpace /dist-fs/data > > MetadataStorageSpace /dist-fs/meta > > LogFile /var/log/orangefs-server.log > > </Defaults> > > > > <Aliases> > > Alias master01 tcp://master01:3334 > > Alias master02 tcp://master02:3334 > > Alias slave01 tcp://slave01:3334 > > Alias slave02 tcp://slave02:3334 > > Alias slave03 tcp://slave03:3334 > > Alias slave04 tcp://slave04:3334 > > Alias slave05 tcp://slave05:3334 > > Alias slave06 tcp://slave06:3334 > > Alias slave07 tcp://slave07:3334 > > Alias slave08 tcp://slave08:3334 > > </Aliases> > > > > <Filesystem> > > Name pvfs2-fs > > ID 1337569378 > > RootHandle 1048576 > > FileStuffing yes > > <MetaHandleRanges> > > Range master01 3-922337203685477582 > > Range master02 922337203685477583-1844674407370955162 > > </MetaHandleRanges> > > <DataHandleRanges> > > Range slave01 1844674407370955163-2767011611056432742 > > Range slave02 2767011611056432743-3689348814741910322 > > Range slave03 3689348814741910323-4611686018427387902 > > Range slave04 4611686018427387903-5534023222112865482 > > Range slave05 5534023222112865483-6456360425798343062 > > Range slave06 6456360425798343063-7378697629483820642 > > Range slave07 7378697629483820643-8301034833169298222 > > Range slave08 8301034833169298223-9223372036854775802 > > </DataHandleRanges> > > <StorageHints> > > TroveSyncMeta yes > > TroveSyncData no > > TroveMethod alt-aio > > </StorageHints> > > </Filesystem> > > -------------------------------------------------- > > > > [root@master01 orangefs]# df -h /dist-fs > > Filesystem Size Used Avail Use% Mounted on > > /dev/mapper/hdp_meta-lv_meta > > 119G 33M 119G 1% /dist-fs > > > > Please help. > > > > > > This message is intended for designated recipients only. If you have > received this message in error, please delete the original and all copies > and notify the sender immediately. Federal law prohibits the disclosure or > other use of this information. > > > > > _______________________________________________ > Pvfs2-users mailing list > [email protected] > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users > > > > > > > > _______________________________________________ > Pvfs2-users mailing list > [email protected] > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users > >
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
