On our production servers, we increased the shared memory for BDB to about 2gigs, and we have BDB on a SSD. This way, MOST of the frequently accessed metadata will be in memory or, at least, on fast disk. Also, we recommend that all of the servers in your OrangeFS system be defined as both I/O and Metadata servers, so that metadata operations are spread across the entire system.
Becky -- Becky Ligon HPC Admin Staff PVFS/OrangeFS Developer Clemson University/Omnibond.com OrangeFS Support 864-650-4065 > Becky, > > I'm using a stable release of OrangeFS, version 2.8.4. I'm looking at the > tests under test/automated and most of them will be easy to run and very > helpful. > > The changes I'm making to trove focus on dbpf's database usage. Is there > anything else you suggest for testing / benchmarking dbpf's database > backend? > > The help is appreciated, > > - John > > On Tue, Jun 14, 2011 at 12:18 PM, Becky Ligon <[email protected]> wrote: > >> John: >> >> I'm not familiar with those particular trove tests, but I will find out >> why you are experiencing problems with trove-import. It is possible >> that >> these tests are outdated; these are not the regression tests that we run >> on a nightly basis. Which version of PVFS/OrangeFS are you using? >> >> The regression tests that we run are located >> .../test/automated/{sysint-tests.d,vfs-tests.d}. Most likely, all you >> need is the tests in sysint-tests.d to ensure that your changes to trove >> are working properly. >> >> Becky >> -- >> Becky Ligon >> HPC Admin Staff >> PVFS/OrangeFS Developer >> Clemson University/Omnibond.com OrangeFS Support >> 864-650-4065 >> >> > Becky, >> > >> > Thanks for the heads up. I checked out test/io/trove and I can't seem >> to >> > get >> > all of the tests running properly. I dug into the source code a bit >> and >> > tried to work out the program usage as best I could based on >> parse_args(). >> > >> > I tried the following: >> > >> > ./trove-mkfs -c trove-test-fs -s /tmp/trove-test-space >> > >> > This seems to work fine. /tmp/trove-test-space exists, contains >> databases, >> > and is named trove-test-fs. >> > >> > ./trove-touch -c trove-test-fs -s /tmp/trove-test-space -p /testfile >> > >> > This appears to work. The test returns successfully, says /testfile >> was >> > created. Dumping the dataspace db confirms this. >> > >> > ./trove-ls -c trove-test-fs -s /tmp/trove-test-space >> > >> > This returns successfully, but I don't see the files I tried making >> with >> > trove-touch. >> > >> > ./trove-import -c trove-test-fs -s /tmp/trove-test-space >> trove-import.c >> > /trovefile >> > >> > This causes bstream write to fail. >> > >> > Is there something obvious that I'm doing wrong when running these >> tests? >> > >> > Thanks for the time and help! >> > >> > - John >> > >> > On Mon, Jun 13, 2011 at 3:09 PM, Becky Ligon <[email protected]> >> wrote: >> > >> >> John: >> >> >> >> If you look in the <your pvfs dir>/test directory and the >> accompanying >> >> *.d >> >> subdirectories, you will find many of the tests that we run for >> >> regression >> >> testing. Take a look at them and see if they will help you out. >> >> >> >> Becky >> >> -- >> >> Becky Ligon >> >> HPC Admin Staff >> >> PVFS/OrangeFS Developer >> >> Clemson University/Omnibond.com OrangeFS Support >> >> 864-650-4065 >> >> >> >> > Hello all, >> >> > >> >> > I'm looking to make some changes to the trove-dbpf storage >> >> implementation >> >> > and was wondering what the PVFS2 development team used for >> regression >> >> > testing and performance benchmarking. If there exist specific >> >> regression >> >> > tests and benchmarks for trove implementations, that would be even >> >> better! >> >> > >> >> > Thanks for the help, >> >> > >> >> > - John >> >> > _______________________________________________ >> >> > Pvfs2-developers mailing list >> >> > [email protected] >> >> > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers >> >> > >> >> >> >> >> >> >> > >> >> >> > _______________________________________________ Pvfs2-developers mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
