John:
The BDB cache size is set below in the StorageHints.DBCacheSizeBytes
<Filesystem>
Name pvfs-palmetto
ID 180520100
RootHandle 1048576
FileStuffing yes
DefaultNumDFiles 4
FlowBufferSizeBytes 524288
<StorageHints>
TroveSyncMeta yes
TroveSyncData no
TroveMethod alt-aio
DBCacheSizeBytes 1610612736
</StorageHints>
...
Becky
--
Becky Ligon
HPC Admin Staff
PVFS/OrangeFS Developer
Clemson University/Omnibond.com OrangeFS Support
864-650-4065
> On our production servers, we increased the shared memory for BDB to about
> 2gigs, and we have BDB on a SSD. This way, MOST of the frequently
> accessed metadata will be in memory or, at least, on fast disk. Also, we
> recommend that all of the servers in your OrangeFS system be defined as
> both I/O and Metadata servers, so that metadata operations are spread
> across the entire system.
>
> Becky
> --
> Becky Ligon
> HPC Admin Staff
> PVFS/OrangeFS Developer
> Clemson University/Omnibond.com OrangeFS Support
> 864-650-4065
>
>> Becky,
>>
>> I'm using a stable release of OrangeFS, version 2.8.4. I'm looking at
>> the
>> tests under test/automated and most of them will be easy to run and very
>> helpful.
>>
>> The changes I'm making to trove focus on dbpf's database usage. Is there
>> anything else you suggest for testing / benchmarking dbpf's database
>> backend?
>>
>> The help is appreciated,
>>
>> - John
>>
>> On Tue, Jun 14, 2011 at 12:18 PM, Becky Ligon <[email protected]> wrote:
>>
>>> John:
>>>
>>> I'm not familiar with those particular trove tests, but I will find out
>>> why you are experiencing problems with trove-import. It is possible
>>> that
>>> these tests are outdated; these are not the regression tests that we
>>> run
>>> on a nightly basis. Which version of PVFS/OrangeFS are you using?
>>>
>>> The regression tests that we run are located
>>> .../test/automated/{sysint-tests.d,vfs-tests.d}. Most likely, all you
>>> need is the tests in sysint-tests.d to ensure that your changes to
>>> trove
>>> are working properly.
>>>
>>> Becky
>>> --
>>> Becky Ligon
>>> HPC Admin Staff
>>> PVFS/OrangeFS Developer
>>> Clemson University/Omnibond.com OrangeFS Support
>>> 864-650-4065
>>>
>>> > Becky,
>>> >
>>> > Thanks for the heads up. I checked out test/io/trove and I can't seem
>>> to
>>> > get
>>> > all of the tests running properly. I dug into the source code a bit
>>> and
>>> > tried to work out the program usage as best I could based on
>>> parse_args().
>>> >
>>> > I tried the following:
>>> >
>>> > ./trove-mkfs -c trove-test-fs -s /tmp/trove-test-space
>>> >
>>> > This seems to work fine. /tmp/trove-test-space exists, contains
>>> databases,
>>> > and is named trove-test-fs.
>>> >
>>> > ./trove-touch -c trove-test-fs -s /tmp/trove-test-space -p /testfile
>>> >
>>> > This appears to work. The test returns successfully, says /testfile
>>> was
>>> > created. Dumping the dataspace db confirms this.
>>> >
>>> > ./trove-ls -c trove-test-fs -s /tmp/trove-test-space
>>> >
>>> > This returns successfully, but I don't see the files I tried making
>>> with
>>> > trove-touch.
>>> >
>>> > ./trove-import -c trove-test-fs -s /tmp/trove-test-space
>>> trove-import.c
>>> > /trovefile
>>> >
>>> > This causes bstream write to fail.
>>> >
>>> > Is there something obvious that I'm doing wrong when running these
>>> tests?
>>> >
>>> > Thanks for the time and help!
>>> >
>>> > - John
>>> >
>>> > On Mon, Jun 13, 2011 at 3:09 PM, Becky Ligon <[email protected]>
>>> wrote:
>>> >
>>> >> John:
>>> >>
>>> >> If you look in the <your pvfs dir>/test directory and the
>>> accompanying
>>> >> *.d
>>> >> subdirectories, you will find many of the tests that we run for
>>> >> regression
>>> >> testing. Take a look at them and see if they will help you out.
>>> >>
>>> >> Becky
>>> >> --
>>> >> Becky Ligon
>>> >> HPC Admin Staff
>>> >> PVFS/OrangeFS Developer
>>> >> Clemson University/Omnibond.com OrangeFS Support
>>> >> 864-650-4065
>>> >>
>>> >> > Hello all,
>>> >> >
>>> >> > I'm looking to make some changes to the trove-dbpf storage
>>> >> implementation
>>> >> > and was wondering what the PVFS2 development team used for
>>> regression
>>> >> > testing and performance benchmarking. If there exist specific
>>> >> regression
>>> >> > tests and benchmarks for trove implementations, that would be even
>>> >> better!
>>> >> >
>>> >> > Thanks for the help,
>>> >> >
>>> >> > - John
>>> >> > _______________________________________________
>>> >> > Pvfs2-developers mailing list
>>> >> > [email protected]
>>> >> > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
>>> >> >
>>> >>
>>> >>
>>> >>
>>> >
>>>
>>>
>>>
>>
>
>
>
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
