Michael: To increase the amount of cache available to Berkeley DB, set the following option in your conf file and restart all of your servers:
<Filesystem>
<StorageHints>
DBCacheSizeBytes 1610612736
</StorageHints>
</Filesystem>
I have attached an example conf file that sets the Berkeley DB cache size
to 1GB.
Becky
On Fri, May 24, 2013 at 6:06 PM, Michael Robbert <[email protected]> wrote:
> We recently noticed a performance problem with our OrangeFS server.
>
> Here are the server stats:
> 3 servers, built identically with identical hardware
>
> [root@orangefs02 ~]# /usr/sbin/pvfs2-server --version
> 2.8.7-orangefs (mode: aio-threaded)
>
> [root@orangefs02 ~]# uname -r
> 2.6.18-308.16.1.el5.584g0000
>
> 4 core E5603 1.60GHz
> 12GB of RAM
>
> OrangeFS is being served to clients using bmi_tcp over DDR Infiniband.
> Backend storage is PanFS with 2x10Gig connections on the servers.
> Performance to the backend looks fine using bonnie++. >100MB/sec write and
> ~250MB/s read to each stack. ~300 creates/sec.
>
> On the OrangeFS clients are running kernel version 2.6.18-238.19.1.el5.
>
> The biggest problem I have right now is that delete are taking a long
> time. Almost 1 sec per file.
>
> [root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes_**truncerr1e-11]# find
> N2/|wc -l
> 137
> [root@fatcompute-11-32 L_10_V0.2_eta0.3_wRes_**truncerr1e-11]# time rm
> -rf N2
>
> real 1m31.096s
> user 0m0.000s
> sys 0m0.015s
>
> Similar results for file creates:
>
> [root@fatcompute-11-32 ]# date;for i in `seq 1 50`;do touch
> file${i};done;date
> Fri May 24 16:04:17 MDT 2013
> Fri May 24 16:05:05 MDT 2013
>
> What else do you need to know? Which debug flags? What should we be
> looking at?
> I don't see any load on the servers and I've restarted server and rebooted
> server nodes.
>
> Thanks for any pointers,
> Mike Robbert
> Colorado School of Mines
>
>
> _______________________________________________
> Pvfs2-users mailing list
> [email protected]
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
>
>
--
Becky Ligon
OrangeFS Support and Development
Omnibond Systems
Anderson, South Carolina
pvfs2-server.conf.no-ib
Description: Binary data
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
