What linux distribution are you running? 32 or 64 bit?
Do you have the Dell Openmanage tools installed? (can get & set controller
properties. Dell has RPM repos for this but depends on disto.)
Is cpu power saving enabled? (/proc/cpuinfo will show lower MHz).
Have you tested the underlying disk performance? ("iostat -dmx 1" has a
utilization % - last field)
On Apr 29, 2011, at 12:41 PM, Jim Kusznir wrote:
> Hi all:
>
> I believe I'm getting very poor performance from my pvfs2 system, and
> would like to start trying to identify why.
>
> System details:
> 3 pvfs2-io servers, all dedicated to pvfs2:
> Dell Poweredge 1950 with
> dual-socket E5310 (quad core 1.6Ghz)
> 4GB RAM
> dual onboard gig-E (using balance-alb bonding)
> PERC 6/e raid for storage
> PERC 5/i raid1 for metadata/OS storage
> all servers are metadata servers as well as data servers
> running pvfs2.8.2 on the servers
>
> My cluster has 24 nodes and 1 dedicated compute node, all single-gig
> connected.
>
> Performance to the pvfs2 is extremely slow. Every time I check the
> load on the pvfs2 nodes, its never greater than 50% and usually well
> under that. Last time I had to chown a whole bunch of files (a user
> had 30 directories with over 10k files each), it took nearly 2 full
> days. I/O from the head node appears to be less than half (possibly
> less than 1/4) of the rate to local disk. Calculated data rates are
> well under 1GB. And previous tests showed that once I got I/O from
> more than 3 or 4 nodes simultaneously, the performance plateaued.
>
> I'm not even sure how to proceed with the troubleshooting. The only
> obvious question that came to mind is whether the bonding-alb is
> helping or hurting things.
>
> --Jim
> _______________________________________________
> Pvfs2-users mailing list
> [email protected]
> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
