Alll the pvfs servers are attached via a 4Gbit/sec fiber channel card to some RAID disks.
The disk arrays have xfs as the file system on them and a dd to the filesystem gives me about 350MBytes/sec per controller. Each pvfs server is attached to 2 raid controllers so in theory I should be able to write at about 600 or more MBytes/sec on each pvfs server. Also each pvfs server has an IB card and I ran the IB performance test earlier an saw speeds around 400-500MBytes/sec with pvfs2-cp and dd. Thanks for the help Rene -------------------------- Rene ----- Original Message ----- From: Rob Ross <[EMAIL PROTECTED]> To: Salmon, Rene Cc: [email protected] <[email protected]> Sent: Tue Oct 30 03:10:22 2007 Subject: Re: [Pvfs2-users] Pvfs performance over 10Ge How fast is the disk you're writing to? -- Rob Salmon, Rene wrote: > Hi, > > Trying to benchmark pvfs running over 10ge. I can run network > benchmarks like netperf and iperf and get numbers fairly close to > 10Gbits/sec from any client to any of the pvfs servers. > > When I try to run some dd's or pvfs2-cp's on the pvfs file system I seem > to be reaching a 1Gbit/sec limit: > > hpca4000(salmr0)60:pvfs2-cp -t -b 4194304 /pvfs2-fs/foo /pvfs2-fs/junk3 > Wrote 4194304000 bytes in 49.089332 seconds. 81.484099 MB/seconds > > hpca4000(salmr0)61:/usr/bin/time -p dd if=/dev/zero of=/pvfs2-fs/foo2 > bs=4M count=1000 > 1000+0 records in > 1000+0 records out > 4194304000 bytes (4.2 GB) copied, 50.4064 seconds, 83.2 MB/s > > Is there some hard coded limit with pvfs2 that assumes a 1Gbit/sec link > or am I missing something here? > > Thanks > Rene > > _______________________________________________ > Pvfs2-users mailing list > [email protected] > http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users > _______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
