> New server - Harmonia - now has Occam's duties as a mysql > server and NFS file server. Harmonia is a machine that is at > least twice as good as Occam in all respects save disk > storage, but she's acting in a lot of respects like a > Commodore 64. :-( > > Harmonia's specs: > > * Dual AMD opteron 3.2Ghz duo core (4 processors) > * 6 x 2GB ECC DDR2 PC5300 RAM (12 GB) > * 8 x 500GB Seagate SATA300 32MB cache 7200RPM drives > setup as RAID 5 (3.5 TB) > * Running Fedora 10 > > I seem to have three problems. > > 1) I can't seem to copy anything with regard to this machine > without its load average going through the roof. An scp, even > a cp will drive the computer's load average to between 12 and > 18. Copying a large file, or doing a mysqlhotcopy, will make > the load average slowly climb, with some spikes up to that > level. I can't think that's right. Not for something with 4 > processors. > > 2) Whenever the load average goes above, say, 5 NFS starts > seriously flaking out. It goes "bye-bye," stops responding, > and starts disconnecting disks at the clients. After the load > average goes down, it will come back. > > NFS exports is here: > > /BigBang *(rw,insecure,sync,nohide) > /mnt/data *(rw,insecure_locks,nohide,insecure) > > /mnt/data is our RAID drive. /BigBang is an alias to /mnt/data/BigBang > > 3) Finally, network performance is completely in the toilet. > Copying files via scp, or rsync, in addition to driving the > load average up, seems to go at a rate of 2.5MB/s. I have two > gigabit ethernet cards in this machine. These are wired to a > gigabit switch. The switch is wired to the rest of the office > via a 100Mbps hub, but the issue is we got far better > transfer performance from the old server (Occam) than we are > from the new, faster server (Harmonia) and I can't figure out why. Several things... First, a hub, really? I assume nothing useful in your logs or you would have said so... What filesystem on the new/old systems? What kernel and any interesting patches on both systems? Which scheduler (e.g., cfq) on both systems? What does iostat show and have you tried running dstat with lots of detail? How well do local copies run (if you have different sets of spindles, between them would be better). Have you checked the logs on your switches or even just watched the lights for odd patterns (collisions, resets, renegotiations... Etc)
I'm sure more questions will arise from these answers. Hope this helps and good luck, Jon Network Plumbers, Inc. _______________________________________________ bblisa mailing list [email protected] http://www.bblisa.org/mailman/listinfo/bblisa
