Re: 8-STABLE performance issues on Supermicro Core i7
I have tried both drives independently (two system drives currently in ZFS mirror), but the interrupts was something that caught my attention as well. I haven't yet tried polling yet on the em interface, but I still have interrupts like what you are seeing (minus the em ones) when I'm just compiling and not really using the network, so I was going to wait before going down that path. Bryce On Sun, May 2, 2010 at 11:20 PM, Adam Vande More amvandem...@gmail.com wrote: On Sun, May 2, 2010 at 9:40 PM, Bryce Edwards br...@bryce.net wrote: Hello, I've got a new Supermicro X58 system with an Intel Core i7 930 with 6 GB ram that is not performing nearly as fast as it should in many ways (compiling, network transfers). To give an example, it has been building the gcc44 port for about 10 hours now and at the same time rsync'ing from a Linux box on the same Gigabit network is only getting throughput of between 10-25 MB/sec. When I did a buildkernel for 8-STABLE, it took 17 hours! My investigations have shown inhibited performance on compute, network and storage activities. Have you investigated potential faulty HD? I have an i7 870 and your ahci interrupts are an order of magintude greater than mine. That could be many other things too, but I think a SMART scan could help. -- Adam Vande More ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8-STABLE performance issues on Supermicro Core i7
Maybe this is a ridiculous question, but did you check whether your CPU is used and accelerated in case you use powerd/cpufreq or another power-saving feature? I ask you because I had this problem and I recalled that the same thing gathered my attention in the beginning, slow compilations. Basically, my CPU was nost scaling upwards for technical reasons that I can't understand. Here's my thread: http://lists.freebsd.org/pipermail/freebsd-stable/2010-April/056105.html Cheers, Mihai On Mon, 3 May 2010 13:30:17 -0500 Bryce Edwards br...@bryce.net wrote: I have tried both drives independently (two system drives currently in ZFS mirror), but the interrupts was something that caught my attention as well. I haven't yet tried polling yet on the em interface, but I still have interrupts like what you are seeing (minus the em ones) when I'm just compiling and not really using the network, so I was going to wait before going down that path. Bryce -- Mihai ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8-STABLE performance issues on Supermicro Core i7
On Sun, May 02, 2010 at 09:40:13PM -0500, Bryce Edwards wrote: I've got a new Supermicro X58 system with an Intel Core i7 930 with 6 GB ram that is not performing nearly as fast as it should in many ways (compiling, network transfers). To give an example, it has been building the gcc44 port for about 10 hours now and at the same time rsync'ing from a Linux box on the same Gigabit network is only getting throughput of between 10-25 MB/sec. When I did a buildkernel for 8-STABLE, it took 17 hours! My investigations have shown inhibited performance on compute, network and storage activities. ... Thanks in advance for any ideas. Here's some system info and stats: ... hint.p4tcc.0.disabled=1 hint.acpi_throttle.0.disabled=1 Are you using powerd(8) on this machine? Does the behaviour change if you shut it off? FreeBSD tahiti.bryce.net 8.0-STABLE FreeBSD 8.0-STABLE #0: Wed Apr 28 10:53:37 CDT 2010 ... br...@tahiti[~]cat /etc/sysctl.conf kern.timecounter.hardware=HPET Can you explain why you're overriding the OSes choice here? According to other parts of your dmesg, ACPI-fast or ACPI-safe is a better choice. The output from sysctl -a kern.timecounter would list off all your timecounter choices. Why I ask: I tend to leave HPET disabled on Supermicro systems since ACPI-fast/safe have always been reliable for me on such. On every Supermicro system I've used, HPET has defaulted to disabled. Dmesg output: ... ACPI Warning: Incorrect checksum in table [OEMB] - 0x7B, should be 0x74 (20100331/tbutils-354) I don't know if this could possibly explain the problem or not; freebsd-acpi might have some ideas. pci0: base peripheral, interrupt controller at device 20.0 (no driver attached) pci0: base peripheral, interrupt controller at device 20.1 (no driver attached) pci0: base peripheral, interrupt controller at device 20.2 (no driver attached) pci0: base peripheral, interrupt controller at device 20.3 (no driver attached) pci0: base peripheral at device 22.0 (no driver attached) pci0: base peripheral at device 22.1 (no driver attached) pci0: base peripheral at device 22.2 (no driver attached) pci0: base peripheral at device 22.3 (no driver attached) pci0: base peripheral at device 22.4 (no driver attached) pci0: base peripheral at device 22.5 (no driver attached) pci0: base peripheral at device 22.6 (no driver attached) pci0: base peripheral at device 22.7 (no driver attached) I have no idea what to make of this, but I see interrupt controller and I get a bit concerned. The reason is, ahci0 on your system ties in to pci0: ahci0: Intel ICH10 AHCI SATA controller port 0xa480-0xa487,0xb000-0xb003,0xac00-0xac07,0xa880-0xa883,0xa800-0xa81f mem 0xf9fda000-0xf9fda7ff irq 19 at device 31.2 on pci0 -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8-STABLE performance issues on Supermicro Core i7
On Sun, May 02, 2010 at 09:40:13PM -0500, Bryce Edwards wrote: I've got a new Supermicro X58 system with an Intel Core i7 930 with 6 GB ram that is not performing nearly as fast as it should in many ways (compiling, network transfers). By the way, an interesting thread you might read -- yes it's long. Subject Only 70% of theoretical peak performance on FreeBSD 8/amd64, Corei7 920: http://lists.freebsd.org/pipermail/freebsd-stable/2010-April/thread.html#56253 The performance stats you're providing are much lower than 70% peak, so I'm not sure there's a correlation, but that's a thread which did bring up odd performance-affecting changes in the i5/i7 architecture: http://lists.freebsd.org/pipermail/freebsd-stable/2010-April/056332.html It's also hard to determine from the thread given its length, but I believe pinning a process to an individual CPU increased (~20%+) the OPs performance. http://lists.freebsd.org/pipermail/freebsd-stable/2010-April/056316.html http://lists.freebsd.org/pipermail/freebsd-stable/2010-April/056339.html -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
8-STABLE performance issues on Supermicro Core i7
Hello, I've got a new Supermicro X58 system with an Intel Core i7 930 with 6 GB ram that is not performing nearly as fast as it should in many ways (compiling, network transfers). To give an example, it has been building the gcc44 port for about 10 hours now and at the same time rsync'ing from a Linux box on the same Gigabit network is only getting throughput of between 10-25 MB/sec. When I did a buildkernel for 8-STABLE, it took 17 hours! My investigations have shown inhibited performance on compute, network and storage activities. In the BIOS, I have played with a few settings and some actually made it worse. What I have done now is disabled Hyperthreading and Turbo Boost. Thanks in advance for any ideas. Here's some system info and stats: br...@tahiti[~]uname -a FreeBSD tahiti.bryce.net 8.0-STABLE FreeBSD 8.0-STABLE #0: Wed Apr 28 10:53:37 CDT 2010 r...@tahiti.bryce.net:/usr/obj/usr/src/sys/GENERIC amd64 br...@tahiti[~]cat /boot/loader.conf ahci_load=YES ichsmb_load=YES smb_load=YES coretemp_load=YES zfs_load=YES vfs.root.mountfrom=zfs:system hint.p4tcc.0.disabled=1 hint.acpi_throttle.0.disabled=1 br...@tahiti[~]cat /etc/sysctl.conf kern.timecounter.hardware=HPET br...@tahiti[~]vmstat 1 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad0 ad1 in sy cs us sy id 5 0 0 1068M 3478M 572 1 1 0 862 0 0 0 9370 16514 16157 71 22 7 5 0 0 1068M 3478M 2 0 0 0 0 0 0 0 8008 14504 11716 81 17 2 5 0 0 1068M 3478M 0 0 0 0 0 0 0 0 12429 22323 18125 77 23 0 5 0 0 1068M 3478M 0 0 0 0 0 0 0 0 12348 22125 17988 73 27 0 br...@tahiti[~]vmstat -i interrupt total rate irq1: atkbd0 9291 0 irq17: fwohci0 1 0 cpu0: timer 75416246 2000 irq256: em0 137590284 3649 irq257: em0 206367605 5473 irq260: em0 1 0 irq266: ahci0 9892384 262 cpu2: timer 75415653 2000 cpu3: timer 75415702 2000 cpu1: timer 75415561 2000 Total 655522728 17385 br...@tahiti[~]netstat -I em0 -h 1 input (em0) output packets errs idrops bytes packets errs bytes colls 7.7K 0 0 11M 7.2K 0 475K 0 8.1K 0 0 12M 7.4K 0 491K 0 7.8K 0 0 11M 7.2K 0 476K 0 br...@tahiti[/usr/adm]iostat 1 tty ada0 ada1 ada2 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 108 22.35 3 0.07 20.61 3 0.07 58.60 0 0.00 71 0 4 17 7 0 222 64.00 1 0.06 128.00 1 0.12 0.00 0 0.00 87 0 2 11 0 Dmesg output: Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-STABLE #0: Wed Apr 28 10:53:37 CDT 2010 r...@tahiti.bryce.net:/usr/obj/usr/src/sys/GENERIC amd64 Timecounter i8254 frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM) i7 CPU 930 @ 2.80GHz (2786.02-MHz K8-class CPU) Origin = GenuineIntel Id = 0x106a5 Family = 6 Model = 1a Stepping = 5 Features=0xbfebfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE Features2=0x98e3bdSSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT AMD Features=0x28100800SYSCALL,NX,RDTSCP,LM AMD Features2=0x1LAHF TSC: P-state invariant real memory = 6446645248 (6148 MB) avail memory = 6169243648 (5883 MB) ACPI APIC Table: 021210 APIC1519 FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 ioapic0: Changing APIC ID to 1 ioapic0 Version 2.0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: SMCI on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of 0, a (3) failed acpi0: reservation of 10, cbf0 (3) failed Timecounter ACPI-fast frequency 3579545 Hz quality 1000 acpi_timer0: 24-bit timer at 3.579545MHz port 0x808-0x80b on acpi0 cpu0: ACPI CPU on acpi0 ACPI Warning: Incorrect checksum in table [OEMB] - 0x7B, should be 0x74 (20100331/tbutils-354) cpu1: ACPI CPU on acpi0 cpu2: ACPI CPU on acpi0 cpu3: ACPI CPU on acpi0 acpi_hpet0: High Precision Event Timer iomem 0xfed0-0xfed003ff on acpi0 Timecounter HPET frequency 14318180 Hz quality 900 pcib0: ACPI
Re: 8-STABLE performance issues on Supermicro Core i7
On Sun, May 2, 2010 at 9:40 PM, Bryce Edwards br...@bryce.net wrote: Hello, I've got a new Supermicro X58 system with an Intel Core i7 930 with 6 GB ram that is not performing nearly as fast as it should in many ways (compiling, network transfers). To give an example, it has been building the gcc44 port for about 10 hours now and at the same time rsync'ing from a Linux box on the same Gigabit network is only getting throughput of between 10-25 MB/sec. When I did a buildkernel for 8-STABLE, it took 17 hours! My investigations have shown inhibited performance on compute, network and storage activities. Have you investigated potential faulty HD? I have an i7 870 and your ahci interrupts are an order of magintude greater than mine. That could be many other things too, but I think a SMART scan could help. -- Adam Vande More ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
