PAE Slowdown
Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. I'm not sure what I should try disabling. I tried nodevice usb, but that didn't seem to change anything. SMP and GENERIC kernels work fine. CPU: Intel Core Duo 2 Quad 2.4ghz Memory: 8 gig (4 2 gig dimms) Swap: 16 gig partition If I try to boot without ACPI disabled the kernel doesn't finish booting, it stops after ata7. Full kernel message listing: Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-RELEASE-p8 #0: Mon Oct 8 11:04:03 CDT 2007 [EMAIL PROTECTED]:/usr/src/sys/i386/compile/PAE ACPI APIC Table: INTEL DP965LT Timecounter i8254 frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM)2 Quad CPU @ 2.40GHz (2412.00-MHz 686-class CPU) Origin = GenuineIntel Id = 0x6f7 Stepping = 7 Features=0xbfebfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE Features2=0xe3bdSSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,b9,CX16,b14,b15 AMD Features=0x2010NX,LM AMD Features2=0x1LAHF Cores per package: 4 real memory = 9059696640 (8640 MB) avail memory = 8340590592 (7954 MB) ioapic0: Changing APIC ID to 2 ioapic0 Version 2.0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: INTEL DP965LT on motherboard acpi0: Power Button (fixed) Timecounter ACPI-fast frequency 3579545 Hz quality 1000 acpi_timer0: 24-bit timer at 3.579545MHz port 0x408-0x40b on acpi0 cpu0: ACPI CPU on acpi0 acpi_perf0: ACPI CPU Frequency Control on cpu0 acpi_perf0: failed in PERF_STATUS attach device_attach: acpi_perf0 attach returned 6 acpi_throttle0: ACPI CPU Throttling on cpu0 acpi_perf0: ACPI CPU Frequency Control on cpu0 acpi_perf0: failed in PERF_STATUS attach device_attach: acpi_perf0 attach returned 6 acpi_button0: Sleep Button on acpi0 pcib0: ACPI Host-PCI bridge port 0xcf8-0xcff on acpi0 pci0: ACPI PCI bus on pcib0 pcib1: ACPI PCI-PCI bridge at device 1.0 on pci0 pci1: ACPI PCI bus on pcib1 3ware device driver for 9000 series storage controllers, version: 3.60.03.006 twa0: 3ware 9000 series Storage Controller port 0x3000-0x30ff mem 0xe800-0xe9ff,0xea20-0xea200fff irq 16 at device 0.0 on pci1 twa0: [GIANT-LOCKED] twa0: INFO: (0x15: 0x1300): Controller details:: Model 9650SE-4LPML, 4 ports, Firmware FE9X 3.08.02.005, BIOS BE9X 3.08.00.002 pci0: simple comms at device 3.0 (no driver attached) em0: Intel(R) PRO/1000 Network Connection Version - 6.2.9 port 0x40c0-0x40df mem 0xea30-0xea31,0xea32-0xea320fff irq 20 at device 25.0 on pci0 em0: Ethernet address: 00:19:d1:b0:d5:d0 pci0: serial bus, USB at device 26.0 (no driver attached) pci0: serial bus, USB at device 26.1 (no driver attached) pci0: serial bus, USB at device 26.7 (no driver attached) pcib2: ACPI PCI-PCI bridge at device 28.0 on pci0 pci2: ACPI PCI bus on pcib2 pcib3: ACPI PCI-PCI bridge at device 28.1 on pci0 pci3: ACPI PCI bus on pcib3 atapci0: GENERIC ATA controller port 0x2018-0x201f,0x2024-0x2027,0x2010-0x2017,0x2020-0x2023,0x2000-0x200f mem 0xea10-0xea1001ff irq 17 at device 0.0 on pci3 ata2: ATA channel 0 on atapci0 ata3: ATA channel 1 on atapci0 pcib4: ACPI PCI-PCI bridge at device 28.2 on pci0 pci4: ACPI PCI bus on pcib4 pcib5: ACPI PCI-PCI bridge at device 28.3 on pci0 pci5: ACPI PCI bus on pcib5 pcib6: ACPI PCI-PCI bridge at device 28.4 on pci0 pci6: ACPI PCI bus on pcib6 pci0: serial bus, USB at device 29.0 (no driver attached) pci0: serial bus, USB at device 29.1 (no driver attached) pci0: serial bus, USB at device 29.2 (no driver attached) pci0: serial bus, USB at device 29.7 (no driver attached) pcib7: ACPI PCI-PCI bridge at device 30.0 on pci0 pci7: ACPI PCI bus on pcib7 pci7: display, VGA at device 0.0 (no driver attached) fwohci0: Texas Instruments TSB43AB22/A mem 0xea084000-0xea0847ff,0xea08-0xea083fff irq 19 at device 3.0 on pci7 fwohci0: OHCI version 1.10 (ROM=0) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:90:27:00:01:e7:67:5e fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: IEEE1394(FireWire) bus on fwohci0 fwe0: Ethernet over FireWire on firewire0 if_fwe0: Fake Ethernet address: 02:90:27:e7:67:5e fwe0: Ethernet address: 02:90:27:e7:67:5e fwe0: if_start running deferred for Giant sbp0: SBP-2/SCSI over FireWire on firewire0 fwohci0: Initiate bus reset fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode firewire0: 1 nodes, maxhop = 0, cable
Re: PAE Slowdown
Jeff Kramer wrote: Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. I'm not sure what I should try disabling. I tried nodevice usb, but that didn't seem to change anything. SMP and GENERIC kernels work fine. CPU: Intel Core Duo 2 Quad 2.4ghz Memory: 8 gig (4 2 gig dimms) Swap: 16 gig partition If I try to boot without ACPI disabled the kernel doesn't finish booting, it stops after ata7. Perhaps unrelated, but why don't you run amd64 version? I think PAE is a hack, for instance it does not allow processes to use more than 2GB memory, while AMD64 (called EM64T by Intel implementation) provides much more... Cheers, -- Xin LI [EMAIL PROTECTED] http://www.delphij.net/ FreeBSD - The Power to Serve! signature.asc Description: OpenPGP digital signature
Re: PAE Slowdown
Jeff Kramer wrote: Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. Does vmstat -i show unusually high interrupt rates? signature.asc Description: OpenPGP digital signature
Re: PAE Slowdown
More weirdness, if I take out 4 gig of ram and only run with 4 total, the PAE kernel works fine. At 11:23 AM -0500 10/8/07, Jeff Kramer wrote: Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. I'm not sure what I should try disabling. I tried nodevice usb, but that didn't seem to change anything. SMP and GENERIC kernels work fine. CPU: Intel Core Duo 2 Quad 2.4ghz Memory: 8 gig (4 2 gig dimms) Swap: 16 gig partition -- Jeff Kramer [EMAIL PROTECTED] http://www.jeffkramer.org/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: PAE Slowdown
Hello, On 10/8/07, Jeff Kramer [EMAIL PROTECTED] wrote: More weirdness, if I take out 4 gig of ram and only run with 4 total, the PAE kernel works fine. Please don't top post, so we could track the thread :) As Li said, you better for for AMD64 arch to enjoy the speed of your box. -- Regards, -Abdullah Ibn Hamad Al-Marri Arab Portal http://www.WeArab.Net/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: PAE Slowdown
At 6:56 PM +0200 10/8/07, Ivan Voras wrote: Jeff Kramer wrote: Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. Does vmstat -i show unusually high interrupt rates? When it's running ok at idle (4 gig of ram): interrupt total rate irq1: atkbd0 77 0 irq16: twa0 1084 3 irq17: atapci0 1 0 irq19: fwohci0++ 3 0 irq20: em0 161 0 cpu0: timer 549165 1920 Total 550491 1924 When it's slow at idle (8 gig of ram): interrupt total rate irq1: atkbd0 48 0 irq16: twa0 1093 8 irq17: atapci0 1 0 irq19: fwohci0++ 3 0 irq20: em0 179 1 cpu0: timer 241862 1950 Total 243186 1961 -- Jeff Kramer [EMAIL PROTECTED] http://www.jeffkramer.org/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: PAE Slowdown
Jeff Kramer wrote: At 6:56 PM +0200 10/8/07, Ivan Voras wrote: Jeff Kramer wrote: Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. Does vmstat -i show unusually high interrupt rates? When it's running ok at idle (4 gig of ram): interrupt total rate irq1: atkbd0 77 0 irq16: twa0 1084 3 irq17: atapci0 1 0 irq19: fwohci0++ 3 0 irq20: em0 161 0 cpu0: timer 549165 1920 Total 550491 1924 When it's slow at idle (8 gig of ram): interrupt total rate irq1: atkbd0 48 0 irq16: twa0 1093 8 irq17: atapci0 1 0 irq19: fwohci0++ 3 0 irq20: em0 179 1 cpu0: timer 241862 1950 Total 243186 1961 The culprit could be the twa driver. Are you really generating that much I/O? Scott ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: PAE Slowdown
Jeff Kramer [EMAIL PROTECTED] writes: Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. This may not be a PAE-related problem. I say this because I noticed you have the same MB I have: ACPI APIC Table: INTEL DP965LT Several Intel MBs, including the DP965LT, have a BIOS bug that rears its head when you have 4G (or more) of memory installed, where the BIOS sets the cache control registers incorrectly. This cause a chunk of your main memory (on my system, the chunk between 448MB and 512MB) to be labeled uncachable, with the result being random slowdowns whenever the kernel or user processes happen to touch memory in that chunk. This problem drove me crazy trying to figure out what the problem was until I stumbled on this report on a Linux users' forum explaining the situation. http://forums.fedoraforum.org/showthread.php?t=157232 Fortunately, the workaround is fairly straightforward, adding an rc.d script to twiddle the MTRRs. Assuming this is your problem, if you could post the output of memcontrol list it should be possible to id which of the entires is bogus and needs to be removed. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: PAE Slowdown
At 2:00 PM -0500 10/8/07, Richard Todd wrote: Jeff Kramer [EMAIL PROTECTED] writes: Hey all, I know that AMD64's the preferred way to run 4 gig systems, but I'm having a weird situation with 6.2-RELEASE-p8 and 6-STABLE as of last night. When I compile the PAE kernel, my system performance drops like a rock. It still boots and everything still runs, but for instance, running the Flops port my megaflops drop from the 950 MFLOPS range to 4 MFLOPS. It feels about as fast as a 486. This may not be a PAE-related problem. I say this because I noticed you have the same MB I have: ACPI APIC Table: INTEL DP965LT Several Intel MBs, including the DP965LT, have a BIOS bug that rears its head when you have 4G (or more) of memory installed, where the BIOS sets the cache control registers incorrectly. This cause a chunk of your main memory (on my system, the chunk between 448MB and 512MB) to be labeled uncachable, with the result being random slowdowns whenever the kernel or user processes happen to touch memory in that chunk. This problem drove me crazy trying to figure out what the problem was until I stumbled on this report on a Linux users' forum explaining the situation. http://forums.fedoraforum.org/showthread.php?t=157232 Fortunately, the workaround is fairly straightforward, adding an rc.d script to twiddle the MTRRs. Assuming this is your problem, if you could post the output of memcontrol list it should be possible to id which of the entires is bogus and needs to be removed. Sweet, I just downgraded to the 1669 bios rev and it looks like it's running at full speed. I'm compiling an SMP/PAE kernel now, but it looks like this was the fix! Thanks, Richard! -- Jeff Kramer [EMAIL PROTECTED] http://www.jeffkramer.org/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
