Re: apache hanging on 8.0 AMD64
On Fri, Jan 8, 2010 at 8:58 PM, Rainer Duffner rai...@ultra-secure.de wrote:
Hi,
we have an interesting problem with FreeBSD 8.0 AMD64:
The server is a HP DL380G5 with two Harpertown-class CPUs and 8 GB RAM.
It is running MySQL, Apache (worker MPM) and PHP as CGI with Fast-CGI
and SUEXEC.
It has over 500 ZFS filesystems that comprise various customers
websites, each running PHP as their own user.
Soon after we put this system into production, we saw httpd-processes
being stalled in the ucond state, leading to a total stand-still of
the apache-server (apache blocked itself somehow).
I disabled ZFS prefetching and the problem went away for a couple of
days - until yesterday, when it happened again.
Swap was unused when it happened the last time.
I switched top into thread-mode (M) and saw that the processes
actually seemed to be in different state (zio-i, arc_mr, tx_tx, RUN).
I cannot get any info from kstat, because when the problem happens and I
attach to one of the processes, I don't get anything back - it just sits
there.
If there anything I can take a look at to further debug this problem?
At the time of the hang, no swap was used:
last pid: 6450; load averages: 36.32, 30.17,
17.75
up 4+11:15:44 20:11:01
482 processes: 28 running, 452 sleeping, 1 zombie, 1 lock
CPU: % user, % nice, % system, % interrupt, % idle
Mem: 1619M Active, 3829M Inact, 2066M Wired, 211M Cache, 827M Buf, 188M Free
Swap: 8192M Total, 8192M Free
PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND
6011 user1 44 0 24960K 3432K RUN 1 2:50 7.08% pure-ftpd
6038 user2 66 0 161M 18856K RUN 3 1:26 3.47% php-cgi
716 root 46 0 32452K 13776K select 5 104:53 3.08% snmpd
6021 user3 63 0 163M 20232K RUN 7 1:28 2.49% php-cgi
6009 www 44 0 103M 26952K tx-tx 3 0:55 1.76% {httpd}
6030 www 44 0 101M 26168K CPU4 7 0:57 1.66% {httpd}
6028 www 44 0 101M 26476K tx-tx 2 0:55 1.66% {httpd}
6030 www 44 0 101M 26168K zio-i 5 0:55 1.66% {httpd}
6008 www 44 0 102M 26640K RUN 2 1:23 1.56% {httpd}
6009 www 46 0 103M 26952K tx-tx 3 1:22 1.56% {httpd}
6016 www 44 0 102M 26636K tx-tx 2 1:17 1.56% {httpd}
6024 www 44 0 106M 26568K RUN 1 1:07 1.56% {httpd}
5978 www 44 0 102M 26960K RUN 0 1:00 1.56% {httpd}
6008 www 44 0 102M 26640K zio-i 7 0:55 1.56% {httpd}
5970 www 44 0 108M 27700K arc_mr 4 0:59 1.46% {httpd}
6024 www 44 0 106M 26568K tx-tx 5 0:50 1.46% {httpd}
5979 www 45 0 102M 26904K zio-i 1 1:14 1.37% {httpd}
6009 www 47 0 103M 26952K zio-i 7 1:11 1.37% {httpd}
I disabled all the apache-modules we don't need.
This is the only system of its kind we have, currently, but we would
really like to get this fixed so we can move more of our
hosting-customers to similar setup servers.
Another detail: due to the fact that every user has a access- and
error-logfile, we had to bump FD_SETSIZE to 16384U.
We tried bumping kern.maxvnodes to larger and larger values (now at
40, 200k are used), but it didn't really help that much. Disabling
prefetching helped a lot (only one crash in 5 days) - but we would like
to know why it actually happens and then fix it forever ;-)
Best Regards,
Rainer
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
From my experience with OpenSolaris, and many/large ZFS file systems,
8GB is skirting on the low end amount of RAM to accomplish simple file
serving, let alone website and database hosting.
Even though you show little to no swap used, I'd still bet there is a
lot of memory pressure from the ZFS ARC.
Can you try limiting the size of the ARC, or add more memory?
On top of 500 zvols, do they also have snapshots under them? What does
disk I/O look like?
I've also seen Apache free due to SSL renegotiation (something I'm
currently struggling with), but you would see idle workers, not in any
state.
--
Brent Jones
br...@servuhome.net
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: USB problems on 8.0-STABLE
On 01/09/2010 05:39, Warren Block wrote: On Fri, 8 Jan 2010, Frank wrote: On Fri, 8 Jan 2010, Steven Friedrich wrote: Option AllowEmptyInput off EndSection Comment out the line containing AllowEmptyInput. OK, this took care of the nothing-works-unless-mouse-is-moved problem but why do I get this? It's keeping apcupsd from starting. Ace /usr/ports # usbdevs -d -v usbdevs: no USB controllers found I'd guess that usbdevs is obsolete, part of the old USB system. Ace /usr/ports # usbconfig ugen0.1: OHCI root HUB nVidia at usbus0, cfg=0 md=HOST spd=FULL (12Mbps) pwr=ON ugen1.1: EHCI root HUB nVidia at usbus1, cfg=0 md=HOST spd=HIGH (480Mbps) pwr=ON ugen0.2: Back-UPS XS 1200 FW:8.g1 .D USB FW:g1 American Power Conversion at usbus0, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON ugen0.3: USB Optical Mouse vendor 0x0461 at usbus0, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON ugen0.4: Dell USB Keyboard Dell at usbus0, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON Do you have DEVICE /dev/ugen0.2 in apcupsd.conf? I don't understand why usbdevs can't find any controllers and apcupsd can't find any device while the kernel and usbconfig can find it all. upsdevs: probably obsolete. As for apcupsd, I don't think it can auto-scan for USB devices, but haven't used it with USB. I have: FreeBSD avoriaz.restart.bel 8.0-RELEASE FreeBSD 8.0-RELEASE #0 r199628M: Tue Nov 24 21:38:07 CET 2009 r...@avoriaz.restart.bel:/usr/obj/usr/src/sys/AVORIAZ amd64 usbconfig: ugen0.2: Back-UPS CS 650 FW:817.v4.I USB American Power Conversion at usbus0, cfg=0 md=HOST spd=LOW (1.5Mbps) pwr=ON apcupsd.conf: UPSNAME Back-UPS-CS-650 UPSCABLE usb UPSTYPE usb DEVICE apcupsd is working with this config. Henri -Warren Block * Rapid City, South Dakota USA ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
FreeBSD 8.0 STABLE sata regression
Hello, My servers are alright with FreeBSD 8.0-RELEASE, but not with -STABLE. FreeBSD NOC.WEArab.Net 8.0-STABLE FreeBSD 8.0-STABLE #0: Fri Jan 8 18:26:13 UTC 2010 ad...@localhost.localdomain:/usr/obj/usr/src/sys/GENERIC amd64 atapci0: Intel ICH7 SATA300 controller port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x20a0-0x20af mem 0x9020-0x902003ff irq 19 at device 31.2 on pci0 ata0: ATA channel 0 on atapci0 ata0: [ITHREAD] ata1: ATA channel 1 on atapci0 ata1: [ITHREAD] when I upgraded to FreeBSD 8.0-STABLE it got many issues. ad2: 381554MB WDC WD4000KD-00NAB0 01.06A01 at ata1-master UDMA100 ^^^ Here is another box. FreeBSD VB.WeArab.Net 8.0-STABLE FreeBSD 8.0-STABLE #0: Fri Jan 8 17:40:17 UTC 2010 arab...@vb.wearab.net:/usr/obj/usr/src/sys/VB amd64 atapci0: Intel ICH7 SATA300 controller port 0xd060-0xd067,0xd050-0xd053,0xd040-0xd047,0xd030-0xd033,0xd020-0xd02f irq 17 at device 31.2 on pci0 atapci0: [ITHREAD] ata2: ATA channel 0 on atapci0 ata2: [ITHREAD] ata3: ATA channel 1 on atapci0 ata3: [ITHREAD] ad4: 238475MB WDC WD2500KS-00MJB0 02.01C03 at ata2-master UDMA100 ad6: 715404MB WDC WD7500AAKS-00RBA0 30.04G30 at ata3-master UDMA100 SMP: AP CPU #1 Launched! GEOM: ad4s1: geometry does not match label (255h,63s != 16h,63s). GEOM: ad6s1: geometry does not match label (255h,63s != 16h,63s). GEOM: ufsid/47547b65269ba92c: geometry does not match label (255h,63s != 16h,63s). Trying to mount root from ufs:/dev/ad4s1a GEOM: ufsid/47547b65269ba92c: geometry does not match label (255h,63s != 16h,63s). Regards, -Abdullah Ibn Hamad Al-Marri Arab Portal http://www.WeArab.Net/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ntpd not removed; WITHOUT_NTP enabled in src.conf
Roland Smith wrote: Henrik Hudson wrote: Hey List, Among other things I have in my /etc/src.conf WITHOUT_NTP=yes which from my understanding should not build ntpd, etc... [...] ntpd still exists in /usr/sbin and the man pages, etc... seem to still be hanging around. Did I miss something? Adding options to `/etc/src.conf` does not remove old binaries, libraries or manpages! It just prevents the system from building newer ones. I'm afraid that's not true. When you disable something in src.conf(5), its files *will* be removed when you do make delete-old. See the file src/tools/build/mk/OptionalObsoleteFiles.inc for all the details. It's included by src/ObsoleteFiles.inc which in turn is included by src/Makefile.inc1 (after /etc/src.conf was parsed by share/mk/bsd.own.mk). If that doesn't work for WITHOUT_NTP, then that's a bug. Probably some entries missing in OptionalObsoleteFiles.inc. Best regards Oliver -- Oliver Fromme, secnetix GmbH Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd To this day, many C programmers believe that 'strong typing' just means pounding extra hard on the keyboard. -- Peter van der Linden ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: USB problems on 8.0-STABLE
On Fri, 8 Jan 2010, Steven Friedrich wrote: OK, first a disclaimer. I am not a FreeBSD developer, but I have been admin'ing my own *nix systems for decades. I think this is weird: ugen0.2: American Power Conversion at usbus0 What device or port was this on previous to 8-Stable? Is it connected via serial cable (rs232) or USB? USB. I'm betting USB and I'm thinking that maybe the driver you used to use hasn't been converted to the new USB system in 8-Stable. If that's the case it makes sense. I guess I'll just have to wait until it's converted. Thanks. -- Frank ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [Bulk] Re: USB problems on 8.0-STABLE
On Fri, 8 Jan 2010, Warren Block wrote: Do you have DEVICE /dev/ugen0.2 in apcupsd.conf? No, just DEVICE From the online manual: If you have a USB UPS, the essential elements of your apcupsd.conf file should look like the following: ## apcupsd.conf v1.1 ## UPSCABLE usb UPSTYPE usb DEVICE LOCKFILE /var/lock UPSCLASS standalone UPSMODE disable Notice that we have not specified a device. In doing so, apcupsd will try all the well known USB ports. I don't understand why usbdevs can't find any controllers and apcupsd can't find any device while the kernel and usbconfig can find it all. upsdevs: probably obsolete. As for apcupsd, I don't think it can auto-scan for USB devices, but haven't used it with USB. See above. -Warren Block * Rapid City, South Dakota USA -- Frank ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ntpd not removed; WITHOUT_NTP enabled in src.conf
On Sat, Jan 09, 2010 at 12:08:09PM +0100, Oliver Fromme wrote: Roland Smith wrote: Henrik Hudson wrote: Hey List, Among other things I have in my /etc/src.conf WITHOUT_NTP=yes which from my understanding should not build ntpd, etc... [...] ntpd still exists in /usr/sbin and the man pages, etc... seem to still be hanging around. Did I miss something? Adding options to `/etc/src.conf` does not remove old binaries, libraries or manpages! It just prevents the system from building newer ones. I'm afraid that's not true. When you disable something in src.conf(5), its files *will* be removed when you do make delete-old. See the file src/tools/build/mk/OptionalObsoleteFiles.inc for all the details. It's included by src/ObsoleteFiles.inc which in turn is included by src/Makefile.inc1 (after /etc/src.conf was parsed by share/mk/bsd.own.mk). Hmm, interesting. Thanks for the heads-up :-) If that doesn't work for WITHOUT_NTP, then that's a bug. Probably some entries missing in OptionalObsoleteFiles.inc. There are a actually quite a lot missing, if you compare src.conf(5) with /usr/src/tools/build/mk/OptionalObsoleteFiles.inc WITHOUT_ACCT ((or MK_ACCT) to begin with, WITHOUT_AMD, WITHOUT_APM, WITHOUT_AT, WITHOUT_BZIP2 etc. And a lot of others need to be filled in, like MK_BOOT, MK_CALENDAR, MK_CPP, MK_CRYPT, etc. I'll give improving the list a try, as soon as I can find some spare time. Got some frozen bowden calbes on my bike to sort out first. :-/ Roland -- R.F.Smith http://www.xs4all.nl/~rsmith/ [plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated] pgp: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 (KeyID: C321A725) pgppHn45d9edj.pgp Description: PGP signature
Re: ntpd not removed; WITHOUT_NTP enabled in src.conf
Roland Smith wrote: Oliver Fromme wrote: When you disable something in src.conf(5), its files *will* be removed when you do make delete-old. See the file src/tools/build/mk/OptionalObsoleteFiles.inc for all the details. It's included by src/ObsoleteFiles.inc which in turn is included by src/Makefile.inc1 (after /etc/src.conf was parsed by share/mk/bsd.own.mk). Hmm, interesting. Thanks for the heads-up :-) If that doesn't work for WITHOUT_NTP, then that's a bug. Probably some entries missing in OptionalObsoleteFiles.inc. There are a actually quite a lot missing, if you compare src.conf(5) with /usr/src/tools/build/mk/OptionalObsoleteFiles.inc That's true. I guess some people simply forget it (or don't know about it) when adding a knob for src.conf. There's another pitfall: When you install, say, BIND from the ports collection with the option WITH_REPLACE_BASE=true and add WITHOUT_BIND=yes to src.conf. When you update your world it will wipe out your BIND files that were installed from ports, so you have to re-install the port. I haven't tried this myself, though ... Maybe there's a safety-belt somewhere. Anyway -- Only very few ports have a good reason to have an option to install them in base. The ntp port isn't one of them, so clearly there's no harm to add its files to the OptionalObsoleteFiles.inc file. Best regards Oliver -- Oliver Fromme, secnetix GmbH Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd (On the statement print 42 monkeys + 1 snake:) By the way, both perl and Python get this wrong. Perl gives 43 and Python gives 42 monkeys1 snake, when the answer is clearly 41 monkeys and 1 fat snake.-- Jim Fulton ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS performance degradation over time
On Fri, 8 Jan 2010 15:05:06 -0800 Jeremy Chadwick free...@jdc.parodius.com wrote: All that said -- I know what the OP is referring to, as I've seen it myself (on RELENG_7, and possibly early releases of 8.0). The only way to relieve the pain, AFAIK, is to reboot. I assume the problem is that the memory handling in ZFS is not the best regarding memory fragmentation (at least in FreeBSD, I do not know of the memory handling in Solaris has a similar behavior). Regarding the RELENG_7 systems you have which use ZFS, are they SMP systems? If yes, do you see problems when a lot of parallel accesses (let's say several find in parallel) are made? All the commits to ZFS for 7-stable are triggered by a problem I have in this regard on a 7-stable system, but so far nothing helped. I do see some MFC's done about 13 hours ago to RELENG_7 and RELENG_8 that talk about the ARC and paging pressure, which to me means decreased performance when it occurs... or maybe it helps with the kmem exhaustion problem? The brief description in the commit is simply not enough to suffice; it's almost like we need a FreeBSD ZFS Newsletter that documents what all the changes are that get committed, what they fix, and what's being worked on/tested in HEAD (for potential MFC). The change you talk about tells ZFS to cleanup the ARC when the max size is passed, instead when there is real need to get some free memory. The dresult is that the arc_max setting is more strictly followed, and that there is no expensive operation to be done to free the ARC when the system needs free memory. Bye, Alexander. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 8.0 STABLE sata regression
Hi. Abdullah Ibn Hamad Al-Marri wrote: My servers are alright with FreeBSD 8.0-RELEASE, but not with -STABLE. FreeBSD NOC.WEArab.Net 8.0-STABLE FreeBSD 8.0-STABLE #0: Fri Jan 8 18:26:13 UTC 2010 ad...@localhost.localdomain:/usr/obj/usr/src/sys/GENERIC amd64 atapci0: Intel ICH7 SATA300 controller port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x20a0-0x20af mem 0x9020-0x902003ff irq 19 at device 31.2 on pci0 ata0: ATA channel 0 on atapci0 ata0: [ITHREAD] ata1: ATA channel 1 on atapci0 ata1: [ITHREAD] when I upgraded to FreeBSD 8.0-STABLE it got many issues. ad2: 381554MB WDC WD4000KD-00NAB0 01.06A01 at ata1-master UDMA100 If UDMA mode reported instead of SATA speed is the only issue, then it is not an issue, but only a cosmetic change. It doesn't mean that your drives will work slower. Thanks for report, I'll plug ICH7 board a bit later to check this. To get more info about the problem, try `atacontrol mode ad2` command. -- Alexander Motin ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: nginx hanging with state zoneli
On 08.01.2010 20:21, Steven Hartland wrote: [..] 12582/218/12800/12800 4k (page size) jumbo clusters in use (current/cache/total/max) Try to increase jumbo clusters (sysctl kern.ipc.nmbjumbop) [...] -- Alexander Nesterov ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: mounting ext3 for rw
On Saturday 09 January 2010 08:40, Zoran Kolic wrote: I should probably kldload ext2fs.ko first to have support. the way i use it to mount them since it's a fuse-implementation, i use /usr/local/etc/rc.d/fusefs(or fuse, i don't remember) onestart and it loads the fuse module. contrary to you, i didn't remove EXT2FS from my kernel, but i don't think that makes any difference. -- Cocaine is nature's way of telling you you have too much money. signature.asc Description: This is a digitally signed message part.
8-stable/amd64: ATA: hard hang when doing burncd fixate
All, I get a hard hang on a TYAN Thunder K8S with a single Opteron mounted: : CPU: AMD Opteron(tm) Processor 246 (1991.62-MHz K8-class CPU) Origin = AuthenticAMD Id = 0xf58 Stepping = 8 Features=0x78bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2 AMD Features=0xe0500800SYSCALL,NX,MMX+,LM,3DNow!+,3DNow! real memory = 1073741824 (1024 MB) avail memory = 1023348736 (975 MB) ACPI APIC Table: A M I OEMAPIC : atapci0: SiI 3114 SATA150 controller port 0xbc00-0xbc07,0xb880-0xb883,0xb800-0xb807,0xac00-0xac03,0xa880-0xa88f mem 0xfeafec00-0xfeafefff irq 19 at device 5.0 on pci3 atapci0: [ITHREAD] ata2: ATA channel 0 on atapci0 ata2: [ITHREAD] ata3: ATA channel 1 on atapci0 ata3: [ITHREAD] ata4: ATA channel 2 on atapci0 ata4: [ITHREAD] ata5: ATA channel 3 on atapci0 ata5: [ITHREAD] : atapci1: AMD 8111 UDMA133 controller port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0 ata0: ATA channel 0 on atapci1 ata0: [ITHREAD] ata1: ATA channel 1 on atapci1 ata1: [ITHREAD] : atapci2: Marvell 88SX6081 SATA300 controller port 0x8800-0x88ff mem 0xfc80-0xfc8f irq 26 at device 2.0 on pci2 atapci2: [ITHREAD] ata6: ATA channel 0 on atapci2 ata6: [ITHREAD] ata7: ATA channel 1 on atapci2 ata7: [ITHREAD] ata8: ATA channel 2 on atapci2 ata8: [ITHREAD] ata9: ATA channel 3 on atapci2 ata9: [ITHREAD] ata10: ATA channel 4 on atapci2 ata10: [ITHREAD] ata11: ATA channel 5 on atapci2 ata11: [ITHREAD] ata12: ATA channel 6 on atapci2 ata12: [ITHREAD] ata13: ATA channel 7 on atapci2 ata13: [ITHREAD] : acd0: DVDR NEC DVD+/-RW ND-6500A/2.22 at ata1-master UDMA33 ad0: 476940MB Maxtor 7H500F0 HA431DN0 at ata2-master UDMA100 SATA 1.5Gb/s ad1: 476940MB Maxtor 7H500F0 HA431DN0 at ata3-master UDMA100 SATA 1.5Gb/s ad2: 1430799MB Seagate ST31500341AS SD17 at ata6-master UDMA100 SATA 3Gb/s ad3: 1430799MB Seagate ST31500341AS CC1H at ata7-master UDMA100 SATA 3Gb/s ad4: 476940MB MAXTOR STM3500630AS 3.AAE at ata12-master UDMA100 SATA 1.5Gb/s : Writing an image is fine using: ns1% sudo burncd -f /dev/acd0 data FreeBSD-9.0-CURRENT-201001-ia64-bootonly.iso Fixating the CD is causing the hard hang: ns1% sudo burncd -f /dev/acd0 fixate fixating CD, please wait.. *hard hang* There's nothing in the console and interrupts are all masked. A power-cycle is the only thing that can be done. Is this a known issue? -- Marcel Moolenaar xcl...@mac.com ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS performance degradation over time
Andrew Snow wrote: Ivan Voras wrote: It is true that ZFS in theory doesn't do very well with random writes of any kind - the kind that torrent clients do should actually be the worst case for ZFS, *but*, this very much depends on the actual workload. ZFS has aggressive read-ahead for sequential read-aheads, so its worth noting that the performance problem can be mitigated by having lots of RAM free for read-ahead, as well as multiple vdevs in the zpool (so that it can be seeking all disks at once) Yes and no. Read ahead will not help performance when the data is so fragmented that the disk is seek-bound. No matter how much of the file you can get in RAM, it still needs to be fetched from the drive platters. (Except if it's smart enough to read sequential chunks from the raw storage even though they are logically not located nearly, and in case of torrents, probably belong to different files, which I very much doubt it does). ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ntpd not removed; WITHOUT_NTP enabled in src.conf
On 1/9/10, Oliver Fromme o...@lurza.secnetix.de wrote: There's another pitfall: When you install, say, BIND from the ports collection with the option WITH_REPLACE_BASE=true and add WITHOUT_BIND=yes to src.conf. When you update your world it will wipe out your BIND files that were installed from ports, so you have to re-install the port. I haven't tried this myself, though ... Maybe there's a safety-belt somewhere. Currently, there is no safety belt to protect from deleting the BIND files. I created this simple patch to OptionalObsoleteFiles.inc that will prevent the deleting of the BIND Files when the BIND port is installed using WITH_REPLACE_BASE: http://www.freebsd.org/cgi/query-pr.cgi?pr=142529 Scot ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8-stable/amd64: ATA: hard hang when doing burncd fixate
On Sat, Jan 9, 2010 at 11:14 AM, Marcel Moolenaar xcl...@mac.com wrote: All, I get a hard hang on a TYAN Thunder K8S with a single Opteron mounted: : CPU: AMD Opteron(tm) Processor 246 (1991.62-MHz K8-class CPU) Origin = AuthenticAMD Id = 0xf58 Stepping = 8 Features=0x78bfbffFPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2 AMD Features=0xe0500800SYSCALL,NX,MMX+,LM,3DNow!+,3DNow! real memory = 1073741824 (1024 MB) avail memory = 1023348736 (975 MB) ACPI APIC Table: A M I OEMAPIC : atapci0: SiI 3114 SATA150 controller port 0xbc00-0xbc07,0xb880-0xb883,0xb800-0xb807,0xac00-0xac03,0xa880-0xa88f mem 0xfeafec00-0xfeafefff irq 19 at device 5.0 on pci3 atapci0: [ITHREAD] ata2: ATA channel 0 on atapci0 ata2: [ITHREAD] ata3: ATA channel 1 on atapci0 ata3: [ITHREAD] ata4: ATA channel 2 on atapci0 ata4: [ITHREAD] ata5: ATA channel 3 on atapci0 ata5: [ITHREAD] : atapci1: AMD 8111 UDMA133 controller port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0 ata0: ATA channel 0 on atapci1 ata0: [ITHREAD] ata1: ATA channel 1 on atapci1 ata1: [ITHREAD] : atapci2: Marvell 88SX6081 SATA300 controller port 0x8800-0x88ff mem 0xfc80-0xfc8f irq 26 at device 2.0 on pci2 atapci2: [ITHREAD] ata6: ATA channel 0 on atapci2 ata6: [ITHREAD] ata7: ATA channel 1 on atapci2 ata7: [ITHREAD] ata8: ATA channel 2 on atapci2 ata8: [ITHREAD] ata9: ATA channel 3 on atapci2 ata9: [ITHREAD] ata10: ATA channel 4 on atapci2 ata10: [ITHREAD] ata11: ATA channel 5 on atapci2 ata11: [ITHREAD] ata12: ATA channel 6 on atapci2 ata12: [ITHREAD] ata13: ATA channel 7 on atapci2 ata13: [ITHREAD] : acd0: DVDR NEC DVD+/-RW ND-6500A/2.22 at ata1-master UDMA33 ad0: 476940MB Maxtor 7H500F0 HA431DN0 at ata2-master UDMA100 SATA 1.5Gb/s ad1: 476940MB Maxtor 7H500F0 HA431DN0 at ata3-master UDMA100 SATA 1.5Gb/s ad2: 1430799MB Seagate ST31500341AS SD17 at ata6-master UDMA100 SATA 3Gb/s ad3: 1430799MB Seagate ST31500341AS CC1H at ata7-master UDMA100 SATA 3Gb/s ad4: 476940MB MAXTOR STM3500630AS 3.AAE at ata12-master UDMA100 SATA 1.5Gb/s : Writing an image is fine using: ns1% sudo burncd -f /dev/acd0 data FreeBSD-9.0-CURRENT-201001-ia64-bootonly.iso Fixating the CD is causing the hard hang: ns1% sudo burncd -f /dev/acd0 fixate fixating CD, please wait.. *hard hang* There's nothing in the console and interrupts are all masked. A power-cycle is the only thing that can be done. Is this a known issue? -- Marcel Moolenaar I believe the standard advice is to be using atapicam and cdrecord w/ ahci. -- Adam Vande More ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 8.0 STABLE sata regression
Hello, - Original Message From: Alexander Motin m...@freebsd.org To: Abdullah Ibn Hamad Al-Marri wearab...@yahoo.ca Cc: FreeBSD STABLE freebsd-stable@freebsd.org; FreeBSD Questions freebsd-questi...@freebsd.org Sent: Sat, January 9, 2010 5:29:46 PM Subject: Re: FreeBSD 8.0 STABLE sata regression Hi. Abdullah Ibn Hamad Al-Marri wrote: My servers are alright with FreeBSD 8.0-RELEASE, but not with -STABLE. FreeBSD NOC.WEArab.Net 8.0-STABLE FreeBSD 8.0-STABLE #0: Fri Jan 8 18:26:13 UTC 2010ad...@localhost.localdomain:/usr/obj/usr/src/sys/GENERIC amd64 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x20a0-0x20af mem 0x9020-0x902003ff irq 19 at device 31.2 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] when I upgraded to FreeBSD 8.0-STABLE it got many issues. ad2: 381554MB at ata1-master UDMA100 If UDMA mode reported instead of SATA speed is the only issue, then it is not an issue, but only a cosmetic change. It doesn't mean that your drives will work slower. Thanks for report, I'll plug ICH7 board a bit later to check this. To get more info about the problem, try `atacontrol mode ad2` command. -- Alexander Motin Here is the result, VB# atacontrol mode ad4 current mode = UDMA100 VB# atacontrol mode ad6 current mode = UDMA100 VB# ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS performance degradation over time
2010/1/8 Artem Belevich fbsdl...@src.cx: Keep an eye on ARC size and on active/inactive/cache/free memory lists: I can share a munin plugin for monitoring some of ARC L1/L2 statistics, as well as memory decomposition. It still WIP (and I'm sure, that not all statistics are properly gathered), but I hope it may help. And I'm still not quite sure, if I'm interpreting some ARC parameters correctly. Just put attached files into /usr/local/etc/munin/plugins. Cheers, Wiktor Niesiobedzki ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: USB problems on 8.0-STABLE
On Saturday 09 January 2010 06:50:59 am Frank wrote: On Fri, 8 Jan 2010, Steven Friedrich wrote: OK, first a disclaimer. I am not a FreeBSD developer, but I have been admin'ing my own *nix systems for decades. I think this is weird: ugen0.2: American Power Conversion at usbus0 What device or port was this on previous to 8-Stable? Is it connected via serial cable (rs232) or USB? USB. I'm betting USB and I'm thinking that maybe the driver you used to use hasn't been converted to the new USB system in 8-Stable. If that's the case it makes sense. I guess I'll just have to wait until it's converted. Is it possible to boot one of your machines to an older release of FreeBSD, so you can discover what device driver you had been using, if any. Or any old logs may have the info. I haven't had an APC UPS, so I'm unfamiliar with apcupsd. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: USB problems on 8.0-STABLE
On Sat, 9 Jan 2010, Steven Friedrich wrote: USB. I'm betting USB and I'm thinking that maybe the driver you used to use hasn't been converted to the new USB system in 8-Stable. If that's the case it makes sense. I guess I'll just have to wait until it's converted. Is it possible to boot one of your machines to an older release of FreeBSD, so you can discover what device driver you had been using, if any. Or any old logs may have the info. I haven't had an APC UPS, so I'm unfamiliar with apcupsd. Hope this is what you mean. On 7.2-STABLE the UPS attached to ugen0. It is the same now. P.S. Per the pkg-message directions I have commented out uhid in the kernel config file, compiled and installed. Is this still necessary? -- Frank ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 8.0 STABLE sata regression
Abdullah Ibn Hamad Al-Marri wrote:
Abdullah Ibn Hamad Al-Marri wrote:
My servers are alright with FreeBSD 8.0-RELEASE, but not with -STABLE.
FreeBSD NOC.WEArab.Net 8.0-STABLE FreeBSD 8.0-STABLE #0: Fri Jan 8
18:26:13
UTC 2010ad...@localhost.localdomain:/usr/obj/usr/src/sys/GENERIC amd64
atapci0: port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x20a0-0x20af mem 0x9020-0x902003ff
irq
19 at device 31.2 on pci0
ata0: on atapci0
ata0: [ITHREAD]
ata1: on atapci0
ata1: [ITHREAD]
when I upgraded to FreeBSD 8.0-STABLE it got many issues.
ad2: 381554MB at ata1-master UDMA100
If UDMA mode reported instead of SATA speed is the only issue, then it
is not an issue, but only a cosmetic change. It doesn't mean that your
drives will work slower.
Thanks for report, I'll plug ICH7 board a bit later to check this.
To get more info about the problem, try `atacontrol mode ad2` command.
Here is the result,
VB# atacontrol mode ad4
current mode = UDMA100
VB# atacontrol mode ad6
current mode = UDMA100
VB#
OK. I have attached my ICH7 board and found where is the problem. This
chipset doesn't provide access to SATA control registers. As result,
driver can't get SATA connection info and so doesn't report it. If you
wish, you can restore previous behavior by applying attached patch. Here
is what I have with it:
%atacontrol mode ad0
current mode = UDMA100
%atacontrol mode ad4
current mode = UDMA100 SATA 1.5Gb/s
%atacontrol mode ad5
current mode = UDMA100 SATA 1.5Gb/s
%atacontrol mode ad6
current mode = UDMA100 SATA 1.5Gb/s
%atacontrol mode ad7
current mode = UDMA100 SATA 1.5Gb/s
But as I have said before, it is only a cosmetics.
--
Alexander Motin
--- ata-pci.c.prev 2010-01-10 01:25:45.0 +0200
+++ ata-pci.c 2010-01-10 01:25:49.0 +0200
@@ -714,9 +714,12 @@ static int
ata_pcichannel_getrev(device_t dev, int target)
{
struct ata_pci_controller *ctlr =
device_get_softc(device_get_parent(dev));
+ struct ata_channel *ch = device_get_softc(dev);
if (ctlr-getrev)
return (ctlr-getrev(dev, target));
+ else if (ch-flags ATA_SATA)
+ return (1);
else
return (0);
}
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: nginx hanging with state zoneli
- Original Message - From: Alexander Nesterov nester@gmail.com On 08.01.2010 20:21, Steven Hartland wrote: [..] 12582/218/12800/12800 4k (page size) jumbo clusters in use (current/cache/total/max) Try to increase jumbo clusters (sysctl kern.ipc.nmbjumbop) Thanks for the suggestion Alex I've doubled this now and will keep an eye. Regards Steve This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmas...@multiplay.co.uk. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS performance degradation over time
After being up for a few days and having good performance, I turned on rTorrent and downloaded two 700MB files. After these torrents completed, my performance has tanked again. My combined read/write speed to the array won't exceed about 25MB/s. It seems that after having downloaded a few torrents, resources are grabbed and then not released. From top: Mem: 2326M Active, 962M Inact, 484M Wired, 82M Cache, 418M Buf, 87M Free Nothing in userland is using a significant amount of memory. eg rTorrent is using 41MB according to top. Killing rTorrent does not alleviate the performance problems. arcstats.size is hovering around 30-40MB. [r...@leviathan ~]# sysctl kstat.zfs.misc.arcstats.size kstat.zfs.misc.arcstats.size: 28953448 [r...@leviathan ~]# sysctl vm.stats.vm.v_inactive_count vm.stats.vm.v_inactive_count: 237831 [r...@leviathan ~]# sysctl vm.stats.vm.v_active_count vm.stats.vm.v_active_count: 595762 [r...@leviathan ~]# sysctl vm.stats.vm.v_cache_count vm.stats.vm.v_cache_count: 21472 If no-one has any questions, I'll try Artem's suggestion of wasting a bunch of memory in Perl/Python and forcing some memory to be swapped out. (I don't want to do it yet in case someone wants a specific number before I do that). ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS performance degradation over time
On Sat, Jan 09, 2010 at 07:40:53PM -0500, Garrett Moore wrote: If no-one has any questions, I'll try Artem's suggestion of wasting a bunch of memory in Perl/Python and forcing some memory to be swapped out. (I don't want to do it yet in case someone wants a specific number before I do that). It would help if you could provide the entire output from: sysctl kstat.zfs.misc.arcstats -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS performance degradation over time
Sure: [r...@leviathan ~]# sysctl kstat.zfs.misc.arcstats kstat.zfs.misc.arcstats.hits: 32092629 kstat.zfs.misc.arcstats.misses: 1064835 kstat.zfs.misc.arcstats.demand_data_hits: 30542262 kstat.zfs.misc.arcstats.demand_data_misses: 848959 kstat.zfs.misc.arcstats.demand_metadata_hits: 1550367 kstat.zfs.misc.arcstats.demand_metadata_misses: 215876 kstat.zfs.misc.arcstats.prefetch_data_hits: 0 kstat.zfs.misc.arcstats.prefetch_data_misses: 0 kstat.zfs.misc.arcstats.prefetch_metadata_hits: 0 kstat.zfs.misc.arcstats.prefetch_metadata_misses: 0 kstat.zfs.misc.arcstats.mru_hits: 18329884 kstat.zfs.misc.arcstats.mru_ghost_hits: 114483 kstat.zfs.misc.arcstats.mfu_hits: 13762745 kstat.zfs.misc.arcstats.mfu_ghost_hits: 172573 kstat.zfs.misc.arcstats.deleted: 1735926 kstat.zfs.misc.arcstats.recycle_miss: 2076926 kstat.zfs.misc.arcstats.mutex_miss: 545 kstat.zfs.misc.arcstats.evict_skip: 532474 kstat.zfs.misc.arcstats.hash_elements: 6784 kstat.zfs.misc.arcstats.hash_elements_max: 14351 kstat.zfs.misc.arcstats.hash_collisions: 149862 kstat.zfs.misc.arcstats.hash_chains: 338 kstat.zfs.misc.arcstats.hash_chain_max: 4 kstat.zfs.misc.arcstats.p: 25819136 kstat.zfs.misc.arcstats.c: 107609280 kstat.zfs.misc.arcstats.c_min: 107609280 kstat.zfs.misc.arcstats.c_max: 860874240 kstat.zfs.misc.arcstats.size: 40148272 kstat.zfs.misc.arcstats.hdr_size: 1411072 kstat.zfs.misc.arcstats.l2_hits: 0 kstat.zfs.misc.arcstats.l2_misses: 0 kstat.zfs.misc.arcstats.l2_feeds: 0 kstat.zfs.misc.arcstats.l2_rw_clash: 0 kstat.zfs.misc.arcstats.l2_writes_sent: 0 kstat.zfs.misc.arcstats.l2_writes_done: 0 kstat.zfs.misc.arcstats.l2_writes_error: 0 kstat.zfs.misc.arcstats.l2_writes_hdr_miss: 0 kstat.zfs.misc.arcstats.l2_evict_lock_retry: 0 kstat.zfs.misc.arcstats.l2_evict_reading: 0 kstat.zfs.misc.arcstats.l2_free_on_write: 0 kstat.zfs.misc.arcstats.l2_abort_lowmem: 0 kstat.zfs.misc.arcstats.l2_cksum_bad: 0 kstat.zfs.misc.arcstats.l2_io_error: 0 kstat.zfs.misc.arcstats.l2_size: 0 kstat.zfs.misc.arcstats.l2_hdr_size: 0 kstat.zfs.misc.arcstats.memory_throttle_count: 10349 Additionally, from top: Mem: 2869M Active, 440M Inact, 479M Wired, 91M Cache, 418M Buf, 63M Free Getting 20MB/s combined read/write at this point (ie copying files from one directory to another, both source and destination on the zpool). On Sat, Jan 9, 2010 at 7:56 PM, Jeremy Chadwick free...@jdc.parodius.comwrote: On Sat, Jan 09, 2010 at 07:40:53PM -0500, Garrett Moore wrote: If no-one has any questions, I'll try Artem's suggestion of wasting a bunch of memory in Perl/Python and forcing some memory to be swapped out. (I don't want to do it yet in case someone wants a specific number before I do that). It would help if you could provide the entire output from: sysctl kstat.zfs.misc.arcstats -- | Jeremy Chadwick j...@parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: mounting ext3 for rw
contrary to you, i didn't remove EXT2FS from my kernel Looking at GENERIC in 8.0, I don't see ext2 at all. Just as module. Probably could be added. Further reading and thinkering, I should be probably fine loading ext2fs module on amd64 8.0, then mounting it via: mount -t ext2fs /dev/da0s1 /storage I also found a patch for branch 7, included in 8. If suffices, I'd go no further. If something happens, I will install e2fsprogs for fsck on bsd, rather than linux. Plug is still on the way, cannot try out all the stuff. Thank you for answer. Best reagards Zoran ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
