Re: IPv6 default route. Can't see the wood for the trees.
On 8/27/2012 12:27 PM, Christian Laursen wrote: On 08/27/12 21:03, John Hawkes-Reed wrote: On 27/08/2012 19:06, Christian Laursen wrote: On 08/27/12 18:49, John Hawkes-Reed wrote: rc.conf: (I'm not convinced that obfuscating the addresses is worth the confusion) ipv6_gateway_enable=YES ip6addrctl_verbose=YES rtadvd_enable=YES rtadvd_interfaces=rl0 ipv6_cpe_wanif=pcn0 ipv6_defaultrouter=2001:470:1f0a:b5a::1 gif_interfaces=gif0 gifconfig_gif0=192.168.1.100 216.66.80.30 ifconfig_gif0_ipv6=inet6 2001:470:1f0a:b5a::2 2001:470:1f0a:b5a::1 prefixlen 128 ifconfig_pcn0_ipv6=inet6 2001:470:1f0b:b5a::4 prefixlen 64 ifconfig_rl0_ipv6=inet6 2001:470:1f0b:b5a::3 prefixlen 64 -accept_rtadv It looks like you are trying to use the /64 used for your tunnel on the inside network. That's probably what causes the problem. You should use the Routed /64 on the inside. If you need more than one /64, you can request a /48. I think I am. The endpoints are ...:1f0A: and the /64 is ...:1f0B: Sorry, my bad. Are pcn0 and rl0 both connected to internal networks? Having the same /64 configured on both is probably bad. Why would it be? -- I am only one, but I am one. I cannot do everything, but I can do something. And I will not let what I cannot do interfere with what I can do. -- Edward Everett Hale, (1822 - 1909) ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Latest stable/8 broken for mozilla ports
For both firefox and thunderbird I'm getting this: firefox Fatal error 'locklevel = 0' at line 98 in file /frontier/svn/stable/8/lib/libthr/thread/thr_kern.c (errno = 2) Redirecting call to abort() to mozalloc_abort Segmentation fault: 11 (core dumped) This is on r238752, previous working version was r238655 thr_kern.c hasn't been updated since the last 8-release, so it would seem to be something else. Insights welcome, Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Latest stable/8 broken for mozilla ports (fwd)
On 7/24/2012 2:09 PM, Pedro Giffuni wrote: Hi Doug; Perhaps you are using -O2 in you CFLAGS? I use the standard CFLAGS, so I'm assuming the answer is yes. :) And in case my previous message wasn't clear, this worked fine until just today. Also, I forgot to add that recompiling firefox didn't help. Doug -- Change is hard. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Latest stable/8 broken for mozilla ports
On Wed, 25 Jul 2012, Konstantin Belousov wrote: On Tue, Jul 24, 2012 at 01:41:58PM -0700, Doug Barton wrote: For both firefox and thunderbird I'm getting this: firefox Fatal error 'locklevel = 0' at line 98 in file /frontier/svn/stable/8/lib/libthr/thread/thr_kern.c (errno = 2) Redirecting call to abort() to mozalloc_abort Segmentation fault: 11 (core dumped) This is on r238752, previous working version was r238655 thr_kern.c hasn't been updated since the last 8-release, so it would seem to be something else. Insights welcome, Doug Does reverting of r238715 fix your issue ? Yes, it certainly seems to. Previously firefox dumped immediately when I tried to start it. Now it is running Ok. I'll try thunderbird after I finish this message. This should probably be reverted ASAP before other stable/8 users run into it. Also, FWIW, looking at the log that MFC put mergeinfo directly onto the 2 files affected. It almost certainly should have been done at lib/libthr instead. Doug ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Fix for grub 2.00/bzr kfreebsd to boot 9.1 kernels
[ Removed -current, not relevant to 9.x ] On 07/21/2012 11:58, Juergen Lock wrote: Hi! I'm in the process of testing 9.1 on the laptop where I use grub2 because I had to put bsd in an `extended' slice, and I found out grub2 won't boot the 9.1 kernel. Nothing will boot FreeBSD on an extended slice, I'm surprised it even installed. -- Change is hard. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Fix for grub 2.00/bzr kfreebsd to boot 9.1 kernels
On 07/21/2012 17:21, Juergen Lock wrote: On Sat, Jul 21, 2012 at 02:21:49PM -0700, Doug Barton wrote: [ Removed -current, not relevant to 9.x ] On 07/21/2012 11:58, Juergen Lock wrote: Hi! I'm in the process of testing 9.1 on the laptop where I use grub2 because I had to put bsd in an `extended' slice, and I found out grub2 won't boot the 9.1 kernel. Nothing will boot FreeBSD on an extended slice, I'm surprised it even installed. I don't remember how I installed 9.0 back then, maybe it was manually, but yes grub boots it just fine, and with the fix also after updating to RELENG_9. zsh enceladus% uname -a FreeBSD enceladus.kn-bremen.de 9.1-PRERELEASE FreeBSD 9.1-PRERELEASE #0: Fri Jul 20 21:28:23 CEST 2012 n...@enceladus.kn-bremen.de:/usr/obj/d3t/d3t/home/nox/src91/src/sys/ENCELADUS amd64 zsh enceladus% df -k Filesystem 1024-blocks Used Avail Capacity Mounted on /dev/ada0s7a 8245660 6150304 143570481%/ [...] Well I'm happy to be proven wrong. Do you have one big partition, or were you able to partition it? And do you have more than one FreeBSD installed? Doug -- Change is hard. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Checksum errors across ZFS array
On 07/20/2012 15:55, James Snow wrote: On Fri, Jul 20, 2012 at 03:46:21PM -0700, Doug Barton wrote: You probably know this already, but just in case ... Software memory tests cannot tell you conclusively that memory is good, only that it's bad. I may have known that in a past life but certainly wasn't thinking about it now. Glad to help. To make sure it's good you need a hardware tester. Is there one you'd recommend? They're not exactly an impulse purchase. :) -- Change is hard. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Checksum errors across ZFS array
On 07/20/2012 15:22, James Snow wrote: I've run memtest for about 20 hours now (13 hours in one pass, 7 and counting on the second) and seen no errors. Hrm. You probably know this already, but just in case ... Software memory tests cannot tell you conclusively that memory is good, only that it's bad. To make sure it's good you need a hardware tester. hth, Doug -- Change is hard. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 -8.3 regression on disk writes
Have you tried switching your scheduler to 4BSD? -- Change is hard. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: fsck_ufs running too often
On 06/24/2012 06:35, Jakub Lach wrote: It boiled down to that: - fsck in background massively slowed i/o and full fsck before starting system is actually preferred/faster for most cases. Try switching to SCHED_4BSD in your kernel conf and see if that helps with slow i/o during load. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
PORTS_MODULES
Howdy, This is an FYI to let people know about a really nice feature for those that have ports installed which include kernel modules. You can place a list in /etc/src.conf like this: PORTS_MODULES= emulators/virtualbox-ose-kmod sysutils/fusefs-kmod x11/nvidia-driver which will cause those modules to be built and installed with all the proper matching stuff at the same time as buildkernel and installkernel. This feature has existed for a while, but has had issues. Thanks to a team effort it's a lot more robust now, and ready for prime time (in HEAD, and the -STABLE branches for now, soon to be in 9.1-RELEASE). Enjoy, Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: CLang and WERROR
Please don't try to start a new thread by replying to a message and changing the subject line. Those of us who use threaded mail readers see the new message under the old thread, which can cause the new message to be missed. It's better to start a whole new message. hth, Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ULE Scheduler
On 06/06/2012 18:16, Doug Barton wrote: On 06/06/2012 18:01, Момчил Иванов wrote: Is there some remedy? Try the 4BSD scheduler. Did you ever try this? Did it help? -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Documenting 'make config' options
On 06/06/2012 11:59, Dave Hayes wrote: I'm describing more of a use case here, not attempting to specify an implementation. If a user invokes 'make', a window is presented to them with various options. It's probably very common that this is met with an initial reaction of what the hell do these do?, even from the most seasoned of admins (presuming they are unfamiliar with the software they have been asked to install). I claim it would be an improvement to have that information at the fingertips of the make invoker. What manner of providing this information would meet your needs? -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ULE Scheduler
On 06/06/2012 18:01, Момчил Иванов wrote: Is there some remedy? Try the 4BSD scheduler. -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Installworld and /usr/include/*.h modification times
On 06/04/2012 00:10, Christer Solskogen wrote: On Fri, Jun 1, 2012 at 3:42 PM, Kimmo Paasiala kpaas...@gmail.com wrote: Hello list, Why are /usr/include files installed with install -C during make installworld when almost everything else is installed without the -C flag? This makes it harder to track which files were actually installed during the last make installworld. One can easily find obsolete files (that are not covered with make delete-old(-libs)) with find -x / -type f -mtime +suitable_time but this doesn't work for /usr/include files because the modification times are not bumped on make installworld. If you want, you can do this /after/ a buildworld # mv /usr/include /usr/include.old # cd /usr/src You don't need to do those last 2 steps below if you mv /usr/include right before you do 'make installworld', FYI. # make hierarchy # make installincludes -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Why Are You NOT Using FreeBSD?
On 06/03/2012 05:43, Erich wrote: it is new to me that Microsoft asks for a Windows update when a new Office version appears at the scene. Actually it's very common for Windows applications to specify a minimum OS service pack level. To stretch the analogy a bit, you're also not going to find any modern Windows application that will run on Windows 98, for example. Microsoft also does not ask to update all other applications before the latest Office can be installed. I commonly get prompted to update the .Net I have installed, and/or to install a newer version altogether when installing the latest and greatest Windows applications. As with all things computery, your mileage may vary. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [ GSOC ] Differences in shell behaviour
On 5/31/2012 12:21 PM, Alexander Pronin wrote: But, is it suitable to write sh script for 9.0, that does not work in 8.3? No. Our tools need to work in all supported versions of FreeBSD, which at this time includes 7 as well. hope this helps, Doug PS, please don't cross-post to multiple FreeBSD lists. freebsd-ports@ would have been enough for this message. -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: /usr/bin/unzip not being installed on 8.3-STABLE
On 5/29/2012 12:37 AM, Dag-Erling Smørgrav wrote: Doug Barton do...@freebsd.org writes: This needs more than diff-posting, it needs actual testing. By humans, and an -exp run. Since miwi is on the cc list, perhaps he can arrange it? No -exp run required. This code is already in use in head and 9 and has been for ages - two and a half years, to be exact. I saw your followup, and I think you're probably right ... the problem is that there are some things in the ports tree that are conditional on OSVERSION, so the fact that it works on HEAD and 9 doesn't necessarily mean that it will work in 8. If you've already done the MFC that should be fine. If I were miwi I'd still schedule the -exp run, but I'm not the boss of him. :) Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 9.0 hangs on heavy I/O
On 5/29/2012 12:26 PM, Kees Jan Koster wrote: I seem to have a problem where really heavy disk I/O is drowning my machine. Assuming you're using the default scheduler (SCHED_ULE), try switching to the 4BSD scheduler in your kernel config file and see if that helps. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Named Error
On 05/28/2012 01:28, Shiv. NK wrote: eval: mtree: not found eval: mount: not found I assume you're typing '/etc/rc.d/named restart'. If so, there appears to be something wrong with your PATH in that shell. Try doing 'service named restart' instead. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Named Error
On 05/28/2012 02:36, Shiv. NK wrote: On 05/28/2012 01:28, Shiv. NK wrote: eval: mtree: not found eval: mount: not found I assume you're typing '/etc/rc.d/named restart'. If so, there appears to be something wrong with your PATH in that shell. Try doing 'service named restart' instead. Doug Dear D. Barton, thanks for your response, i forgot to tell that the error i reported above is generated when named is restarted using bash script through cron. But if i manually restart from terminal window, both commands works just fine. without any error Then it's definitely a PATH problem. Use the service method described above and the problem will go away. FYI, you almost certainly do not need to restart named via a cron job. You probably want to write to bind-us...@isc.org and describe what you're trying to accomplish, and they can give you better suggestions on how to do it. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: clang tautology
On 5/28/2012 8:47 PM, Randy Bush wrote: and if i try to follow http://wiki.freebsd.org/BuildingFreeBSDWithClang i do not see where the clang world and kernel are actually made the normal bootable. is the clang build for releng_9 for amd64 in good enough shape that i can simply csup hack make.conf clean /usr/obj (I know you know this, but for the sake of the archive ) make buildworld make kernel boot single make installworld mergemaster -cviFU FYI, there is no reason to use -F and -U together. The latter is sufficient. The -F option is useful on a new install when the db for -U is not present. reboot as if life was normal? Normal'ish. Personally, unless you have a specific reason to have a clang-built world, I would avoid the hassle. (Not to mention all the extra time that bootstrapping clang takes during buildworld.) Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: /usr/bin/unzip not being installed on 8.3-STABLE
This needs more than diff-posting, it needs actual testing. By humans, and an -exp run. Since miwi is on the cc list, perhaps he can arrange it? Doug On 5/28/2012 10:59 AM, Jason Hellenthal wrote: Here is the unzip diff from stable/8 - head On Mon, May 28, 2012 at 07:20:03PM +0200, Dag-Erling Smørgrav wrote: Jason Hellenthal jhellent...@dataix.net writes: Could someone MFC this to stable/8 please... Is unzip in stable/8 identical to unzip in head and stable/9? If not, this should be addressed first. Otherwise, there is a good chance that many ports will fail to build. -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Make filesystem type configurable for periodic(8)?
On Fri, 4 May 2012, Freddie Cash wrote: daily_status_security_neggrpperm_fs_ignore= Please don't add new examples of variables that are empty by default. It's ok to include that line in /etc/defaults/periodic.conf, just put a comment before it. Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 3/6/2012 2:12 AM, Adrian Chadd wrote: You haven't been bitten by the storage layer or filesystem hackery bits which has caused filesystem corruption. :) Ummm, I have, actually. I was one of the early adopters of SU+J and complained loudly when it ate my /var/ for lunch. I also use a lot of separate slices/partitions, so my system partition isn't getting written to very often, isn't using SU+J, and almost always comes up clean after a crash. My layout looks like this: FreeBSD 1 2 are the same: / + /usr /var /tmp (memory disk) /usr/local/ (this is the big partition, things like ports WRKDIRPREFIX and /usr/obj go here) Then I have separate ext2fs filesystems for /home, /data (cvs, svn, other big trees). These are accessible from my Linux partition, which is also where the shared swap partition is. Using ext2fs for things I really care about (like /home) or things that would take a long time to reproduce (like cvs and svn trees) has helped avoid some of the more exciting corruption/data loss events, and everything on the /usr/local's is either backed up, or trivially reproducable. That said, FFS+SUJ has made recover-from-kernel-panic so much less painful. Thankyou Jeffr and others! It's also made a mess out of snapshots ... The only thing I use SU+J for is /var and /usr/local (see above). What I tend to do is either run current on a VM or organise some dedicated -current laptops. And run the bits of -current I'm testing on -8 and -9. Well you get a gold start for actually running it at all, so there you go. :) Doug ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 3/4/2012 2:04 PM, Adrian Chadd wrote: 2012/3/3 Doug Barton do...@freebsd.org: On 03/02/2012 16:05, Adrian Chadd wrote: Try breaking that cycle. ... one of the things I've been asking for years. :) Julian's right though, I think PC-BSD will help, but I still think that committers should run -current. I've asked privately for our committers to go back to -current and then have some dedicated development time where we work together to fix the problems that *we* find in order to make the project more desktop-friendly overall. I was (figuratively) laughed out of the room. There's a magic intersection between need to run current and need to keep stuff unbroken enough to get work done. Personally I have a -current partition (slice) that I keep up to date, and an 8-stable'ish slice that I purposely keep in a known-good state, and only update if -current has been running good for a while (which it has more often than not in the last several years). I have both slices set up to share data such as /home, my cvs and svn trees, etc. This has worked really well for me (and others, I originally got the idea and some of my configuration from David Wolfskill) for over a decade. hth, Doug ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 03/03/2012 08:53, K. Macy wrote: a) We as a members of the community are collectively responsible for the state of FreeBSD. Simply disabling features or removing functionality that doesn't work or doesn't work optimally and / or filing bug reports but not being able or willing to respond to feedback requests is in essence a form of neglect. Although we all have day to day obligations for which the use of FreeBSD is extremely impractical if not impossible ... any progress, any improvements, any advancements will only happen because *we* made it happen. Since we're reiterating key points, I'll do mine one more time. While I sympathize with what you wrote above, if you continue to believe that users have a responsibility to help you debug new features you're going to be disappointed and frustrated. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 03/02/2012 16:05, Adrian Chadd wrote: Try breaking that cycle. ... one of the things I've been asking for years. :) Julian's right though, I think PC-BSD will help, but I still think that committers should run -current. I've asked privately for our committers to go back to -current and then have some dedicated development time where we work together to fix the problems that *we* find in order to make the project more desktop-friendly overall. I was (figuratively) laughed out of the room. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 03/03/2012 13:03, K. Macy wrote: On Sat, Mar 3, 2012 at 9:54 PM, Doug Barton do...@freebsd.org wrote: On 03/03/2012 08:53, K. Macy wrote: a) We as a members of the community are collectively responsible for the state of FreeBSD. Simply disabling features or removing functionality that doesn't work or doesn't work optimally and / or filing bug reports but not being able or willing to respond to feedback requests is in essence a form of neglect. Although we all have day to day obligations for which the use of FreeBSD is extremely impractical if not impossible ... any progress, any improvements, any advancements will only happen because *we* made it happen. Since we're reiterating key points, I'll do mine one more time. While I sympathize with what you wrote above, if you continue to believe that *users* have a responsibility to help you debug new features you're going to be disappointed and frustrated. Users don't, community members do. You're drawing a distinction that I don't. So I guess I rest my case for you Doug. You're an end user at the end of the day who thinks he is a member of the community. As you've made apparent on other threads. In your mind Other People(TM) are responsible for FreeBSD's welfare for consuming your dogfood because you know the people who eat it. Um, wow. Clearly you are either unable or unwilling to see my point, so I wish you all the best. -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 03/01/2012 16:03, K. Macy wrote: I understand the switch. Uptime is important in any production network. However, it seems like it may have been too easy to turn it off because no one has made any effort to help me debug the issues. By analogy your guidance for ports usability problems would be to install Ubuntu. Apparently you've missed all the times that I've given that exact advice. :) But your analogy is severely flawed. Flowtable was an experimental feature that theoretically might have increased performance for some work flows, but turned out to be fatally flawed. The ports system is an essential part of the FreeBSD operating *system*, depended on by virtually 100% of FreeBSD users. Users don't have any obligation to help us debug new/experimental features. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 03/02/2012 03:44, K. Macy wrote: Apparently you've missed all the times that I've given that exact advice. :) But your analogy is severely flawed. Flowtable was an experimental feature that theoretically might have increased performance for some work flows, but turned out to be fatally flawed. The ports system is an essential part of the FreeBSD operating *system*, depended on by virtually 100% of FreeBSD users. Certainly fatally flawed without any user support. Just as many new features have been. Right, but what's your point? I have this cool new thing, and you have to risk your network stability in order to help me debug it on a production network? That's not how the world works man. Users don't have any obligation to help us debug new/experimental features. Correct. However, I'm not sure the analogy is flawed. I am, to some degree, guilty of the same sin. I now run Ubuntu and have never had a single problem keeping my package system up date, in stark contrast to my experiences of slow and nightmarishly error-ridden port updates. So first of all, apples and oranges (Ubuntu packages vs. our ports), but yeah, I get it. I use both, and have had the same user experience you have, on both systems. I work with the ports infrastructure quite a bit, and I know it's flaws intimately. That's one reason that I wrote portmaster. I know there are users who have operated without such problems. It is entirely possible that they're simply smarter than I am. Not necessarily. I have said many times that the ports system has some really bad fundamental design principles that make users' lives harder, and unfortunately there is a lot of inertia that prevents change. Some of this is improving, a lot of it is not. But, at the same time, a lot of work is going into improving usability, and I think the situation is better now than it was even just a few years ago. I similarly feel no compunction to use a FreeBSD feature (the ports system) that I can't rely on. ... and here is the crux of the problem. The vast majority of our developers don't use FreeBSD as their regular workstation. So it has increasingly become an OS where changes are being lobbed over the wall by developers who don't run systems that those changes affect. That's no way to run a railroad. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 03/02/2012 10:46, K. Macy wrote: You understand my point but then fail to or choose not to see how it applies to you when it creates problems for you personally. No, I already pointed out the distinction between new, experimental features; and essential components of the FreeBSD operating system. It's Ok for you to disagree with that distinction, or with its importance. But what you're suggesting is that if users don't help developers debug cool new feature X then we won't have cool new feature X. By implication you're saying that if we don't continue to develop cool new features then at some point down the road we wither and die. What I have tried ever-so-delicately to avoid saying is that lack of user help with debugging cool new feature X is generally a sign of lack of user demand for cool new feature X. Not all cool new ideas are good ones. :) OTOH, if we don't fix the fundamental problems with ports, and other key areas of the operating system, we're just not going to have users, period. Given that most of the developers (like you) have stopped using FreeBSD on a day-to-day basis, who can blame them? Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 3/2/2012 1:27 PM, Andriy Gapon wrote: on 02/03/2012 20:21 Doug Barton said the following: ... and here is the crux of the problem. The vast majority of our developers don't use FreeBSD as their regular workstation. Do you care to back this up with facts? You mean other than the very few hands that go up whenever we discuss who is actually using FreeBSD as their desktop? If that doesn't work for you, look around at the next developer's summit and take note of the overwhelming preponderance of fruit logos. Just looking at the committers, of which we have over 300, only a couple dozen at most have ever identified as actually using FreeBSD as a desktop at my count. Taking the larger development community into account I think the numbers are a little better, but not much. Sure, our strength is servers, and that is not going to change. But how many real-life bugs have I personally uncovered in -current as a result of actually running it (mostly) daily? I'm not the only one, certainly, but if the numbers were flipped and the vast majority of our developers *did* use FreeBSD routinely, how much better off would we be? And before anyone bothers to point it out, yes, I happen to be using Windows at this exact moment. I have some layer 9 work to get done and I need tools that are only available to me in Windows (more's the pity). The sad thing is, judging by the activity on the -ports@ list, the traffic in #bsdports, and just talking to/interacting with FreeBSD users, a lot of *them* are not only interested in FreeBSD as a desktop OS, they are actually doing it. Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
On 2/29/2012 6:01 PM, Steve Wills wrote: On 02/29/12 13:17, K. Macy wrote: . I tried it, on both FreeBSD routers, web systems, and database servers; all on 8.2+. It still causes massive instability. Disabling the sysctl, and/or removing it from the kernel solved the problems. Routing I can believe, but I'm wondering how close attention you paid to the workload. There are CDN networks with high uptimes and shipping firewall products that use flowtable, so your mention of web systems forces makes me ask for specifics. The failure I experienced was with web servers running 8.0 behind a F5 load balancer in an HA setup. Whenever the failover happened, the web servers would continue sending to the wrong MAC address, despite the arp table updating. Disabling flowtable via the sysctl solved the problem. Maybe Doug's failure was similar, maybe not, but I thought I'd throw my $0.02 in. Yes, that was part of it. On the web and db systems we had what I can only describe as general wackiness with systems suddenly becoming unreachable, etc. This was with a moderately complex network setup with a combination of different VLANs, multiple interfaces, etc. The FreeBSD routers would just plain panic on a semi-regular interval. Removing flowtable made all this go away, and we've been quite stable since then. hth, Doug -- This .signature sanitized for your protection ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [CFT] modular kernel config
On 2/28/2012 10:48 AM, Arnaud Lacombe wrote: You will sure go really far with this kind of It is broken ? Let's not fix it and disable it instead mentality, even more when coming from a committer. As long as there will be these kind of comments around here, FreeBSD will deserve nothing but to keep dying piece by piece, and it will be deserved. In general, I tend to agree with you, but in this case it's useful to know the history of the flowtable option. 1. It was introduced in -current 2. It received fairly good testing, was pronounced good and useful, and MFC'ed. 3. Several releases happened with flowtable. 4. Users started to report problems that were ultimately tracked down to flowtable. 5. Ultimately it was decided that flowtable was not a universal good. 6. The developer of the option agreed that it should be disabled by default until such time as it can be fixed. 7. The fixing hasn't happened yet. While generally fixing things is the right solution, if the fix is complex (or worse, unknown AND complex) then disabling by default is a reasonable answer. Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: flowtable usable or not
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On 02/28/2012 15:08, Florian Smeets wrote: I talked to Kip Macy, who implemented flowtable, about this. He thinks that the problem was caused by inappropriate default setting of net.inet.ip.output_flowtable_size. This should have been fixed by r205488 which was MFC'd to 8 and should be part of 8.2 and of course 9.0. However nobody who experienced the problem wanted to try any of these releases with flowtable enabled, so we still don't know if it's fixed or not. Should anyone try this it could certainly be the case that net.inet.ip.output_flowtable_size needs to be tuned even more. I tried it, on both FreeBSD routers, web systems, and database servers; all on 8.2+. It still causes massive instability. Disabling the sysctl, and/or removing it from the kernel solved the problems. Doug - -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.18 (FreeBSD) iQEcBAEBCAAGBQJPTdKIAAoJEFzGhvEaGryEHksH/1Hg6TIXLuXf9fUrwsr2Wru3 0qY4MyB6Z0jgXZYqK3QtVd+zzo3LjCbhlN2qUJE/j5eLdROwev+vqdmmKgHRmU5+ lbqIw8t3W9ICobzTxlKmOjJlgBMgrPcX1Dbz0h1+kj26EIJEzThv/l4dxwElm1OT W6bNvYIsrs/fR7MoYnJAp+frTMiuAx3QACx8YeKDLevKtUK8VmQxRJzZ7f6dFSNm qtucCnfDyawIomnoRFbWLvA88RoK8gEZ3sYytXb97qB2D0oLkCu3aX6LkaDzFVR5 LrZwtY8gFzSueGEIaxdxZjgEcHMeyXeq3b6MXvxSBGd0QQ0F15ZpDxhBI4jjEI0= =He/W -END PGP SIGNATURE- ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ssh-add echos passphrase
On 02/21/2012 16:16, Warren Block wrote: Is anyone else seeing ssh-add echo the passphrase on a recent 8-stable? No. Are you sure that you're running the agent before you ssh-add? Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: disk access seems unitask and ant-slow
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On 02/19/2012 05:27, H wrote: Doug Barton wrote: First, please don't start a new thread by replying to an existing message and changing the subject line. That screws up threading for those of us who use threaded mail readers, and may cause your message to be ignored. On 02/18/2012 03:44, H wrote: Hi I have 9-Stable on one partition of my SATAII disk, with kde4, to be sure I compiled yesterday sources world and kernel happens that any secondary task with diskaccess is so very slow that it is inacceptable for example, compiling firefox and then trying to open an image with gimp, I am sitting here for over 5 minutes and the open image dialog still do not show the directory content ..., same with dolphin or any other diskaccess Please try compiling a custom kernel with the 4BSD scheduler instead of SCHED_ULE and see if that helps. Hi no idea what you referring to in your top post When you posted your first message you hit Reply to an existing message on the list, and then changed the subject line. Don't do that. Instead, create a new message, and paste the address of the list into your new message. but since we are both newcomers here Um ... I'm not exactly a newcomer. :) we're still learning and skip it ok :) No, if you're still learning this is something you actually *need* to learn. When you hijack someone else's thread your message shows up under the old thread for anyone using a properly threaded mail reader (which is most of the people on this list). That's bad for the list because what you're talking about is a new topic, and should be treated as such both in the ongoing discussion and in the archives. It's also bad for *you* because anyone who's ignoring that old thread is not going to see your new message. now, 4FBSD really changed for me the face of the system, generally, I have much better response, thank you for the hint, it is ok now I'm glad to hear that. can you tell if it is worth checking this out on amd64 servers also? Yes. but seems that the principal delay came as present from a pkg maintainer who dares piping ... Please keep your language on our public lists family-friendly. Thanks, Doug - -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.18 (FreeBSD) iQEcBAEBCAAGBQJPQXuoAAoJEFzGhvEaGryEt18IAIb4npCHz/fqpyZS86ZNr55K INscFNcpnXoKiG5M2ruAqohh5ykflNfyuEM6sV1OXcOIqAbM6N6TBeNcMeh2nkI4 Xd8rwtB+CXENGlufkoYlydLbmC/IGSvz5+RNOfWPSCKiWYbJjNDxoR3ReQM9qk7I B491KhWmpFWvODG94+vyTLHQXHv5EKXqOkJoiwU4NS+uKF7J+WSxqmSBGwNqzEoB 4z7d0KuxkbPO3GlKZMqE3IzSGzbfCzVB7i6MzyyedjKvBsh9nfIz6TE3e7+F2YRH XJGKCtLVi7XU2e0RahtCWWUVY1q8ncG80z3BdAfJGwslaQ49Kpq+seCRpcQi4m4= =JiCq -END PGP SIGNATURE- ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: disk access seems unitask and ant-slow
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 First, please don't start a new thread by replying to an existing message and changing the subject line. That screws up threading for those of us who use threaded mail readers, and may cause your message to be ignored. On 02/18/2012 03:44, H wrote: Hi I have 9-Stable on one partition of my SATAII disk, with kde4, to be sure I compiled yesterday sources world and kernel happens that any secondary task with diskaccess is so very slow that it is inacceptable for example, compiling firefox and then trying to open an image with gimp, I am sitting here for over 5 minutes and the open image dialog still do not show the directory content ..., same with dolphin or any other diskaccess Please try compiling a custom kernel with the 4BSD scheduler instead of SCHED_ULE and see if that helps. hth, Doug - -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.18 (FreeBSD) iQEcBAEBCAAGBQJPQCMdAAoJEFzGhvEaGryEoPoH/3v1oqE/sVAbBrJkV+Tz4+N/ ugaDUIjwUR+IYC1TlSx1p1pHk8qJ9u1F9FLViNeHwXGQIaH+7wb94JrT6piUalu2 yj1EAcNZmcQrC+WJIhe+9osuSaAjm83ut0d6Y4Ad4XUDT2JGs92Z/uQ7Jf9ZF6ws 2ZwXOptm7JibHuNSnTSmAyzxEH4vkp9SgnOPTmT032fOZqaFr5v76dVSiLXCSkln /atV6zngEJexQMb7chEcIY5OhT8gyHVwQN6avThMr8C7grQAnTXaHfKN/QuK2uqM AZPe3DZTggHXrabrWC10/nncDNr1/hklbrsER2rXo1rVjs7b/jQPqfYjcu9fSH0= =VR4/ -END PGP SIGNATURE- ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Why won't 8.2 umount -f?
On 02/14/2012 08:39, Rick Macklem wrote: I took a look and they seem to have been MFC'd. That's awesome! Thanks for your time on this. I guess we've got some upgrading to do. Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Why won't 8.2 umount -f?
Is there some magic I'm missing to convince an 8.2 system to umount -f? I had an NFS server crash, so I'm trying to get the mounts updated. All of the 7.x systems happily did 'umount -f', but the 8.x systems (mostly 8.2-pN) are just hanging forever. Is this a bug, or is it something I'm missing? Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Why won't 8.2 umount -f?
On 02/13/2012 13:02, Doug Barton wrote: Is there some magic I'm missing to convince an 8.2 system to umount -f? I had an NFS server crash, so I'm trying to get the mounts updated. All of the 7.x systems happily did 'umount -f', but the 8.x systems (mostly 8.2-pN) are just hanging forever. ... and it gets worse. I just 'shutdown -r now'ed one of my less-critical 8.2 systems, and it hung for several minutes after All buffers synced. After a power cycle it came back, but the buffers weren't actually synced because it's still fsck'ing some pretty large file systems. What the heck? -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Why won't 8.2 umount -f?
On 02/13/2012 18:23, Rick Macklem wrote: Doug Barton wrote: Is there some magic I'm missing to convince an 8.2 system to umount -f? I had an NFS server crash, so I'm trying to get the mounts updated. All of the 7.x systems happily did 'umount -f', but the 8.x systems (mostly 8.2-pN) are just hanging forever. Is this a bug, or is it something I'm missing? Well, I didn't realize that a 7.n system would umount -f an NFS mount when the server was down and there were dirty blocks that needed to be written back, but I don't know. I'm doubtful that any of those systems had dirty blocks. (I seem to recall that someone encouraged me to MFC one of my changes related to this back to stable/7, but I'm not sure if it mattered?) Please don't unless you can verify that it doesn't make this situation worse. :) I have pretty well fixed the new client w.r.t. this except for the case where you do a umount path and that gets hung. Once a non -f umount gets hung, there is nothing you can do, because the mount point is locked up, so a subsequent umount -f can't get as far as nfs_umount(). I'm aware of this issue, and I did 'umount -f' first. But I wonder if this isn't something that should be fixed because I think most users would expect that 'umount - umount -f' would be the natural progression, similar to 'kill - kill -9'. My guess is that the old (default for 8.n) client isn't fixed for this. If you grep MNTK_UNMOUNTF in the sources, you'll see it used some in the old/regular client, but not as much as the new one. You also need a fairly recent (can't remember if that is in 8.2) version of umount.c, since the code had a sync(); at the beginning of it that would hang before even getting to the umount(2) syscall. Bottom line, I think the newnfs client (the default for 9.0) can do this, but I'm doubtful the old/reguler one can. (I also wouldn't be surprised if there is still a bug other than the above mentioned one w.r.t. doing a umount /mnt and getting that hung before trying umount -f /mnt. Is the new client in 8-stable up to date relevant to 9.0, and/or is it considered safe to use in production? Thanks, Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Why won't 8.2 umount -f?
On 02/13/2012 19:13, Rick Macklem wrote: I just looked and at least some of the fixes were MFC'd to stable/8 about 8months ago. So, they aren't in 8.2, but will be in 8.3. Well 8.3 is about to enter code freeze, any way we can check to be sure all of the relevant fixes can be mfc'ed? Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Reducing the need to compile a custom kernel
On 02/10/2012 12:13, Adrian Chadd wrote: I've done this a few times. The /boot/loader takes a _long_ time to suck in the 25 odd modules my eeepc requires to load a completely modular kernel. For those modules not directly related to booting you're better off putting them in kld_list in rc.conf. It's available already in 9, and in [78]-stable. hth, Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 9-stable from i386 to amd64
On 02/10/2012 20:56, Randy Bush wrote: is there a recipe for moving from i386 to amd64? Other than backup and reinstall, no. As you already discovered the old world won't run on the new kernel. Installing the new world before reboot isn't safe either, as at some point in the process it'll blow up. Sorry, Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 9-stable from i386 to amd64
Sorry, I wasn't clear. There are various hacky solutions that you can use if you're safely within shouting distance of the system. But Randy specified very remote, thus the answer to his question is no. Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: [releng_8_2 tinderbox] failure on powerpc/powerpc
On 02/03/2012 05:34, John Baldwin wrote: On Thursday, February 02, 2012 7:17:14 pm George Mitchell wrote: On 02/02/12 15:37, FreeBSD Tinderbox wrote: [... one of three errors it's been reporting repeatedly for days ...] Talk about a lack of focus! Apparently two or three people have all recently checked in code without first verifying that it compiled (let alone ran), or else possibly did not completely commit their changes, and then absconded to a place where they fail to receive these emails about the problems. Can someone please either diagnose these errors or else revert the deficient commits? -- George Mitchell No, it is more that the tinderbox for 8 wasn't actually checking these kernels before (they have been broken since 8.1 and 8.2 were released) and they are on less-used platforms. Shouldn't whoever asked for that to be enabled take responsibility for cleaning them up then? I do agree it needs to be cleaned up one way or another. Given the reticence to commit changes to release branches, They're already broken. It's hard to see how fixing the problems could make things worse. :) Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 8.2-stable: devd fails to restart
On 02/02/2012 21:34, Sergey Kandaurov wrote: On 3 February 2012 00:22, Torfinn Ingolfsen torfinn.ingolf...@broadpark.no wrote: Hi, I thought this bug was fixed back in 2009? root@kg-v7# uname -a FreeBSD kg-v7.kg4.no 8.2-STABLE FreeBSD 8.2-STABLE #7: Sat Jul 9 23:00:31 CEST 2011 r...@kg-v7.kg4.no:/usr/obj/usr/src/sys/GENERIC amd64 root@kg-v7# root@kg-v7# service devd status devd is running as pid 555. root@kg-v7# service devd restart Stopping devd. Starting devd. devd: devd already running, pid: 555 /etc/rc.d/devd: WARNING: failed to start devd root@kg-v7# service devd status devd is not running. What gives? Please apply this patch and report how it goes for you. http://www.freebsd.org/cgi/cvsweb.cgi/src/etc/rc.d/devd.diff?r1=1.12;r2=1.13 This is not in 8-STABLE yet. Actually all the OP needs to do is to make sure the src tree is up to date and run mergemaster. I MFC'ed the relevant changes to rc.d/devd last April. Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 8.2-stable: devd fails to restart
On 02/02/2012 13:45, Jeremy Chadwick wrote: On Thu, Feb 02, 2012 at 09:22:22PM +0100, Torfinn Ingolfsen wrote: Hi, I thought this bug was fixed back in 2009? root@kg-v7# uname -a FreeBSD kg-v7.kg4.no 8.2-STABLE FreeBSD 8.2-STABLE #7: Sat Jul 9 23:00:31 CEST 2011 r...@kg-v7.kg4.no:/usr/obj/usr/src/sys/GENERIC amd64 root@kg-v7# root@kg-v7# service devd status devd is running as pid 555. root@kg-v7# service devd restart Stopping devd. Starting devd. devd: devd already running, pid: 555 /etc/rc.d/devd: WARNING: failed to start devd root@kg-v7# service devd status devd is not running. What gives? This is probably what gives, as it's a common problem with all sorts of daemons and is not specific to devd in the least: - devd is running (pid 555) - Admin issues service devd restart -- devd is sent SIGTERM; devd internally starts shutting down, but is not fully dead yet. kill does not block (wait) for processes to end, obviously No, but wait_for_pids() does. The OP's /etc is out of date. -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 8.2-stable: devd fails to restart
On 02/02/2012 22:54, Jeremy Chadwick wrote: Hmm, mine dated April, for RELENG_8 tag, doesn't appear to use wait_for_pids. It's in rc.subr. -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Looks like a bug (or odd intended practice) in cron not honoring the PATH variable.
On 01/28/2012 16:45, Eric Bullen wrote: /user/local/bin -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: not overwriting files in /usr/share/skel
Sorry it's taken so long to get back to you about this. On 01/20/2012 06:50, Miroslav Lachman wrote: Files in /usr/share/skel are used as example . (dot) files for new accounts, when new user is added by adduser command. We have some local modifications in those files, like another umask and so on. You would probably be better off putting these kinds of local modifications in /etc/login.conf. The files are overwritten on each installworld. Is there any option to not overwrite files in /usr/share/skel or install/upgrade them with mergemaster instead? No such option exists, sorry. Or should we use some other directory and use adduser.conf instead? That would be another suitable alternative for you, yes. PS: I am CCing you Doug, because I think you are the most competent person in this area I'm flattered. :) And once again, sorry for the delay. hth, Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: kernel: panic: softdep_sync_buf: Unknown type jnewblk
On 01/26/2012 16:40, António Trindade wrote: Cheers. I recently updated my system to FreeBSD-9.0 and activated softupdate journaling for a number of file systems (name /home, /var, /usr). Since then I have been experiencing kernel panics: kernel: panic: softdep_sync_buf: Unknown type jnewblk Yesterday, Jan 26th, I got 6 (six) automatic reboots due to these kernel panics. I have now disabled softupdates journaling in the hope that the panics disappear. I am sorry for not providing more information about the panic, but I'll gladly try to gather more info if instructed how to. Make sure that dumpdev is defined in rc.conf. Usually you want to use your swap device. You should also boot into single user mode and do 'fsck -y' to make sure that the file systems are actually clean. There have been problems reported where SU+J doesn't recover fully after a crash, which leads to the kinds of instability you're reporting. hth, Doug -- It's always a long day; 86400 doesn't fit into a short. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: GENERIC make buildkernel error / fails - posix_fadvise
On 01/22/2012 11:00, clift...@volcano.org wrote:
On 12.01.2012 15:52, Doug Barton wrote:
chflags -R noschg /usr/obj/usr
rm -rf /usr/obj/usr
It's much faster to do:
/bin/rm -rf ${obj}/* 2 /dev/null || /bin/chflags -R 0 ${obj}/*
/bin/rm -rf ${obj}/*
If I could just add one thing here, for those who might be tempted
to immediately cut and paste that elegant command line:
Consider, how does that command evaluate if the shell variable obj
is not set, and you're running that literal string as root?
It wasn't intended that anyone actually do what you're considering. I
assumed that our users are smart enough to know that they have to
substitute the actual value of /usr/obj.
Doug
--
It's always a long day; 86400 doesn't fit into a short.
Breadth of IT experience, and depth of knowledge in the DNS.
Yours for the right price. :) http://SupersetSolutions.com/
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FYI: 9.0-RELEASE announced...
On 01/14/2012 01:39, Claude Buisson wrote: And can we say that 9.0-RELEASE is the first FreeBSD release not including the release documentation on the distribution media ? There are a variety of things that could be improved about the release note generation process, however the actual process of doing the release takes a non-trivial amount of time, and the fact that they are available on line coincident with the release is a plus. To have re-started the process of seeding the release files out to all the mirrors (or holding it for the release docs in the first place) would have further delayed a long-overdue delivery. The release engineers made the best decision they could under the circumstances. On an another topic, as the author of PR 162190, I am afraid that this release, as built, is not able to play audio CDs with popular applications like VLC: the needed commit (r230014) has been done by mav@ in stable/9 on Jan 12. Yep, that's a known issue, and as you point out, the solution is already available. Doug -- You can observe a lot just by watching. -- Yogi Berra Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 9 recompile ports
On 01/13/2012 01:52, George Kontostanos wrote: On Thu, Jan 12, 2012 at 8:42 PM, George Kontostanos gkontos.m...@gmail.com wrote: Greetings all and my apologies for cross posting! There seems to be a confusion regarding the ABI change in FreeBSD 9 and if this affects the usual upgrade path which includes a full port rebuild. The relevant post is here: http://forums.freebsd.org/showthread.php?t=28831 Frankly, I am also confused because I remember a relevant discussion a few months ago in the lists. Traditionally a major RELEASE upgrade requires a full ports rebuild, however this time there is no COMPAT_FREEBSD8 in GENERIC and most upgraded systems seem to be working fine. On the other hand this is stated in UPDATING: 20110828: Bump the shared library version numbers for libraries that do not use symbol versioning, have changed the ABI compared to stable/8 and which shared library version was not bumped. Done as part of 9.0-RELEASE cycle. Your input would be appreciated! Hmm, anyone :) ? If your question is, Do I need to rebuild my ports when doing a major OS version upgrade? the answer is always Yes. The method described at the end of the portmaster man page is preferred, whether you actually use portmaster to do the upgrade or not. (I.e., good backups, delete everything, start over from scratch.) hth, Doug -- You can observe a lot just by watching. -- Yogi Berra Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 9 recompile ports
On 01/13/2012 02:06, Volodymyr Kostyrko wrote: Why can't it be that only shared libraries should be bumped, but no kernel incompatible changes were introduced? Because one of the reasons we have major branches is so that we can change the various API/KPI/etc. in the newer branch. Doug -- You can observe a lot just by watching. -- Yogi Berra Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 9 recompile ports
On 01/13/2012 03:56, George Kontostanos wrote: On Fri, Jan 13, 2012 at 12:55 PM, Andriy Gapon a...@freebsd.org wrote: on 13/01/2012 11:59 Doug Barton said the following: On 01/13/2012 01:52, George Kontostanos wrote: On Thu, Jan 12, 2012 at 8:42 PM, George Kontostanos gkontos.m...@gmail.com wrote: Greetings all and my apologies for cross posting! There seems to be a confusion regarding the ABI change in FreeBSD 9 and if this affects the usual upgrade path which includes a full port rebuild. The relevant post is here: http://forums.freebsd.org/showthread.php?t=28831 Frankly, I am also confused because I remember a relevant discussion a few months ago in the lists. Traditionally a major RELEASE upgrade requires a full ports rebuild, however this time there is no COMPAT_FREEBSD8 in GENERIC and most upgraded systems seem to be working fine. On the other hand this is stated in UPDATING: 20110828: Bump the shared library version numbers for libraries that do not use symbol versioning, have changed the ABI compared to stable/8 and which shared library version was not bumped. Done as part of 9.0-RELEASE cycle. Your input would be appreciated! Hmm, anyone :) ? If your question is, Do I need to rebuild my ports when doing a major OS version upgrade? the answer is always Yes. The method described at the end of the portmaster man page is preferred, whether you actually use portmaster to do the upgrade or not. (I.e., good backups, delete everything, start over from scratch.) I think that another part of the question was why there is no COMPAT_FREEBSD8 kernel option in 9? and I think that Volodymyr has tried to answer this part with another question. -- Andriy Gapon Hi guys, I am aware of the proper procedure which requires a full rebuild after a major upgrade. Doug, the question had to to with COMPAT_FREEBSD8 missing from GENERIC. It seems this and the fact that some upgrades from 8.2-STABLE worked fine without a recompile, has created the confusion. Well clearly there is something about this that I don't understand. :) If you have a sufficiently small number of ports, sure it's possible that you *might* not have to recompile. However if you're talking about a desktop system with X I guarantee you that if you clean out all the old stuff in the base after doing a major version upgrade then there are things in /usr/local/ that are linked against libs that no longer exist. How much that affects you is a YMMV of course. Meanwhile my larger point was that it doesn't matter whether COMPAT_FREEBSD8 exists or not, whether some upgrades appear to work or not, etc. When you do a major version upgrade your safest bet is wipe out your old stuff and start over from scratch. You'll waste more time trying to find ways around doing that than you would spend just doing it. :) Doug -- You can observe a lot just by watching. -- Yogi Berra Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: GENERIC make buildkernel error / fails - posix_fadvise
chflags -R noschg /usr/obj/usr
rm -rf /usr/obj/usr
It's much faster to do:
/bin/rm -rf ${obj}/* 2 /dev/null || /bin/chflags -R 0 ${obj}/*
/bin/rm -rf ${obj}/*
--
You can observe a lot just by watching. -- Yogi Berra
Breadth of IT experience, and depth of knowledge in the DNS.
Yours for the right price. :) http://SupersetSolutions.com/
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: GENERIC make buildkernel error / fails - posix_fadvise
On 01/12/2012 20:10, Garrett Cooper wrote: When I did stuff in parallel (have 8 regular cores, 8 SMT cores), the process took less than an hour to complete. Sounds like you should get to work figuring out how to optimize rm to take advantage of this. :) Doug -- You can observe a lot just by watching. -- Yogi Berra Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: DNSSec on FreeBSD 9.0-RELEASE causes CPU 100%
On 01/04/2012 16:24, George Kontostanos wrote:
Greetings everyone,
I was testing DNSSec resolution on BIND 9.8.1-P1 by adding the
following options:
options {
...
dnssec-enable yes;
dnssec-validation auto;
...
};
Unfortunately immediately after named is restarted one CPU reaches
100% utilization.
There are an enormous number of possible reasons for this. Most common
is that you have a misconfigured firewall in the path that is not
passing DNSSEC-sized packets (which are generally quite a bit larger
than regular DNS due to the signatures).
The first 2 things you need to do are to crank up BIND logging (the
details are in the BIND docs, particularly the ARM); and to check
whether or not your network is properly configured. There are a number
of sites to do the latter, check the following for example:
https://www.dns-oarc.net/oarc/services/replysizetest
If you still need help after these 2 steps, your best bet is
bind-us...@isc.org.
Good luck,
Doug
--
You can observe a lot just by watching. -- Yogi Berra
Breadth of IT experience, and depth of knowledge in the DNS.
Yours for the right price. :) http://SupersetSolutions.com/
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: accepting rtadv broken on 9-STABLE, re driver?
Looping in hrs@ because he's the author of those changes. On 01/06/2012 11:35, Mark Felder wrote: On Fri, 06 Jan 2012 12:49:45 -0600, Sergey Kandaurov pluk...@gmail.com wrote: You mean ipv6_activate_all_interfaces=YES ? Yes... Unfortunately that's what I get for typing it manually and being distracted at the time. :-) What is in your rc.conf? Do you have inet6 accept_rtadv keyword in it? IIRC it should be enough to specify ifconfig_re0_ipv6=inet6 accept_rtadv without additional tweaks. Consult with rc.conf(5). I figured I would end up putting that in rc.conf as a temporary fix, but maybe that's just the long term solution. It seems so odd to me that the sysctl change doesn't automatically cause the ACCEPT_RTADV option to show up for re0, but it does for vboxnet0. Perhaps there should be a cleaner way to do this in rc.conf like how we do ifconfig_re0=DHCP ? -- You can observe a lot just by watching. -- Yogi Berra Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: SCHED_ULE should not be the default
On 12/22/2011 16:23, Adrian Chadd wrote: You've done something that noone else has actually done - provided actual results from real-life testing, rather than a hundred posts of I remember seeing X, so I don't use ULE. Not to take away from Steve's excellent work on this, but I actually spent weeks following detailed instructions from various people using ktr, dtrace, etc. and was never able to produce any data that helped point anyone to something that could be fixed. I'm pretty sure that others have tried as well. That said, I'm glad that Steve was able to produce useful results, and hopefully it will lead to improvements. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Is the svn2cvs gateway down ?
On 12/20/2011 02:01, Claude Buisson wrote: Hi, It seems (from my own csup's and cvswe.cgi) that the src commits are lost, starting with r228697 Sun Dec 18 22:04:55 2011) Yeah, my warning 2 days ago that this was going to happen seems to have gone un-heeded. :) I'm sure you can take bz' word that it's being looked at now though. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: switching schedulers (Re: SCHED_ULE should not be the default)
On 12/16/2011 12:53, Adrian Chadd wrote: Hi all, Can someone load a kernel module dynamically at boot-time? Ie, instead of compiling it in, can 4bsd/ule be loaded as a KLD at boot-time, so the user can just change by rebooting? That may be an acceptable solution for now. That, or a loader.conf tunable (which in the case of making them modules would basically amount to the same thing, right?). I've heard several really smart people with rather convincing explanations of why ULE is not the right choice for default for 2 cores or less. If we could ship one kernel with both schedulers available it should be simple to modify the installer to choose the right one and put the right stuff in loader.conf. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: switching schedulers (Re: SCHED_ULE should not be the default)
On 12/16/2011 13:40, Michel Talon wrote: Adrian Chadd said: Hi all, Can someone load a kernel module dynamically at boot-time? Ie, instead of compiling it in, can 4bsd/ule be loaded as a KLD at boot-time, so the user can just change by rebooting? That may be an acceptable solution for now. As Luigi explained, the problem is not to have code for both schedulers residing in the kernel, the problem is to migrate processes from one scheduler to the other. I think dynamically switching schedulers on a running system and loading one or the other at boot time are different problems, are they not? Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: switching schedulers (Re: SCHED_ULE should not be the default)
On 12/16/2011 14:16, Michel Talon wrote: Of course, you are perfectly right., and i had misunderstood Adrian's post. Happens to the best of us. :) But if the problem is only to change scheduler by rebooting, i think it is no more expensive to compile a kernel with the other scheduler. Or is it that people never compile kernels nowadays? That's part of it. For my money the other 2 big problems are first that we'd like to make it as easy on the 'make release' and installer processes as possible. I imagine (although I would not object to being proven wrong) that 1 kernel with knobs is easier to manage and less resource intensive than 2 kernels that differ only by this 1 feature. The other big problem is freebsd-update. While I assume that logic could be built into the system to handle this issue, if the guts can be built into the kernel itself why not do that instead? Of lesser, but not insignificant consideration is the possibility that at some point we'll have more than 2 scheduler options. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: switching schedulers (Re: SCHED_ULE should not be the default)
On 12/16/2011 14:59, Luigi Rizzo wrote: It really looks much easier than i thought initially. Awesome! -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 7-STABLE: mergemaster tzsetup question
On 12/03/2011 07:24, Christian Weisgerber wrote: Every time I run mergemaster(8) on 7.4-STABLE, I'm now presented with *** There is no /var/db/zoneinfo file to update /etc/localtime. You should run tzsetup Running tzsetup(8) does however not create /var/db/zoneinfo, so mergemaster will prompt the next time, too. I guess I can just ignore it, but it seems weird that mergemaster would keep nagging about this. Where is /var/db/zoneinfo supposed to come from? I also notice that mergemaster can issue tzsetup arguments -C and -r, but tzsetup doesn't support those. Once again, my apologies for assuming that my esteemed colleagues had done the responsible thing and MFC'ed their own work. I have resolved this issue by going back and doing 3 1/2 years of MFCs for tzsetup(8), which now makes it identical to the code in stable/8. If you update your src tree and then update tzsetup you should no longer experience this problem. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
swi4: clock taking 40% cpu?!?
Howdy,
Web server under heavy'ish load (7 on a 2 cpu system) running
8.2-RELEASE-p4 i386 I'm seeing this:
PID USERNAME PRI NICE SIZERES STATE C TIME WCPU COMMAND
12 root -32- 0K 112K WAIT0 129:01 39.99% {swi4: clock}
Any ideas why the clock should be taking so much cpu? HZ=100 if that
makes a difference ...
Doug
--
[^L]
Breadth of IT experience, and depth of knowledge in the DNS.
Yours for the right price. :) http://SupersetSolutions.com/
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: kernel: negative sbsize for uid = 0
On 12/14/2011 11:46, Dan Nelson wrote: In the last episode (Dec 13), Doug Barton said: I'm running 8.2-RELEASE-p4 i386 on some web servers that are generally lightly-moderately loaded, but occasionally see some heavy spikes where load average goes way up. When that is happening, but sometimes even when it's not, I get hundreds of this message spewing into the logs: kernel: negative sbsize for uid = 0 I haven't found anything particularly useful by searching for that message, the one reference was to mbufs, but that seems not to be the problem. Here is the output of 'netstat -m' during one of the load spikes: [...] So is this message something to worry about? If so, how can I diagnose what's happening, and how do I fix it? I've seen it ocassionally too. The error message is printed in /sys/kern/kern_resource.c when the ui_sbsize resource counter goes negative. There's probably insufficient locking somewhere in the functions that call chgsbsize. The increment/decrement is done atomically, but the data pointed to by the hiwat argument is read then updated later without an explicit lock, so if that value changes while the function is executing, it could cause problems. ui_sbsize is only used by the resource limiting code, though, so unless you're enforcing an sbsize rlimit, it should be harmless. Thanks for the response ... I'll double-check were we might be setting that kind of limit. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
kernel: negative sbsize for uid = 0
I'm running 8.2-RELEASE-p4 i386 on some web servers that are generally lightly-moderately loaded, but occasionally see some heavy spikes where load average goes way up. When that is happening, but sometimes even when it's not, I get hundreds of this message spewing into the logs: kernel: negative sbsize for uid = 0 I haven't found anything particularly useful by searching for that message, the one reference was to mbufs, but that seems not to be the problem. Here is the output of 'netstat -m' during one of the load spikes: 598/1712/2310 mbufs in use (current/cache/total) 559/1533/2092/32768 mbuf clusters in use (current/cache/total/max) 559/1105 mbuf+clusters out of packet secondary zone in use (current/cache) 0/528/528/16384 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/8192 9k jumbo clusters in use (current/cache/total/max) 0/0/0/4096 16k jumbo clusters in use (current/cache/total/max) 1267K/5606K/6873K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0/2239/6656 sfbufs in use (current/peak/max) 0 requests for sfbufs denied 0 requests for sfbufs delayed 809790 requests for I/O initiated by sendfile 0 calls to protocol drain routines So is this message something to worry about? If so, how can I diagnose what's happening, and how do I fix it? Doug ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 7-STABLE: mergemaster tzsetup question
On 12/04/2011 12:51, Doug Barton wrote: On 12/3/2011 6:00 PM, Edwin Groothuis wrote: On 04/12/2011, at 11:12 , Doug Barton wrote: On 12/3/2011 8:14 AM, Max Khon wrote: Christian, On Sat, Dec 3, 2011 at 10:24 PM, Christian Weisgerber na...@mips.inka.de wrote: Every time I run mergemaster(8) on 7.4-STABLE, I'm now presented with *** There is no /var/db/zoneinfo file to update /etc/localtime. You should run tzsetup Running tzsetup(8) does however not create /var/db/zoneinfo, so mergemaster will prompt the next time, too. I guess I can just ignore it, but it seems weird that mergemaster would keep nagging about this. Where is /var/db/zoneinfo supposed to come from? I also notice that mergemaster can issue tzsetup arguments -C and -r, but tzsetup doesn't support those. tzsetup in FreeBSD 8 and later creates /var/db/zoneinfo. It seems that mergemaster was merged to RELENG_7 but appropiate version of tzsetup was not. Well that's embarrassing. :) Edwin, what are the chances that you could MFC your changes to tzsetup? If you still have a machine running 7.x (which I don't have anymore), then go for it and do your damage :-) Well I was kind of hoping you'd be responsible for doing your own work. :) (You see, I'm kind of tired of doing other people's MFCs.) You can use ref7.freebsd.org if you need a test platform. Edwin, I haven't seen a response from you on this, apologies if you sent one and I missed it. Can you let me know your plans? Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: SCHED_ULE should not be the default
On 12/13/2011 13:31, Malin Randstrom wrote: stop sending me spam mail ... you never stop despite me having unsubscribeb several times. stop this! If you had actually unsubscribed, the mail would have stopped. :) You can see the instructions you need to follow below. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: SCHED_ULE should not be the default
On 12/12/2011 05:47, O. Hartmann wrote: Do we have any proof at hand for such cases where SCHED_ULE performs much better than SCHED_4BSD? I complained about poor interactive performance of ULE in a desktop environment for years. I had numerous people try to help, including Jeff, with various tunables, dtrace'ing, etc. The cause of the problem was never found. I switched to 4BSD, problem gone. This is on 2 separate systems with core 2 duos. hth, Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 7-STABLE: mergemaster tzsetup question
On 12/3/2011 6:00 PM, Edwin Groothuis wrote: On 04/12/2011, at 11:12 , Doug Barton wrote: On 12/3/2011 8:14 AM, Max Khon wrote: Christian, On Sat, Dec 3, 2011 at 10:24 PM, Christian Weisgerber na...@mips.inka.de wrote: Every time I run mergemaster(8) on 7.4-STABLE, I'm now presented with *** There is no /var/db/zoneinfo file to update /etc/localtime. You should run tzsetup Running tzsetup(8) does however not create /var/db/zoneinfo, so mergemaster will prompt the next time, too. I guess I can just ignore it, but it seems weird that mergemaster would keep nagging about this. Where is /var/db/zoneinfo supposed to come from? I also notice that mergemaster can issue tzsetup arguments -C and -r, but tzsetup doesn't support those. tzsetup in FreeBSD 8 and later creates /var/db/zoneinfo. It seems that mergemaster was merged to RELENG_7 but appropiate version of tzsetup was not. Well that's embarrassing. :) Edwin, what are the chances that you could MFC your changes to tzsetup? If you still have a machine running 7.x (which I don't have anymore), then go for it and do your damage :-) Well I was kind of hoping you'd be responsible for doing your own work. :) (You see, I'm kind of tired of doing other people's MFCs.) You can use ref7.freebsd.org if you need a test platform. -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 7-STABLE: mergemaster tzsetup question
On 12/3/2011 8:14 AM, Max Khon wrote: Christian, On Sat, Dec 3, 2011 at 10:24 PM, Christian Weisgerber na...@mips.inka.de wrote: Every time I run mergemaster(8) on 7.4-STABLE, I'm now presented with *** There is no /var/db/zoneinfo file to update /etc/localtime. You should run tzsetup Running tzsetup(8) does however not create /var/db/zoneinfo, so mergemaster will prompt the next time, too. I guess I can just ignore it, but it seems weird that mergemaster would keep nagging about this. Where is /var/db/zoneinfo supposed to come from? I also notice that mergemaster can issue tzsetup arguments -C and -r, but tzsetup doesn't support those. tzsetup in FreeBSD 8 and later creates /var/db/zoneinfo. It seems that mergemaster was merged to RELENG_7 but appropiate version of tzsetup was not. Well that's embarrassing. :) Edwin, what are the chances that you could MFC your changes to tzsetup? Doug -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 7-STABLE: mergemaster tzsetup question
On 12/3/2011 8:16 AM, David Wolfskill wrote: For machines that run UTC, it's not needed. FYI, the code in mergemaster checks for that. -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/17/2011 02:57, Kostik Belousov wrote: It's not catching there though: Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) c Continuing. no thread to satisfy query 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) info threads Cannot get thread info: invalid key (gdb) Err, the other part of my message was that you shall set the breakpoint on sigprocmask. I'm sorry I'm not making myself clear. We are setting the breakpoint on sigprocmask. But, maybe I'm doing it wrong. Can you give precise instructions as to what you want me to do, from the beginning? Sorry to be so dense. I want to see a backtrace from the breakpoint hit. Several times. Me too. :) Meanwhile, in response to one of the other questions, we are using mpm_prefork. Also, the particular problem we're seeing does not appear related to fork(). The pattern of sigprocmask() calls is different from the pattern you see with fork(). Doug -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/18/2011 01:19, Kostik Belousov wrote: On Fri, Nov 18, 2011 at 12:00:57AM -0800, Doug Barton wrote: On 11/17/2011 02:57, Kostik Belousov wrote: It's not catching there though: Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) c Continuing. no thread to satisfy query 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) info threads Cannot get thread info: invalid key (gdb) Err, the other part of my message was that you shall set the breakpoint on sigprocmask. I'm sorry I'm not making myself clear. We are setting the breakpoint on sigprocmask. But, maybe I'm doing it wrong. Can you give precise instructions as to what you want me to do, from the beginning? Sorry to be so dense. Find the pid of the process issuing excessive number of sigprocmask calls. Do $ gdb /usr/local/bin/httpd (gdb) attach pid (gdb) b _sigprocmask (gdb) c Bah ! Breakpoint fired. (gdb) bt (gdb) c ... Repeat ... Right, so we're on the same page at least. I've been abbreviating the output of gdb to make it easier to see the problem, but here is a (nearly) complete transcript: gdb /usr/local/bin/httpd Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type show copying to see the conditions. There is absolutely no warranty for GDB. Type show warranty for details. This GDB was configured as i386-marcel-freebsd... (gdb) attach 1380 Attaching to program: /usr/local/bin/httpd, process 1380 Reading symbols from (lots of symbol-reading snipped) 3 RSYSCALL(accept) Current language: auto; currently asm (gdb) b _sigprocmask Breakpoint 1 at 0x282d9055: file /usr/src/lib/libthr/thread/thr_sig.c, line 210. (gdb) c Continuing. no thread to satisfy query 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) c Continuing. no thread to satisfy query 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) c Continuing. no thread to satisfy query 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) etc. -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/16/2011 23:49, Kostik Belousov wrote: On Wed, Nov 16, 2011 at 10:46:27PM -0800, Doug Barton wrote: On 11/15/2011 02:09, Jeremy Chadwick wrote: On Tue, Nov 15, 2011 at 11:07:45AM +0200, Kostik Belousov wrote: On Mon, Nov 14, 2011 at 12:51:35PM -0800, Doug Barton wrote: On 11/14/2011 12:31, Doug Barton wrote: Trying to track down a load problem we're seeing on 8.2-RELEASE-p4 i386 in a busy web hosting environment I came across the following post: http://lists.freebsd.org/pipermail/freebsd-questions/2011-October/234520.html That basically describes what we're seeing as well, including the doesn't happen on Linux part. Does anyone have any ideas about this? With incredibly similar stuff running on 7.x we didn't see this problem, so it seems to be something new in 8. Just took a closer look at our ktrace, and actually our pattern is slightly different than the one in that post. In ours the second option is null, but the third is set: 74195 httpd0.17 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.12 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) But repeated hundreds of times in a row. The calls cannot come from rtld, they are generated by some setjmp() invocation. If signal-safety is not needed, sigsetjmp() should be used instead. Quick grep of the apache httpd source shows a single setjmp() in their copy of pcre. No idea is it to safe to change setjmp() into sigsetjmp(?, 0). I hate cross-posting, but: adding freebsd-apache@ to the list. Some of the Apache folks (not just port committers) may have some insight to Kostik's findings. Thanks to everyone for the responses. We tried Kostik's suggestion and unfortunately it didn't reduce the number of sigprocmask() calls to a statistically significant degree. Does anyone have any other ideas on ways to debug this? We're sort of running out of things to test. :-/ Given how important (and prevalent) the Apache + FreeBSD combination is, I'm kind of disturbed that we're seeing this performance problem, and if it's something in 8.x that's also in 9.x, it would be better to fix it prior to 9.0-RELEASE. Since my guess appeared to be not useful, Well I wouldn't say that they weren't useful, we eliminated the obvious candidate. So, not good news certainly, but not unhelpful. :) the way forward is to identify the location of the call(s) that cause the issue. I suggest compliling at least apache itself, libc, rtld and libthr (if used) with debugging information. Then, attach to the running apache worker with the gdb and set breakpoint on sigprocmask. Several backtraces from the hit breakpoint should give enough data. We tried that, and got this: Loaded symbols for /libexec/ld-elf.so.1 0x28183a5d in accept () from /lib/libc.so.7 (gdb) b sigprocmask Breakpoint 1 at 0x282d8f84 (gdb) c Continuing. no thread to satisfy query 0x28183a5d in accept () from /lib/libc.so.7 (gdb) Of course I'm not the world's greatest gdb'er, so maybe there is a better way to do it? High-tech solution is to link with libunwind and add code into sigprocmask() to gather the stacks. But I expect that gdb attach is enough. Ok, we'll look into that, thanks. Doug -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/17/2011 00:30, Daniil Cherednik wrote: I am sorry for repeat (I wrote about it), but what do you think about this hack: Danill, thanks, and sorry if I wasn't clear before, but the problem we're seeing has a very clear pattern: 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) That the rtld calls don't exhibit. Kostik, thanks for your more detailed response, we'll poke that a bit and report back. Doug -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/17/2011 00:12, Kostik Belousov wrote: On Wed, Nov 16, 2011 at 11:59:06PM -0800, Doug Barton wrote: On 11/16/2011 23:49, Kostik Belousov wrote: On Wed, Nov 16, 2011 at 10:46:27PM -0800, Doug Barton wrote: On 11/15/2011 02:09, Jeremy Chadwick wrote: On Tue, Nov 15, 2011 at 11:07:45AM +0200, Kostik Belousov wrote: On Mon, Nov 14, 2011 at 12:51:35PM -0800, Doug Barton wrote: On 11/14/2011 12:31, Doug Barton wrote: Trying to track down a load problem we're seeing on 8.2-RELEASE-p4 i386 in a busy web hosting environment I came across the following post: http://lists.freebsd.org/pipermail/freebsd-questions/2011-October/234520.html That basically describes what we're seeing as well, including the doesn't happen on Linux part. Does anyone have any ideas about this? With incredibly similar stuff running on 7.x we didn't see this problem, so it seems to be something new in 8. Just took a closer look at our ktrace, and actually our pattern is slightly different than the one in that post. In ours the second option is null, but the third is set: 74195 httpd0.17 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.12 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) But repeated hundreds of times in a row. The calls cannot come from rtld, they are generated by some setjmp() invocation. If signal-safety is not needed, sigsetjmp() should be used instead. Quick grep of the apache httpd source shows a single setjmp() in their copy of pcre. No idea is it to safe to change setjmp() into sigsetjmp(?, 0). I hate cross-posting, but: adding freebsd-apache@ to the list. Some of the Apache folks (not just port committers) may have some insight to Kostik's findings. Thanks to everyone for the responses. We tried Kostik's suggestion and unfortunately it didn't reduce the number of sigprocmask() calls to a statistically significant degree. Does anyone have any other ideas on ways to debug this? We're sort of running out of things to test. :-/ Given how important (and prevalent) the Apache + FreeBSD combination is, I'm kind of disturbed that we're seeing this performance problem, and if it's something in 8.x that's also in 9.x, it would be better to fix it prior to 9.0-RELEASE. Since my guess appeared to be not useful, Well I wouldn't say that they weren't useful, we eliminated the obvious candidate. So, not good news certainly, but not unhelpful. :) the way forward is to identify the location of the call(s) that cause the issue. I suggest compliling at least apache itself, libc, rtld and libthr (if used) with debugging information. Then, attach to the running apache worker with the gdb and Note this part. Right, we attached to a worker, that's why it's in accept(). :) It seems your libc has no debugging information. accept() is the pure syscall wrapper, it cannot call sigprocmask. If gdb catched the PLT trampoline instead of real accept(), we would see the rtld frames. So install libc, libthr and rtld with debug. It's not catching there though: Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) c Continuing. no thread to satisfy query 0x28183b2d in accept () at accept.S:3 3 RSYSCALL(accept) (gdb) info threads Cannot get thread info: invalid key (gdb) Doug -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/15/2011 02:09, Jeremy Chadwick wrote: On Tue, Nov 15, 2011 at 11:07:45AM +0200, Kostik Belousov wrote: On Mon, Nov 14, 2011 at 12:51:35PM -0800, Doug Barton wrote: On 11/14/2011 12:31, Doug Barton wrote: Trying to track down a load problem we're seeing on 8.2-RELEASE-p4 i386 in a busy web hosting environment I came across the following post: http://lists.freebsd.org/pipermail/freebsd-questions/2011-October/234520.html That basically describes what we're seeing as well, including the doesn't happen on Linux part. Does anyone have any ideas about this? With incredibly similar stuff running on 7.x we didn't see this problem, so it seems to be something new in 8. Just took a closer look at our ktrace, and actually our pattern is slightly different than the one in that post. In ours the second option is null, but the third is set: 74195 httpd0.17 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.12 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) But repeated hundreds of times in a row. The calls cannot come from rtld, they are generated by some setjmp() invocation. If signal-safety is not needed, sigsetjmp() should be used instead. Quick grep of the apache httpd source shows a single setjmp() in their copy of pcre. No idea is it to safe to change setjmp() into sigsetjmp(?, 0). I hate cross-posting, but: adding freebsd-apache@ to the list. Some of the Apache folks (not just port committers) may have some insight to Kostik's findings. Thanks to everyone for the responses. We tried Kostik's suggestion and unfortunately it didn't reduce the number of sigprocmask() calls to a statistically significant degree. Does anyone have any other ideas on ways to debug this? We're sort of running out of things to test. :-/ Given how important (and prevalent) the Apache + FreeBSD combination is, I'm kind of disturbed that we're seeing this performance problem, and if it's something in 8.x that's also in 9.x, it would be better to fix it prior to 9.0-RELEASE. Doug -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
8.2 + apache == a LOT of sigprocmask
Trying to track down a load problem we're seeing on 8.2-RELEASE-p4 i386 in a busy web hosting environment I came across the following post: http://lists.freebsd.org/pipermail/freebsd-questions/2011-October/234520.html That basically describes what we're seeing as well, including the doesn't happen on Linux part. Does anyone have any ideas about this? With incredibly similar stuff running on 7.x we didn't see this problem, so it seems to be something new in 8. -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/14/2011 12:31, Doug Barton wrote: Trying to track down a load problem we're seeing on 8.2-RELEASE-p4 i386 in a busy web hosting environment I came across the following post: http://lists.freebsd.org/pipermail/freebsd-questions/2011-October/234520.html That basically describes what we're seeing as well, including the doesn't happen on Linux part. Does anyone have any ideas about this? With incredibly similar stuff running on 7.x we didn't see this problem, so it seems to be something new in 8. Just took a closer look at our ktrace, and actually our pattern is slightly different than the one in that post. In ours the second option is null, but the third is set: 74195 httpd0.17 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.13 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) 74195 httpd0.09 RET sigprocmask 0 74195 httpd0.12 CALL sigprocmask(SIG_BLOCK,0,0xbfbf89d4) But repeated hundreds of times in a row. -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 8.2 + apache == a LOT of sigprocmask
On 11/14/2011 12:56, John Baldwin wrote: On Monday, November 14, 2011 3:31:43 pm Doug Barton wrote: Trying to track down a load problem we're seeing on 8.2-RELEASE-p4 i386 in a busy web hosting environment I came across the following post: http://lists.freebsd.org/pipermail/freebsd-questions/2011- October/234520.html That basically describes what we're seeing as well, including the doesn't happen on Linux part. Does anyone have any ideas about this? With incredibly similar stuff running on 7.x we didn't see this problem, so it seems to be something new in 8. I suspect it has to do with some of the changes to rtld such that it now always blocks signals while resolving symbols (or something along those lines IIRC). It makes throwing exceptions slow as well. The calls to sigprocmask() in rtld seem to be doing what you suggest here, but they involve setting and restoring the mask. In my followup post I pasted what we're seeing, which is different, and much more voluminous. For example, 13,500 calls in 30 seconds from a single apache worker process. Although this does seem to explain why our test cases have more calls when compiled with C++ than they do when compiled with C. :) Thanks for the response in any case. Doug -- We could put the whole Internet into a book. Too practical. Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: How to set interface description containing space in 8.x
On 10/22/2011 06:02, Jeremy Chadwick wrote: 3. Hand-hack /etc/network.subr to address this, which you will lose every time you run mergemaster I'm not sure why you'd say that. By design mergemaster checks the $FreeBSD Id string in the installed file and if it's the same as the one in the temproot then it deletes the temproot version and moves on. That behavior was primarily designed to accommodate configuration files, but it works just as well for everything else mergemaster deals with. hth, Doug -- Nothin' ever doesn't change, but nothin' changes much. -- OK Go Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: backup for /var/db/ports
On 10/14/2011 17:48, Oleg Ginzburg wrote: Hi With /etc/periodic/daily/220.backup-pkgdb I would also suggest backing up /var/db/ports dir I'm curious as to the reason for doing this. The options are easy to recreate, and not particularly dynamic. Doug ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: backup for /var/db/ports
On 10/16/2011 21:27, Eugene Grosbein wrote: 17.10.2011 10:13, Doug Barton пишет: On 10/14/2011 17:48, Oleg Ginzburg wrote: Hi With /etc/periodic/daily/220.backup-pkgdb I would also suggest backing up /var/db/ports dir I'm curious as to the reason for doing this. The options are easy to recreate, and not particularly dynamic. How do you recreate them without backup after N years passed? :-) I didn't say that they shouldn't be backed up, simply that I don't see the need to back them up every night. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 9.0-BETA3 Available...
On 10/12/2011 06:47, Ken Smith wrote: On Wed, 2011-10-12 at 14:39 +0100, Bruce Cran wrote: On 29/09/2011 02:42, Ken Smith wrote: MD5 (FreeBSD-9.0-BETA3-amd64-bootonly.iso) = 2ce7b93d28fd7ff37965893f1af3f7fc MD5 (FreeBSD-9.0-BETA3-amd64-dvd1.iso) = 4affc701f2052edc548274f090e49235 MD5 (FreeBSD-9.0-BETA3-amd64-memstick.img) = e260f2f2122326cb9a93ac83eb006c1c The -dvd1.iso files seem to be less than a CD, at 610MB. Are they expected to contain more data over time, or could 'dvd' be removed? I was planning on them having package sets. The new installer doesn't support installing packages like sysinstall had but if I provide Gnome, KDE, and perhaps a small set of other stuff it would be useful to people with crummy network connectivity. They could install the packages from the DVD instead of needing to have everything downloaded. Is there still going to be a CD-sized installer? I find this really useful both at home, and also for virtualized installs. -- Nothin' ever doesn't change, but nothin' changes much. -- OK Go Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
7.3 + kqueue + apache/php + DNS lookup problem
Howdy,
So, this is a bit of an odd one I've got a web server running
apache 2.2.17 and php 5.3.5. The host itself is running 7.3-RELEASE,
i386, and is not busy. I can do DNS queries on the command line all day
long and they are very snappy. Using nslookup, dig, whatever.
The weirdness comes in when the httpd process needs to do a DNS lookup.
With a local cache I'm getting the following:
97625 httpd0.031139 CALL connect(0x55,0x284fd590,0x10)
97625 httpd0.031142 STRU struct sockaddr { AF_INET, 127.0.0.1:53 }
97625 httpd0.031150 RET connect 0
97625 httpd0.031153 CALL sendto(0x55,0x2a7d1000,0x1e,0,0,0)
97625 httpd0.031169 GIO fd 85 wrote 30 bytes
97625 httpd0.031173 RET sendto 30/0x1e
97625 httpd0.031179 CALL clock_gettime(0,0xbfbfb58c)
97625 httpd0.031184 RET clock_gettime 0
97625 httpd0.031188 CALL
kevent(0x54,0xbfbfb678,0x1,0xbfbfb678,0x1,0xbfbfb68c)
97625 httpd3.064266 GIO fd 84 wrote 20 bytes
note the 3 second delay here.
97625 httpd3.064277 GIO fd 84 read 20 bytes
97625 httpd3.064281 RET kevent 1
97625 httpd3.064287 CALL
recvfrom(0x55,0x2a6c4000,0x1,0,0xbfbfb5f8,0xbfbfb694)
97625 httpd3.064293 GIO fd 85 read 30 bytes
97625 httpd3.064296 STRU struct sockaddr { AF_INET, 127.0.0.1:53 }
97625 httpd3.064299 RET recvfrom 30/0x1e
97625 httpd3.064308 CALL close(0x55)
I'm open to suggestions on where to look to improve this situation.
Thanks,
Doug
--
Nothin' ever doesn't change, but nothin' changes much.
-- OK Go
Breadth of IT experience, and depth of knowledge in the DNS.
Yours for the right price. :) http://SupersetSolutions.com/
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: 7.3 + kqueue + apache/php + DNS lookup problem
Thanks Jeremy and Chuck. Answers below.
On 09/30/2011 17:37, Jeremy Chadwick wrote:
On Fri, Sep 30, 2011 at 04:31:18PM -0700, Doug Barton wrote:
Howdy,
So, this is a bit of an odd one I've got a web server running
apache 2.2.17 and php 5.3.5. The host itself is running 7.3-RELEASE,
i386, and is not busy. I can do DNS queries on the command line all day
long and they are very snappy. Using nslookup, dig, whatever.
The weirdness comes in when the httpd process needs to do a DNS lookup.
With a local cache I'm getting the following:
97625 httpd0.031139 CALL connect(0x55,0x284fd590,0x10)
97625 httpd0.031142 STRU struct sockaddr { AF_INET, 127.0.0.1:53 }
97625 httpd0.031150 RET connect 0
97625 httpd0.031153 CALL sendto(0x55,0x2a7d1000,0x1e,0,0,0)
97625 httpd0.031169 GIO fd 85 wrote 30 bytes
97625 httpd0.031173 RET sendto 30/0x1e
97625 httpd0.031179 CALL clock_gettime(0,0xbfbfb58c)
97625 httpd0.031184 RET clock_gettime 0
97625 httpd0.031188 CALL
kevent(0x54,0xbfbfb678,0x1,0xbfbfb678,0x1,0xbfbfb68c)
97625 httpd3.064266 GIO fd 84 wrote 20 bytes
note the 3 second delay here.
97625 httpd3.064277 GIO fd 84 read 20 bytes
97625 httpd3.064281 RET kevent 1
97625 httpd3.064287 CALL
recvfrom(0x55,0x2a6c4000,0x1,0,0xbfbfb5f8,0xbfbfb694)
97625 httpd3.064293 GIO fd 85 read 30 bytes
97625 httpd3.064296 STRU struct sockaddr { AF_INET, 127.0.0.1:53 }
97625 httpd3.064299 RET recvfrom 30/0x1e
97625 httpd3.064308 CALL close(0x55)
I'm open to suggestions on where to look to improve this situation.
I'm not familiar with the kqueue event mechanism in BSD. I know it's
great, but I'm just not familiar with how to use it/etc.. If I'm
reading the syscall trace correctly, it looks like the daemon opens up a
socket to 127.0.0.1:53 (named) on fd 0x55/85, writes 30 bytes of data to
it, initiates a kernel event that writes 20 bytes of data to a different
descriptor 0x54/84, reads 20 bytes back from that fd, then reads 30
bytes from descriptor 0x55/85.
I wonder what the kevent() is actually accomplishing here. I wish I
could see within the kevent structs at 0xbfbfb678 and 0xbfbfb678, and
the timespec struct at 0xbfbfb68c.
There's also a part of me that remembers some sort of kevent/kqueue
problem on older FreeBSD that got fixed at one point. The problem is
that I can't remember what that problem was, nor what release fixed it.
As such I don't want to resort to a upgrade your OS! response.
That's not necessarily off the table, but doing that would have to be
because we're sure it would fix the problem.
Does this happen when httpd tries to do DNS resolution for, say, an
incoming connection to the web server (e.g. trying to resolve the
incoming IP address of the client to an FQDN), or is it happening within
some PHP code (assuming PHP is installed/used as an Apache module)
that's trying to do DNS resolution of some kind?
It's a php module doing a lookup for the hostname of the back-end mysql
server.
Are the delays always 3 seconds?
Pretty much.
If so, that almost sounds like a timeout of some kind.
That was my first thought, but the answer always comes eventually.
To answer Chuck's questions, no threading is involved, and it's not
apache doing the lookups.
Doug
--
Nothin' ever doesn't change, but nothin' changes much.
-- OK Go
Breadth of IT experience, and depth of knowledge in the DNS.
Yours for the right price. :) http://SupersetSolutions.com/
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: FreeBSD 9-Beta3 on X300 problems.
On 09/26/2011 16:02, crsnet.pl wrote: 2. Kadu/Gnu Gadu. I dont know why, but when i run kadu / gnu gadu and try to connect to Gadu-Gadu network software segments ;/ Kadu with signal 6, GnuGadu with signal 11. I try to use old gadulib, or recompie it. But this doesn't help ;/ I run portmaster -y --no-confirm --packages-if-newer -m 'BATCH=yes' -d -a The -y option is meaningless in that context, FYI. And... its works;) I'm glad to hear that at least. :) -- Nothin' ever doesn't change, but nothin' changes much. -- OK Go Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
crash on 8.2-RELEASE amd64, high-traffic squid server
Howdy, I have some high-traffic squid servers, most of which are running a flavor of RELENG_7 very successfully, but one that I've been evaluating 8.x on has had a lot of problems. Most recently we had the crash below twice in the last 2 weeks. Same exact backtrace. Any suggestions on where to look would be appreciated. Thanks, Doug #0 doadump () at pcpu.h:224 224 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump () at pcpu.h:224 #1 0x803ec4be in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:419 #2 0x803ec8f1 in panic (fmt=Variable fmt is not available. ) at /usr/src/sys/kern/kern_shutdown.c:592 #3 0x8069a4d0 in trap_fatal (frame=0x1c, eva=Variable eva is not available. ) at /usr/src/sys/amd64/amd64/trap.c:783 #4 0x8069aab9 in trap (frame=0xff800012f650) at /usr/src/sys/amd64/amd64/trap.c:592 #5 0x80682e84 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:224 #6 0x80698896 in bcopy () at /usr/src/sys/amd64/amd64/support.S:124 #7 0x8044df61 in sbcompress (sb=0xff01d98945e0, m=0xff010b815300, n=0xff006baa3700) at /usr/src/sys/kern/uipc_sockbuf.c:779 #8 0x8044e1e6 in sbappendstream_locked (sb=0xff01d98945e0, m=0xff010b815300) at /usr/src/sys/kern/uipc_sockbuf.c:534 #9 0x80527530 in tcp_do_segment (m=0xff010b815300, th=Variable th is not available. ) at /usr/src/sys/netinet/tcp_input.c:2588 #10 0x80528b4b in tcp_input (m=0xff010b815300, off0=Variable off0 is not available. ) at /usr/src/sys/netinet/tcp_input.c:1029 #11 0x804c3b2c in ip_input (m=0xff010b815300) at /usr/src/sys/netinet/ip_input.c:787 #12 0x804a631e in netisr_dispatch_src (proto=1, source=Variable source is not available. ) at /usr/src/sys/net/netisr.c:917 #13 0x8049d73d in ether_demux (ifp=0xff0002d3, m=0xff010b815300) at /usr/src/sys/net/if_ethersubr.c:894 #14 0x8049db2d in ether_input (ifp=0xff0002d3, m=0xff010b815300) at /usr/src/sys/net/if_ethersubr.c:753 #15 0x8027c18a in em_rxeof (rxr=0xff0002d7c600, count=98, done=0x0) at /usr/src/sys/dev/e1000/if_em.c:4293 #16 0x8027c5a8 in em_handle_que (context=Variable context is not available. ) at /usr/src/sys/dev/e1000/if_em.c:1482 #17 0x80429ab5 in taskqueue_run_locked (queue=0xff0002d8d800) at /usr/src/sys/kern/subr_taskqueue.c:250 #18 0x80429c4e in taskqueue_thread_loop (arg=Variable arg is not available. ) at /usr/src/sys/kern/subr_taskqueue.c:387 #19 0x803c30f8 in fork_exit ( callout=0x80429c00 taskqueue_thread_loop, arg=0xff80005a8748, frame=0xff800012fc40) at /usr/src/sys/kern/kern_fork.c:845 #20 0x8068334e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:565 #21 0x in ?? () #22 0x in ?? () #23 0x in ?? () #24 0x in ?? () #25 0x in ?? () #26 0x in ?? () #27 0x in ?? () #28 0x in ?? () #29 0x in ?? () #30 0x in ?? () #31 0x in ?? () #32 0x in ?? () #33 0x in ?? () #34 0x in ?? () #35 0x in ?? () #36 0x in ?? () #37 0x in ?? () #38 0x in ?? () #39 0x in ?? () #40 0x in ?? () #41 0x in ?? () #42 0x in ?? () #43 0x in ?? () #44 0x in ?? () #45 0x8095ac00 in affinity () #46 0x in ?? () #47 0x in ?? () #48 0xff0002d2d8c0 in ?? () #49 0xff800012f320 in ?? () #50 0xff800012f2c8 in ?? () #51 0xff0002c59000 in ?? () #52 0x80411db9 in sched_switch (td=0x80429c00, newtd=0xff80005a8748, flags=Variable flags is not available. ) at /usr/src/sys/kern/sched_ule.c:1852 Previous frame inner to this frame (corrupt stack?) (kgdb) -- Nothin' ever doesn't change, but nothin' changes much. -- OK Go Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Recent STABLE unable to start process in background
On 08/10/2011 19:51, Adam Vande More wrote: On Wed, Aug 10, 2011 at 8:22 PM, Jeremy Chadwick free...@jdc.parodius.comwrote: Looks like SIGTTOU (output from background process)? This should be controllable with stty -tostop. (But why has it changed...?) On all our RELENG_8 systems (though I use bash), -tostop is default. Hm, it seems there might be something wrong with zsh. stty -a on an old and new setup produces identical output with -tostop set. The old setup runs zsh-4.3.10_3 which works correctly, but zsh-4.3.12 doesn't work on the new. The latest bash works fine on the new. I can file a bug report on zsh, but could someone confirm that it's the likely candidate for a problem so I don't send anyone on a wild goose chase? Back up the old zsh on the working system, install the new one, test. -- Nothin' ever doesn't change, but nothin' changes much. -- OK Go Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: ZFS directory with a large number of files
On 08/05/2011 20:38, Daniel O'Connor wrote: Ahh, but OP had moved these files away and performance was still poor.. _that_ is the bug. I'm no file system expert, but it seems to me the key questions are; how long does it take the system to recover from this condition, and if it's more than N $periods is that a problem? We can't stop users from doing wacky stuff, but the system should be robust in the face of this. -- Nothin' ever doesn't change, but nothin' changes much. -- OK Go Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: gpg-agent dont start automatically
On 07/13/2011 23:42, joerg_surmann wrote: Hi all, i have in my .xinitrc: exec /usr/local/bin/gpg-agent --daemon --write-env-file .gnupg/agent.info /usr/home/holm/.gpg-agent-info Thats don't start gpg-agent. Take a look at this: http://dougbarton.us/PGP/gpg-agent.html -- Nothin' ever doesn't change, but nothin' changes much. -- OK Go Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/ ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
