FreeBSD Quarterly Status Report, July-September 2012.

2013-03-04 Thread Isabell Long
FreeBSD Quarterly Status Report, July-September 2012. Introduction This report covers FreeBSD-related projects between July and September 2012. This is the third of the four reports planned for 2012. Highlights from this quarter include successful participation in Google Summer of

FreeBSD Quarterly Status Report, October-December 2012.

2013-03-04 Thread Isabell Long
FreeBSD Quarterly Status Report, October-December 2012. Introduction This report covers FreeBSD-related projects between October and December 2012. This is the last of four reports planned for 2012. Highlights from this status report include a very successful EuroBSDCon 2012

Re: FreeBSD 9.1 - openldap slapd lockups, mutex problems

2013-03-04 Thread Pierre Guinoiseau
Hi, I've tested it in a 8.3R jail on a 9.1R host, same setup, and the problem is still there. So it may be a kernel bug on 9.1R. On 14/02/2013 10:19:45, Oliver Brandmueller o...@e-gitt.net wrote: Hi, On Thu, Feb 14, 2013 at 03:13:57AM +0100, Pierre Guinoiseau wrote: I have seen openldap

Re: Musings on ZFS Backup strategies

2013-03-04 Thread Volodymyr Kostyrko
02.03.2013 03:12, David Magda: On Mar 1, 2013, at 12:55, Volodymyr Kostyrko wrote: Yes, I'm working with backups the same way, I wrote a simple script that synchronizes two filesystems between distant servers. I also use the same script to synchronize bushy filesystems (with hundred

Re: Musings on ZFS Backup strategies

2013-03-04 Thread David Magda
On Mon, March 4, 2013 11:07, Volodymyr Kostyrko wrote: 02.03.2013 03:12, David Magda: There are quite a few scripts out there: http://www.freshports.org/search.php?query=zfs A lot of them require python or ruby, and none of them manages synchronizing snapshots over network. Yes, but I

Re: Musings on ZFS Backup strategies

2013-03-04 Thread Volodymyr Kostyrko
04.03.2013 19:04, David Magda: On Mon, March 4, 2013 11:07, Volodymyr Kostyrko wrote: 02.03.2013 03:12, David Magda: There are quite a few scripts out there: http://www.freshports.org/search.php?query=zfs A lot of them require python or ruby, and none of them manages synchronizing

Re: 9.1 minimal ram requirements

2013-03-04 Thread Kenneth D. Merry
I just checked in a change to HEAD (247814) that compiles CTL in GENERIC but disables it by default. (i.e. it uses no memory) You can re-enable it with the existing loader tunable. i.e. set kern.cam.ctl.disable=0 in /boot/loader.conf and it will be enabled. Ken On Wed, Feb 27, 2013 at

Re: GNATS now available via rsync

2013-03-04 Thread Jason Helfman
On Sun, Dec 23, 2012 at 1:51 PM, Simon L. B. Nielsen si...@freebsd.orgwrote: Hey, The GNATS database can now be mirrored using rsync from: rsync://bit0.us-west.freebsd.org/FreeBSD-bit/gnats/ I expect that URL to be permanent, at least while GNATS is still alive. At a later point there

ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Karl Denninger
Well now this is interesting. I have converted a significant number of filesystems to ZFS over the last week or so and have noted a few things. A couple of them aren't so good. The subject machine in question has 12GB of RAM and dual Xeon 5500-series processors. It also has an ARECA 1680ix in

carp on stable/9: is there a way to keep jumbo? (fwd)

2013-03-04 Thread Dmitry Morozovsky
Collegaues, sorry, sent to the wrong list (the only escuse for me is possibly that I'm trying to make HAST base on carp...) -- Sincerely, D.Marck [DM5020, MCK-RIPE, DM3-RIPN] [ FreeBSD committer: ma...@freebsd.org ]

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Steven Hartland
What does zfs-stats -a show when your having the stall issue? You can also use zfs iostats to show individual disk iostats which may help identify a single failing disk e.g. zpool iostat -v 1 Also have you investigated which of the two sysctls you changed fixed it or does it require both?

Re: carp on stable/9: is there a way to keep jumbo? (fwd)

2013-03-04 Thread Steven Hartland
You might want to try:- http://blog.multiplay.co.uk/dropzone/freebsd/carp-mtu.patch Be warned it doesn't do any validation so if you use it against physical interfaces with a smaller MTU things will likely go badly wrong, hell they may go badly wrong anyway as its just a very quick and dirty

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Dennis Glatting
I get stalls with 256GB of RAM with arc_max=64G (my limit is usually 25% ) on a 64 core system with 20 new 3TB Seagate disks under LSI2008 chips without much load. Interestingly pbzip2 consistently created a problem on a volume whereas gzip does not. Here, stalls happen across several systems

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Karl Denninger
On 3/4/2013 6:33 PM, Steven Hartland wrote: What does zfs-stats -a show when your having the stall issue? You can also use zfs iostats to show individual disk iostats which may help identify a single failing disk e.g. zpool iostat -v 1 Also have you investigated which of the two sysctls you

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Karl Denninger
Stick this in /boot/loader.conf and see if your lockups goes away: vfs.zfs.write_limit_override=102400 I've got a sentinal running that watches for zero-bandwidth zpool iostat 5s that has been running for close to 12 hours now and with the two tunables I changed it doesn't appear to be

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Steven Hartland
- Original Message - From: Karl Denninger k...@denninger.net Stick this in /boot/loader.conf and see if your lockups goes away: vfs.zfs.write_limit_override=102400 ... If it turns out that the write_limit_override tunable is the one responsible for stopping the hangs I can drop

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Karl Denninger
On 3/4/2013 9:25 PM, Steven Hartland wrote: - Original Message - From: Karl Denninger k...@denninger.net Stick this in /boot/loader.conf and see if your lockups goes away: vfs.zfs.write_limit_override=102400 ... If it turns out that the write_limit_override tunable is the one

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Dennis Glatting
On Mon, 2013-03-04 at 20:58 -0600, Karl Denninger wrote: Stick this in /boot/loader.conf and see if your lockups goes away: vfs.zfs.write_limit_override=102400 K. I've got a sentinal running that watches for zero-bandwidth zpool iostat 5s that has been running for close to 12 hours

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Dennis Glatting
On Tue, 2013-03-05 at 03:25 +, Steven Hartland wrote: - Original Message - From: Karl Denninger k...@denninger.net Stick this in /boot/loader.conf and see if your lockups goes away: vfs.zfs.write_limit_override=102400 ... If it turns out that the

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Steven Hartland
- Original Message - From: Karl Denninger k...@denninger.net Then it happened I thought the machine had wedged, but minutes (not seconds) later, everything sprung into action again. That's exactly what I can reproduce here; the stalls are anywhere from a few seconds to well north of a

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Karl Denninger
On 3/4/2013 10:01 PM, Steven Hartland wrote: - Original Message - From: Karl Denninger k...@denninger.net Then it happened I thought the machine had wedged, but minutes (not seconds) later, everything sprung into action again. That's exactly what I can reproduce here; the stalls are

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Ben Morrow
Quoth Karl Denninger k...@denninger.net: Note that the machine is not booting from ZFS -- it is booting from and has its swap on a UFS 2-drive mirror (handled by the disk adapter; looks like a single da0 drive to the OS) and that drive stalls as well when it freezes. It's definitely a

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Jeremy Chadwick
On Tue, Mar 05, 2013 at 05:05:47AM +, Ben Morrow wrote: Quoth Karl Denninger k...@denninger.net: Note that the machine is not booting from ZFS -- it is booting from and has its swap on a UFS 2-drive mirror (handled by the disk adapter; looks like a single da0 drive to the OS) and

Re: ZFS stalls -- and maybe we should be talking about defaults?

2013-03-04 Thread Garrett Wollman
In article 8c68812328e3483ba9786ef155911...@multiplay.co.uk, kill...@multiplay.co.uk writes: Now interesting you should say that I've seen a stall recently on ZFS only box running on 6 x SSD RAIDZ2. The stall was caused by fairly large mysql import, with nothing else running. Then it happened I