Re: [PATCH] VM cache policy change.
Hi! On Mon, 16 Jul 2012 22:44:33 +0200, Richard Braun wrote: > On Mon, Jul 16, 2012 at 10:30:23PM +0200, Thomas Schwinge wrote: > > I have logs for »ps -w 0 -AF hurd-long«, »vmstat«, »slabinfo« for all > > runs, directly after booting, and some time after the glibc »make check«, > > please tell me which you'd like to see; it's a lot of data already. > > Thanks for this report. And, first and foremost, thanks to you for working on this topic! One thing that comes to mind, by the way, is that the original Debian and your patched package have been built in different environments, by different compilers, so the comparison between them is not completely unbiased, but probably (hopefully!) that shouldn't affect the results very much. > The results of vmstat and slabinfo (vm_object, > thread and ipc_port lines) are what I'm mostly interested in. I suspect > there are quite a lot of them, and the performance regression probably > comes from the scalability issues previously described. As you asked on IRC, I'm simply attaching a tarball containing all the log files, also a few from an earlier 2:1.3.99.dfsg.git20120219-1 run (with older hurd* and libc0.3* packages, too, and without netdde), in case that might be interesting too. Please ask if there is anything unclear about which file is which. Also I'm happy to run further tests -- I'll leave the system in the current state. Grüße, Thomas vm_cache_policy_logs.tar.gz Description: Binary data pgpF2xsapONdC.pgp Description: PGP signature
Re: [PATCH] VM cache policy change.
On Mon, Jul 16, 2012 at 10:30:23PM +0200, Thomas Schwinge wrote: > I have logs for »ps -w 0 -AF hurd-long«, »vmstat«, »slabinfo« for all > runs, directly after booting, and some time after the glibc »make check«, > please tell me which you'd like to see; it's a lot of data already. Thanks for this report. The results of vmstat and slabinfo (vm_object, thread and ipc_port lines) are what I'm mostly interested in. I suspect there are quite a lot of them, and the performance regression probably comes from the scalability issues previously described. -- Richard Braun
Re: [PATCH] VM cache policy change.
Hi! On Tue, 10 Jul 2012 03:03:09 +0200, Richard Braun wrote: > On Mon, Jul 09, 2012 at 04:44:57PM +0200, Richard Braun wrote: > > Note that you need up-to-date versions of both GNU Mach [1] and the > > Hurd [2] to test this patch, as it needs important bug fixes to avoid > > file system crashes and kernel panics. > > Debian packages with the patch and the required bug fixes are available > at my repository : > > deb http://ftp.sceen.net/debian-hurd experimental/ > deb-src http://ftp.sceen.net/debian-hurd experimental/ > > They are currently used on the public hurd box darnassus.sceen.net. Here is what I see for my testload going from originally gnumach-image-1.3.99-486-dbg version 2:1.3.99.dfsg.git20120710-1 to your 2:1.3.99.dfsg.git20120710-1+rbraun.1 (»VM cache policy change.« from »Tue, 10 Jul 2012 19:00:46 +0200«). Unfortunately, performance regresses for me -- hopefully we can figure out why. The testload is for glibc: »make && make install && make check« after a fresh boot. 2:1.3.99.dfsg.git20120710-1 2:1.3.99.dfsg.git20120710-1+rbraun.1 make100 min 170 min make install15 min 17 min make check 54 min 81 min The baseline numbers have been stable (with minor variance) for a lot of previous builds, here confirmed for two runs, the +rbraun.1 numbers have also been essentially stable for two runs. The logs of the three steps are completely equivalent for the 2:1.3.99.dfsg.git20120710-1 and +rbraun.1 builds. The system is an AMD Athlon XP with 1466 MHz, has 1 GiB of RAM, and is running Debian GNU/Hurd unstable x86 with most packages from around 2012-02, and GNU Mach, hurd* (and netdde), libc0.3* current. I have logs for »ps -w 0 -AF hurd-long«, »vmstat«, »slabinfo« for all runs, directly after booting, and some time after the glibc »make check«, please tell me which you'd like to see; it's a lot of data already. Grüße, Thomas pgpUemcmw0fOY.pgp Description: PGP signature
Re: [PATCH] VM cache policy change.
Hello, Running it on the buildds, I'm getting frequent ext2fs.static: /usr/src/hurd-debian/./libports/port-ref.c:31: ports_port_ref: Assertion `pi->refcnt || pi->weakrefcnt' failed. Samuel
Re: [PATCH] VM cache policy change.
On Tue, Jul 10, 2012 at 08:24:30AM +0200, Richard Braun wrote: > On Tue, Jul 10, 2012 at 03:15:00AM +0200, Samuel Thibault wrote: > > I'm currently uploading new hurd, gnumach & netdde packages. > > The bug fixes have been committed, but not the VM cache patch, which is > included in my gnumach package. I'll rebase it soon. An up-to-date gnumach package including the patch is now available. -- Richard Braun
Re: [PATCH] VM cache policy change.
On Tue, Jul 10, 2012 at 03:15:00AM +0200, Samuel Thibault wrote: > Richard Braun, le Tue 10 Jul 2012 03:03:09 +0200, a écrit : > > Debian packages with the patch and the required bug fixes are available > > at my repository : > > I guess they are all already in upstream gits? > > I'm currently uploading new hurd, gnumach & netdde packages. The bug fixes have been committed, but not the VM cache patch, which is included in my gnumach package. I'll rebase it soon. -- Richard Braun
Re: [PATCH] VM cache policy change.
Richard Braun, le Tue 10 Jul 2012 03:03:09 +0200, a écrit : > On Mon, Jul 09, 2012 at 04:44:57PM +0200, Richard Braun wrote: > > Note that you need up-to-date versions of both GNU Mach [1] and the > > Hurd [2] to test this patch, as it needs important bug fixes to avoid > > file system crashes and kernel panics. > > Debian packages with the patch and the required bug fixes are available > at my repository : I guess they are all already in upstream gits? I'm currently uploading new hurd, gnumach & netdde packages. Samuel
Re: [PATCH] VM cache policy change.
On Mon, Jul 09, 2012 at 04:44:57PM +0200, Richard Braun wrote: > Note that you need up-to-date versions of both GNU Mach [1] and the > Hurd [2] to test this patch, as it needs important bug fixes to avoid > file system crashes and kernel panics. Debian packages with the patch and the required bug fixes are available at my repository : deb http://ftp.sceen.net/debian-hurd experimental/ deb-src http://ftp.sceen.net/debian-hurd experimental/ They are currently used on the public hurd box darnassus.sceen.net.
