Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-03-01 Thread Coleman Kane
On 2/28/07, Sten Daniel Soersdal [EMAIL PROTECTED] wrote: Jim C. Nasby wrote: On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the goals of the

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-03-01 Thread Craig Boston
On Tue, Feb 27, 2007 at 04:12:52PM -0600, Jim C. Nasby wrote: On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: I've mentioned this a couple of times, but postgresql didn't scale well [on freebsd at least] when I tried it last year. I hope to revisit when I get time. Let

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-28 Thread Sten Daniel Soersdal
Jim C. Nasby wrote: On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the goals of the SMPng project are complete, for the past year or more

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-27 Thread Jim C. Nasby
On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor workloads, and looking for performance bottlenecks to be optimized.

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-27 Thread Kris Kennaway
On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-27 Thread Jim C. Nasby
On Tue, Feb 27, 2007 at 03:59:52PM -0500, Kris Kennaway wrote: On Tue, Feb 27, 2007 at 12:25:11PM -0600, Jim C. Nasby wrote: On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the goals of the SMPng project are complete, for the past year or more several of us have

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Peter Jeremy
On 2007-Feb-24 16:31:11 -0500, Kris Kennaway [EMAIL PROTECTED] wrote: We have recently made significant progress on optimizing for MySQL running on an 8-core amd64 system. The graph of results may be found here: http://www.freebsd.org/~kris/scaling/scaling.png Those results look wonderful.

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Kris Kennaway
On Mon, Feb 26, 2007 at 07:08:37PM +1100, Peter Jeremy wrote: On 2007-Feb-24 16:31:11 -0500, Kris Kennaway [EMAIL PROTECTED] wrote: We have recently made significant progress on optimizing for MySQL running on an 8-core amd64 system. The graph of results may be found here:

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Kris Kennaway
On Mon, Feb 26, 2007 at 11:15:27PM +0100, Divacky Roman wrote: I wonder if anyone measured what effect superpages has on mysql performance... this should not help scaling but I can imagine it has some effect. I have thought about trying this but have not found the time. I am currently very

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-26 Thread Divacky Roman
On Sat, Feb 24, 2007 at 04:31:11PM -0500, Kris Kennaway wrote: Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor workloads, and looking for performance bottlenecks to be optimized.

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Robert Watson
On Sun, 25 Feb 2007, Kris Kennaway wrote: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree with 4BSD or ULE ? How do those stand up against the Linux SMP scheduler for scalability. It would be nice to see

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Andre Guibert de Bruet
On Feb 25, 2007, at 12:41 AM, Kris Kennaway wrote: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree with 4BSD or ULE ? How do those stand up against the Linux SMP scheduler for scalability. It would be

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Robert Watson
On Sun, 25 Feb 2007, Martin Blapp wrote: It would be really great if we could find workload owners who would maintain easy-to-run benchmark configurations and also run them regularly on a fixed hardware configuration over a long time publishing results and testing patches. Kris has done this

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Kris Kennaway
On Sun, Feb 25, 2007 at 01:54:20PM +0100, Martin Blapp wrote: Hi, It would be really great if we could find workload owners who would maintain easy-to-run benchmark configurations and also run them regularly on a fixed hardware configuration over a long time publishing results and

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Martin Blapp
Hi, It would be really great if we could find workload owners who would maintain easy-to-run benchmark configurations and also run them regularly on a fixed hardware configuration over a long time publishing results and testing patches. Kris has done this for SQL benchmarks to great effect,

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Kris Kennaway
On Mon, Feb 26, 2007 at 12:27:01AM +0100, Martin Blapp wrote: Hi, If you can package up some kind of test or analogous workload that I can run, I'd be happy to take a look at profiling it on MP hardware. Should be possible. Btw. Has setting kern.threads.virtual_cpu to a different

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-25 Thread Martin Blapp
Hi, If you can package up some kind of test or analogous workload that I can run, I'd be happy to take a look at profiling it on MP hardware. Should be possible. Btw. Has setting kern.threads.virtual_cpu to a different value effect for running programms or just started ones ? P.S. I

Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor workloads, and looking for performance bottlenecks to be optimized. We have recently made significant progress on optimizing for

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Matt Olander
On Saturday 24 February 2007 1:31 pm, Kris Kennaway wrote: Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor workloads, and looking for performance bottlenecks to be optimized.

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Coleman Kane
On 2/24/07, Kris Kennaway [EMAIL PROTECTED] wrote: Now that the goals of the SMPng project are complete, for the past year or more several of us have been working hard on profiling FreeBSD in various multiprocessor workloads, and looking for performance bottlenecks to be optimized. We have

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree with 4BSD or ULE ? How do those stand up against the Linux SMP scheduler for scalability. It would be nice to see the comparison displayed to see what the

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
On Sun, Feb 25, 2007 at 05:47:55AM +, Coleman Kane wrote: On Sun, Feb 25, 2007 at 12:41:20AM -0500, Kris Kennaway wrote, and it was proclaimed: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Kris Kennaway
On Sun, Feb 25, 2007 at 01:05:53AM -0500, Andre Guibert de Bruet wrote: On Feb 25, 2007, at 12:41 AM, Kris Kennaway wrote: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree with 4BSD or ULE ? How do

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Coleman Kane
On Sun, Feb 25, 2007 at 12:41:20AM -0500, Kris Kennaway wrote, and it was proclaimed: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance curve look like for the in-CVS 7-CURRENT tree with 4BSD or ULE ? How do those stand up against the Linux SMP

Re: Progress on scaling of FreeBSD on 8 CPU systems

2007-02-24 Thread Coleman Kane
On 2/24/07, Kris Kennaway [EMAIL PROTECTED] wrote: On Sun, Feb 25, 2007 at 05:47:55AM +, Coleman Kane wrote: On Sun, Feb 25, 2007 at 12:41:20AM -0500, Kris Kennaway wrote, and it was proclaimed: On Sat, Feb 24, 2007 at 10:00:35PM -0700, Coleman Kane wrote: What does the performance