Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-04-09 Thread Bruce Momjian
Added to TODO: * Experiment with multi-threaded backend better resource utilization This would allow a single query to make use of multiple CPU's or multiple I/O channels simultaneously.

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-24 Thread Chris Browne
[EMAIL PROTECTED] (Michael Stone) writes: > On Fri, Mar 24, 2006 at 01:21:23PM -0500, Chris Browne wrote: >>A naive read on this is that you might start with one backend process, >>which then spawns 16 more. Each of those backends is scanning through >>one of those 16 files; they then throw relev

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-24 Thread Jim C. Nasby
On Fri, Mar 24, 2006 at 01:21:23PM -0500, Chris Browne wrote: > > Correct me if I'm wrong, but there's no way to (reasonably) accomplish > > that without having some dedicated extra processes laying around that > > you can use to execute the queries, no? In other words, the cost of a > > fork() dur

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-24 Thread Michael Stone
On Fri, Mar 24, 2006 at 01:21:23PM -0500, Chris Browne wrote: A naive read on this is that you might start with one backend process, which then spawns 16 more. Each of those backends is scanning through one of those 16 files; they then throw relevant tuples into shared memory to be aggregated/jo

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-24 Thread Chris Browne
[EMAIL PROTECTED] ("Luke Lonergan") writes: > Christopher, > > On 3/23/06 6:22 PM, "Christopher Browne" <[EMAIL PROTECTED]> wrote: > >> Question: Does the Bizgress/MPP use threading for this concurrency? >> Or forking? >> >> If it does so via forking, that's more portable, and less dependent on >>

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-24 Thread Chris Browne
[EMAIL PROTECTED] ("Jim C. Nasby") writes: > On Thu, Mar 23, 2006 at 09:22:34PM -0500, Christopher Browne wrote: >> Martha Stewart called it a Good Thing when [EMAIL PROTECTED] (Scott Marlowe) >> wrote: >> > On Thu, 2006-03-23 at 10:43, Joshua D. Drake wrote: >> >> > Has someone been working on th

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-24 Thread Luke Lonergan
Christopher, On 3/23/06 6:22 PM, "Christopher Browne" <[EMAIL PROTECTED]> wrote: > Question: Does the Bizgress/MPP use threading for this concurrency? > Or forking? > > If it does so via forking, that's more portable, and less dependent on > specific complexities of threading implementations (wh

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-24 Thread Jim C. Nasby
On Thu, Mar 23, 2006 at 09:22:34PM -0500, Christopher Browne wrote: > Martha Stewart called it a Good Thing when [EMAIL PROTECTED] (Scott Marlowe) > wrote: > > On Thu, 2006-03-23 at 10:43, Joshua D. Drake wrote: > >> > Has someone been working on the problem of splitting a query into pieces > >> >

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-23 Thread Christopher Browne
Martha Stewart called it a Good Thing when [EMAIL PROTECTED] (Scott Marlowe) wrote: > On Thu, 2006-03-23 at 10:43, Joshua D. Drake wrote: >> > Has someone been working on the problem of splitting a query into pieces >> > and running it on multiple CPUs / multiple machines? Yes. Bizgress has >> >

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-23 Thread Scott Marlowe
On Thu, 2006-03-23 at 10:43, Joshua D. Drake wrote: > > Has someone been working on the problem of splitting a query into pieces > > and running it on multiple CPUs / multiple machines? Yes. Bizgress has > > done that. > > I believe that is limited to Bizgress MPP yes? Yep. I hope that somed

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-23 Thread Joshua D. Drake
Has someone been working on the problem of splitting a query into pieces and running it on multiple CPUs / multiple machines? Yes. Bizgress has done that. I believe that is limited to Bizgress MPP yes? ---(end of broadcast)--- TIP 9: In v

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-23 Thread Scott Marlowe
On Thu, 2006-03-23 at 00:19, Jojo Paderes wrote: > I'd like to know if the latest PostgreSQL release can scale up by > utilizing multiple cpu or dual core cpu to boost up the sql > executions. > > I already do a research on the PostgreSQL mailing archives and only > found old threads dating back 2

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core

2006-03-23 Thread Frank Wiles
On Thu, 23 Mar 2006 14:19:24 +0800 "Jojo Paderes" <[EMAIL PROTECTED]> wrote: > I'd like to know if the latest PostgreSQL release can scale up by > utilizing multiple cpu or dual core cpu to boost up the sql > executions. > > I already do a research on the PostgreSQL mailing archives and only > fo

Re: [PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core Powered Servers

2006-03-23 Thread Christopher Browne
[EMAIL PROTECTED] ("Jojo Paderes") wrote: > I'd like to know if the latest PostgreSQL release can scale up by > utilizing multiple cpu or dual core cpu to boost up the sql > executions. > > I already do a research on the PostgreSQL mailing archives and only > found old threads dating back 2000. A l

[PERFORM] Scaling up PostgreSQL in Multiple CPU / Dual Core Powered Servers

2006-03-22 Thread Jojo Paderes
I'd like to know if the latest PostgreSQL release can scale up by utilizing multiple cpu or dual core cpu to boost up the sql executions. I already do a research on the PostgreSQL mailing archives and only found old threads dating back 2000. A lot of things have improved with PostgreSQL and hopefu