Re: [PERFORM] One query run twice in parallel results in huge performance decrease

2013-12-03 Thread Jan Michel
Jeff Janes wrote: I think what I would do next is EXPLAIN (without ANALYZE) one of the queries repeatedly, say once a second, while the other query either runs or doesn't run repeatedly, that is the other query runs for 11 minutes (or however it takes to run), and then sleeps for 11 minutes i

Re: [PERFORM] Parallel Select query performance and shared buffers

2013-12-03 Thread Claudio Freire
On Tue, Dec 3, 2013 at 1:24 PM, Metin Doslu wrote: > Looking into syncscan.c, it says in comments: > > "When multiple backends run a sequential scan on the same table, we try to > keep them synchronized to reduce the overall I/O needed." > > But in my workload, every process was running on a diffe

Re: [PERFORM] Parallel Select query performance and shared buffers

2013-12-03 Thread Metin Doslu
Looking into syncscan.c, it says in comments: "When multiple backends run a sequential scan on the same table, we try to keep them synchronized to reduce the overall I/O needed." But in my workload, every process was running on a different table. On Tue, Dec 3, 2013 at 5:56 PM, Claudio Freire

Re: [PERFORM] Parallel Select query performance and shared buffers

2013-12-03 Thread Claudio Freire
On Tue, Dec 3, 2013 at 10:49 AM, Metin Doslu wrote: > We have several independent tables on a multi-core machine serving Select > queries. These tables fit into memory; and each Select queries goes over one > table's pages sequentially. In this experiment, there are no indexes or > table joins. >

Re: [PERFORM] Parallel Select query performance and shared buffers

2013-12-03 Thread Alvaro Herrera
Metin Doslu wrote: > When we send concurrent Select queries to these tables, query performance > doesn't scale out with the number of CPU cores. We find that complex Select > queries scale out better than simpler ones. We also find that increasing > the block size from 8 KB to 32 KB, or increasing

[PERFORM] Parallel Select query performance and shared buffers

2013-12-03 Thread Metin Doslu
We have several independent tables on a multi-core machine serving Select queries. These tables fit into memory; and each Select queries goes over one table's pages sequentially. In this experiment, there are no indexes or table joins. When we send concurrent Select queries to these tables, query