Re: [PERFORM] query on parent partition table has bad performance

2014-08-20 Thread Tom Lane
"Huang, Suya" writes: > For the first point you made, you're right. The real execution time varies a > lot from the explain analyze, the query on parent table are just as fast as > it is on the child table. is this a bug of explain analyze command? While we > reading the execution plan, shall

Re: [PERFORM] High rate of transaction failure with the Serializable Isolation Level

2014-08-20 Thread Reza Taheri
An update: following the recommendations on this list, I ran a number of experiments: - I ran with all foreign keys deleted. There was a 4% drop in the rate of deadlocks/transaction, which went from 0.32 per transaction to 0.31. So we still have pretty much the same failure rate. One interestin

Re: [PERFORM] query on parent partition table has bad performance

2014-08-20 Thread Huang, Suya
-Original Message- From: Tom Lane [mailto:t...@sss.pgh.pa.us] Sent: Thursday, August 21, 2014 12:13 AM To: Huang, Suya Cc: pgsql-performance@postgresql.org Subject: Re: [PERFORM] query on parent partition table has bad performance "Huang, Suya" writes: > I have a question about partition

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

2014-08-20 Thread Tatsuo Ishii
> On Wed, Aug 20, 2014 at 12:13:50PM -0700, Josh Berkus wrote: >> On a read-write test, it's 10% faster with HT off as well. >> >> Further, from their production machine we've seen that having HT on >> causes the machine to slow down by 5X whenever you get more than 40 >> cores (as in 100% of real

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

2014-08-20 Thread Bruce Momjian
On Wed, Aug 20, 2014 at 12:13:50PM -0700, Josh Berkus wrote: > On a read-write test, it's 10% faster with HT off as well. > > Further, from their production machine we've seen that having HT on > causes the machine to slow down by 5X whenever you get more than 40 > cores (as in 100% of real cores

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

2014-08-20 Thread Peter Geoghegan
On Wed, Aug 20, 2014 at 1:36 PM, Shaun Thomas wrote: > That's so strange. Back when I did my Nehalem tests, we got a very strong > 30%+ increase by enabling HT. We only got a hit when we turned off turbo, or > forgot to disable power saving features. In my experience, it is crucially important to

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

2014-08-20 Thread Mark Kirkwood
On 21/08/14 07:13, Josh Berkus wrote: Mark, all: So, this is pretty damming: Read-only test with HT ON: [pgtest@db ~]$ pgbench -c 20 -j 4 -T 600 -S bench starting vacuum...end. transaction type: SELECT only scaling factor: 30 query mode: simple number of clients: 20 number of threads: 4 durati

Re: [PERFORM] query against pg_locks leads to large memory alloc

2014-08-20 Thread Kevin Grittner
Kevin Grittner wrote: > Dave Owens wrote: > >> I now have 8 hours worth of snapshots from pg_stat_activity and >> pg_locks (16 snapshots from each table/view).  I have turned off >> collection at this point, but I am still able to query pg_locks > > Could you take the earliest one after activity

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

2014-08-20 Thread Shaun Thomas
On 08/20/2014 02:13 PM, Josh Berkus wrote: So we're definitely back to "If you're using PostgreSQL, turn off Hyperthreading". That's so strange. Back when I did my Nehalem tests, we got a very strong 30%+ increase by enabling HT. We only got a hit when we turned off turbo, or forgot to disab

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

2014-08-20 Thread Josh Berkus
Mark, all: So, this is pretty damming: Read-only test with HT ON: [pgtest@db ~]$ pgbench -c 20 -j 4 -T 600 -S bench starting vacuum...end. transaction type: SELECT only scaling factor: 30 query mode: simple number of clients: 20 number of threads: 4 duration: 600 s number of transactions actuall

Re: [PERFORM] query against pg_locks leads to large memory alloc

2014-08-20 Thread Kevin Grittner
Dave Owens wrote: > I now have 8 hours worth of snapshots from pg_stat_activity and > pg_locks (16 snapshots from each table/view).  I have turned off > collection at this point, but I am still able to query pg_locks Could you take the earliest one after activity started, and the latest one befo

Re: [PERFORM] query against pg_locks leads to large memory alloc

2014-08-20 Thread Dave Owens
I now have 8 hours worth of snapshots from pg_stat_activity and pg_locks (16 snapshots from each table/view). I have turned off collection at this point, but I am still able to query pg_locks: # SELECT mode, count(mode) AS count FROM pg_locks GROUP BY mode ORDER BY mode; mode | coun

Re: [PERFORM] query on parent partition table has bad performance

2014-08-20 Thread Tom Lane
"Huang, Suya" writes: > I have a question about partition table query performance in postgresql, it's > an old version 8.3.21, I know it's already out of support. so any words about > the reason for the behavior would be very much appreciated. > I have a partition table which name is test_rank_

Re: [PERFORM] query on parent partition table has bad performance

2014-08-20 Thread David G Johnston
Huang, Suya wrote > Hi, > > I have a question about partition table query performance in postgresql, > it's an old version 8.3.21, I know it's already out of support. so any > words about the reason for the behavior would be very much appreciated. > > I have a partition table which name is test_r

[PERFORM] query on parent partition table has bad performance

2014-08-20 Thread Huang, Suya
Hi, I have a question about partition table query performance in postgresql, it's an old version 8.3.21, I know it's already out of support. so any words about the reason for the behavior would be very much appreciated. I have a partition table which name is test_rank_2014_monthly and it has 7