Re: [PERFORM] [OT] linux 3.10 kernel will improve ipc,sysv semaphore scalability

2013-05-16 Thread Andrea Suisani
Hi all, On 03/26/2013 07:59 PM, Shaun Thomas wrote: On 03/26/2013 08:04 AM, Andrea Suisani wrote: TPS: 100 users: 1257.21 (vanilla)2805.06 (v3 patchset) 400 users: 1437.57 (vanilla)2664.67 (v3 patchset) 800 users: 1236.89 (vanilla)2750.73 (v3 patchset) Wow, I like the look of

Re: [PERFORM] Thinking About Correlated Columns (again)

2013-05-16 Thread Shaun Thomas
On 05/15/2013 03:31 PM, Thomas Kellerer wrote: What happens if you create one index for each column? (instead of one combined index) I just created the combined index to simplify the output. With two indexes, it does the usual bitmap index scan. Even then the row estimate is off by a

[PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Cuong Hoang
Hi all, Our application is heavy write and IO utilisation has been the problem for us for a while. We've decided to use RAID 10 of 4x500GB Samsung 840 Pro for the master server. I'm aware of write cache issue on SSDs in case of power loss. However, our hosting provider doesn't offer any other

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Merlin Moncure
On Thu, May 16, 2013 at 9:46 AM, Cuong Hoang climbingr...@gmail.com wrote: Hi all, Our application is heavy write and IO utilisation has been the problem for us for a while. We've decided to use RAID 10 of 4x500GB Samsung 840 Pro for the master server. I'm aware of write cache issue on SSDs

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Jeff Janes
On Thu, May 16, 2013 at 7:46 AM, Cuong Hoang climbingr...@gmail.com wrote: Hi all, Our application is heavy write and IO utilisation has been the problem for us for a while. We've decided to use RAID 10 of 4x500GB Samsung 840 Pro for the master server. I'm aware of write cache issue on SSDs

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Merlin Moncure
On Thu, May 16, 2013 at 1:34 PM, Jeff Janes jeff.ja...@gmail.com wrote: On Thu, May 16, 2013 at 7:46 AM, Cuong Hoang climbingr...@gmail.com wrote: Hi all, Our application is heavy write and IO utilisation has been the problem for us for a while. We've decided to use RAID 10 of 4x500GB

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Jeff Janes
On Thu, May 16, 2013 at 11:46 AM, Merlin Moncure mmonc...@gmail.com wrote: On Thu, May 16, 2013 at 1:34 PM, Jeff Janes jeff.ja...@gmail.com wrote: On Thu, May 16, 2013 at 7:46 AM, Cuong Hoang climbingr...@gmail.com wrote: Hi all, Our application is heavy write and IO utilisation has

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Cuong Hoang
Thank you for your advice guys. We'll definitely turn off init.d script for PostgreSQL on the master. The standby host will be disk-based so it will be less vulnerable to power loss. I forgot to mention that we'll set up Wal-e https://github.com/wal-e/wal-e to ship base backups and WALs to Amazon

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Tomas Vondra
Hi, On 16.5.2013 16:46, Cuong Hoang wrote: Hi all, Our application is heavy write and IO utilisation has been the problem for us for a while. We've decided to use RAID 10 of 4x500GB Samsung 840 What does heavy write mean in your case? Does that mean a lot of small transactions or few large

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Cuong Hoang
Hi Tomas, We have a lot of small updates and some inserts. The database size is at 35GB including indexes and TOAST. We think it will keep growing to about 200GB. We usually have a burst of about 500k writes in about 5-10 minutes which basically cripples IO on the current servers. I've tried to

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

2013-05-16 Thread Mark Kirkwood
On 17/05/13 12:06, Tomas Vondra wrote: Hi, On 16.5.2013 16:46, Cuong Hoang wrote: Pro for the master server. I'm aware of write cache issue on SSDs in case of power loss. However, our hosting provider doesn't offer any other choices of SSD drives with supercapacitor. To minimise risk, we