Re: [PERFORM] Sudden connection and load average spikes with postgresql 9.3

2015-07-02 Thread Scott Marlowe
On Tue, Jun 30, 2015 at 8:52 AM, eudald_v wrote: > Hello all, > This is my very first message to the Postgresql community, and I really hope > you can help me solve the trouble I'm facing. > > I've an 80 core server (multithread) with close to 500GB RAM. > > My configuration is: > MaxConn: 1500 (w

Re: [PERFORM] Sudden connection and load average spikes with postgresql 9.3

2015-07-02 Thread Kevin Grittner
Josh Berkus wrote: > On 07/02/2015 08:41 AM, eudald_v wrote: >> And this is how it looks like when the spike happens: >> [system CPU staying over 90%] > I think you have a driver, kernel, Linux memory management, or IO > stack issue. In my experience this is usually caused by failure to disable

Re: [PERFORM] Sudden connection and load average spikes with postgresql 9.3

2015-07-02 Thread Josh Berkus
On 07/02/2015 08:41 AM, eudald_v wrote: > And this is how it looks like when the spike happens: > http://pastebin.com/2hAYuDZ5 Hmm, those incredibly high system % indicate that there's something wrong with your system. If you're not using software RAID or ZFS, you should never see that. I think

Re: [PERFORM] Sudden connection and load average spikes with postgresql 9.3

2015-07-02 Thread Josh Berkus
On 07/02/2015 08:41 AM, eudald_v wrote: > All that was recorded during a spike. From this log I have to point > something: > Tables TABLE_X and TABLE_Y have both a TRIGGER that does an INSERT to > TABLE_Z > As you can see, TABLE_Z was being VACUUM ANALYZED. I wonder if TRIGGERS and > VACUUM work we

Re: [PERFORM] New server: SSD/RAID recommendations?

2015-07-02 Thread Wes Vaske (wvaske)
Storage Review has a pretty good process and reviewed the M500DC when it released last year. http://www.storagereview.com/micron_m500dc_enterprise_ssd_review The only database-specific info we have available are for Cassandra and MSSQL: http://www.micron.com/~/media/documents/products/technical-

Re: [PERFORM] New server: SSD/RAID recommendations?

2015-07-02 Thread Craig James
On Wed, Jul 1, 2015 at 4:57 PM, Scott Marlowe wrote: > On Wed, Jul 1, 2015 at 5:06 PM, Craig James wrote: > > We're buying a new server in the near future to replace an aging system. > I'd > > appreciate advice on the best SSD devices and RAID controller cards > > available today. > > > SSD

Re: [PERFORM] New server: SSD/RAID recommendations?

2015-07-02 Thread Craig James
On Wed, Jul 1, 2015 at 4:56 PM, Andreas Joseph Krogh wrote: > På torsdag 02. juli 2015 kl. 01:06:57, skrev Craig James < > cja...@emolecules.com>: > > We're buying a new server in the near future to replace an aging system. > I'd appreciate advice on the best SSD devices and RAID controller cards

Re: [PERFORM] New server: SSD/RAID recommendations?

2015-07-02 Thread Craig James
On Thu, Jul 2, 2015 at 7:01 AM, Wes Vaske (wvaske) wrote: > What about a RAID controller? Are RAID controllers even available for > PCI-Express SSD drives, or do we have to stick with SATA if we need a > battery-backed RAID controller? Or is software RAID sufficient for SSD > drives? > > > > Qui

Re: [PERFORM] Sudden connection and load average spikes with postgresql 9.3

2015-07-02 Thread eudald_v
Dear Josh, I'm sorry I didn't write before, but we have been very busy with this issue and, you know, when something goes wrong, the apocalypse comes with it. I've been working on everything you suggested. I used your tables and script and I can give you a sample of it on locked_query_start 2015

Re: [PERFORM] New server: SSD/RAID recommendations?

2015-07-02 Thread Merlin Moncure
On Wed, Jul 1, 2015 at 6:06 PM, Craig James wrote: > We're buying a new server in the near future to replace an aging system. I'd > appreciate advice on the best SSD devices and RAID controller cards > available today. > > The database is about 750 GB. This is a "warehouse" server. We load supplie

Re: [PERFORM] New server: SSD/RAID recommendations?

2015-07-02 Thread Wes Vaske (wvaske)
What about a RAID controller? Are RAID controllers even available for PCI-Express SSD drives, or do we have to stick with SATA if we need a battery-backed RAID controller? Or is software RAID sufficient for SSD drives? Quite a few of the benefits of using a hardware RAID controller are irrelevan