Re: [GENERAL] High checkpoint_segments

2012-02-15 Thread Venkat Balaji
On Wed, Feb 15, 2012 at 4:12 PM, Andres Freund wrote: > On Wednesday, February 15, 2012 10:38:23 AM Venkat Balaji wrote: > > On Wed, Feb 15, 2012 at 12:21 PM, Scott Marlowe > wrote: > > > On Tue, Feb 14, 2012 at 10:57 PM, Venkat Balaji < > venkat.bal...@verse.in> > > > > all of these 1000 files g

Re: [GENERAL] High checkpoint_segments

2012-02-15 Thread Venkat Balaji
> > Data loss would be an issue when there is a server crash or pg_xlog crash > > etc. That many number of pg_xlog files (1000) would contribute to huge > > data > > loss (data changes not synced to the base are not guaranteed). Of-course, > > this is not related to the current situation. Normally

Re: [GENERAL] High checkpoint_segments

2012-02-15 Thread Andres Freund
On Wednesday, February 15, 2012 10:38:23 AM Venkat Balaji wrote: > On Wed, Feb 15, 2012 at 12:21 PM, Scott Marlowe wrote: > > On Tue, Feb 14, 2012 at 10:57 PM, Venkat Balaji > > > all of these 1000 files get filled up in less than 5 mins, there are > > > chances that system will slow down due to

Re: [GENERAL] High checkpoint_segments

2012-02-15 Thread Tomas Vondra
On 15 Únor 2012, 10:38, Venkat Balaji wrote: > > Data loss would be an issue when there is a server crash or pg_xlog crash > etc. That many number of pg_xlog files (1000) would contribute to huge > data > loss (data changes not synced to the base are not guaranteed). Of-course, > this is not relate

Re: [GENERAL] High checkpoint_segments

2012-02-15 Thread Venkat Balaji
On Wed, Feb 15, 2012 at 12:21 PM, Scott Marlowe wrote: > On Tue, Feb 14, 2012 at 10:57 PM, Venkat Balaji > wrote: > > > > On Wed, Feb 15, 2012 at 1:35 AM, Jay Levitt > wrote: > >> > >> We need to do a few bulk updates as Rails migrations. We're a typical > >> read-mostly web site, so at the mom

Re: [GENERAL] High checkpoint_segments

2012-02-15 Thread Albe Laurenz
Jay Levitt wrote: > We need to do a few bulk updates as Rails migrations. We're a typical > read-mostly web site, so at the moment, our checkpoint settings and WAL are > all default (3 segments, 5 min, 16MB), and updating a million rows takes 10 > minutes due to all the checkpointing. > > We have

Re: [GENERAL] High checkpoint_segments

2012-02-14 Thread Scott Marlowe
On Tue, Feb 14, 2012 at 10:57 PM, Venkat Balaji wrote: > > On Wed, Feb 15, 2012 at 1:35 AM, Jay Levitt wrote: >> >> We need to do a few bulk updates as Rails migrations.  We're a typical >> read-mostly web site, so at the moment, our checkpoint settings and WAL are >> all default (3 segments, 5 m

Re: [GENERAL] High checkpoint_segments

2012-02-14 Thread Venkat Balaji
On Wed, Feb 15, 2012 at 1:35 AM, Jay Levitt wrote: > We need to do a few bulk updates as Rails migrations. We're a typical > read-mostly web site, so at the moment, our checkpoint settings and WAL are > all default (3 segments, 5 min, 16MB), and updating a million rows takes 10 > minutes due to

[GENERAL] High checkpoint_segments

2012-02-14 Thread Jay Levitt
We need to do a few bulk updates as Rails migrations. We're a typical read-mostly web site, so at the moment, our checkpoint settings and WAL are all default (3 segments, 5 min, 16MB), and updating a million rows takes 10 minutes due to all the checkpointing. We have no replication or hot sta