Re: [GENERAL] Replication failed after stalling

2013-12-31 Thread Albe Laurenz
Sergey Konoplev wrote: On Mon, Dec 30, 2013 at 12:27 AM, Albe Laurenz laurenz.a...@wien.gv.at wrote: Joe Van Dyk wrote: If I run COPY (select * from complicate_view) to stdout on the standby, I've noticed that sometimes halts replication updates to the slave. For example, that's

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Albe Laurenz
Joe Van Dyk wrote: If I run COPY (select * from complicate_view) to stdout on the standby, I've noticed that sometimes halts replication updates to the slave. For example, that's happening right now and now() - pg_last_xact_replay_timestamp() is 22 minutes. There's many transactions per

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 12:27 AM, Albe Laurenz laurenz.a...@wien.gv.at wrote: Joe Van Dyk wrote: If I run COPY (select * from complicate_view) to stdout on the standby, I've noticed that sometimes halts replication updates to the slave. For example, that's happening right now and now() -

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Joe Van Dyk
On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk j...@tanga.com wrote: On Sun, Dec 29, 2013 at 10:52 PM, Sergey Konoplev gray...@gmail.com wrote: On Sun, Dec 29, 2013 at 9:56 PM, Joe Van Dyk j...@tanga.com wrote: On

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 8:56 PM, Joe Van Dyk j...@tanga.com wrote: On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk j...@tanga.com wrote: On Sun, Dec 29, 2013 at 10:52 PM, Sergey Konoplev gray...@gmail.com wrote: On

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Scott Marlowe
On Wed, Dec 18, 2013 at 1:51 PM, Adrian Klaver adrian.kla...@gmail.com wrote: On 12/18/2013 12:15 PM, Joe Van Dyk wrote: A possibly related question: I've set wal_keep_segments to 10,000 and also have archive_command running wal-e. I'm seeing my wal files disappear from pg_xlog after 30

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Joe Van Dyk
On Mon, Dec 30, 2013 at 9:11 PM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 8:56 PM, Joe Van Dyk j...@tanga.com wrote: On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk j...@tanga.com wrote: On

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 10:05 PM, Joe Van Dyk j...@tanga.com wrote: I meant all the replication settings, see [1]. And pg_stat_statements when there is a problem, preferable the error, because when everything is okay it is not very useful actually. I don't understand, how is

Re: [GENERAL] Replication failed after stalling

2013-12-29 Thread Joe Van Dyk
On Wed, Dec 18, 2013 at 3:39 PM, Sergey Konoplev gray...@gmail.com wrote: On Wed, Dec 18, 2013 at 11:26 AM, Joe Van Dyk j...@tanga.com wrote: I'm running Postgresql 9.3. I have a streaming replication server. Someone was running a long COPY query (8 hours) on the standby which halted

Re: [GENERAL] Replication failed after stalling

2013-12-29 Thread Sergey Konoplev
On Sun, Dec 29, 2013 at 9:56 PM, Joe Van Dyk j...@tanga.com wrote: On Wed, Dec 18, 2013 at 3:39 PM, Sergey Konoplev gray...@gmail.com wrote: On Wed, Dec 18, 2013 at 11:26 AM, Joe Van Dyk j...@tanga.com wrote: I'm running Postgresql 9.3. I have a streaming replication server. Someone was

[GENERAL] Replication failed after stalling

2013-12-18 Thread Joe Van Dyk
I'm running Postgresql 9.3. I have a streaming replication server. Someone was running a long COPY query (8 hours) on the standby which halted replication. The replication stopped at 3:30 am. I canceled the long-running query at 9:30 am and replication data started catching up. The data up until

Re: [GENERAL] Replication failed after stalling

2013-12-18 Thread Joe Van Dyk
A possibly related question: I've set wal_keep_segments to 10,000 and also have archive_command running wal-e. I'm seeing my wal files disappear from pg_xlog after 30 minutes. Is that expected? Is there a way around that? (I want to use streaming replication and wal-e for PITR restores) On

Re: [GENERAL] Replication failed after stalling

2013-12-18 Thread Jerry Sievers
Joe Van Dyk j...@tanga.com writes: I'm running Postgresql 9.3. I have a streaming replication server. Someone was running a long COPY query (8 hours) on the standby which halted replication. The replication stopped at 3:30 am. I canceled the long-running query at 9:30 am and replication

Re: [GENERAL] Replication failed after stalling

2013-12-18 Thread Adrian Klaver
On 12/18/2013 12:15 PM, Joe Van Dyk wrote: A possibly related question: I've set wal_keep_segments to 10,000 and also have archive_command running wal-e. I'm seeing my wal files disappear from pg_xlog after 30 minutes. Is that expected? Is there a way around that? Well a WAL segment is 16MB

Re: [GENERAL] Replication failed after stalling

2013-12-18 Thread Sergey Konoplev
On Wed, Dec 18, 2013 at 11:26 AM, Joe Van Dyk j...@tanga.com wrote: I'm running Postgresql 9.3. I have a streaming replication server. Someone was running a long COPY query (8 hours) on the standby which halted replication. The replication stopped at 3:30 am. I canceled the long-running query