Re: [GENERAL] Postgres HA

2017-02-22 Thread John R Pierce
On 2/22/2017 2:58 PM, Dylan Luong wrote: For PostgreSQL High Availability, we currently have setup a Master/Slave across two datacenters using PostgreSQL (WAL) streaming replication. have you considered the ramifications of network problems between these two datacenters?with a

Re: [GENERAL] Postgres HA

2017-02-22 Thread JD
Here is the option for HA i.e. EDB failover manager. https://www.enterprisedb.com/docs/en/2.1/edbfm/EDB_Failover_Manager_Guide.1.02.html On Thu, Feb 23, 2017 at 10:08 AM, Venkata B Nagothi wrote: > > On Thu, Feb 23, 2017 at 9:58 AM, Dylan Luong >

Re: [GENERAL] Postgres HA

2017-02-22 Thread Venkata B Nagothi
On Thu, Feb 23, 2017 at 9:58 AM, Dylan Luong wrote: > Hi > > > > I am a DBA at the University of South Australia. For PostgreSQL High > Availability, we currently have setup a Master/Slave across two datacenters > using PostgreSQL (WAL) streaming replication. We use an

Re: [GENERAL] Postgres HA

2017-02-22 Thread Andrew Sullivan
Hi, On Wed, Feb 22, 2017 at 10:58:10PM +, Dylan Luong wrote: > > I am looking at options to improve our high availability. I suspect the central question you have to answer is, "What do you mean by 'improve'?" Do you want to increase the ability to retrieve data? Decrease the potential

Re: [GENERAL] Autovacuum stuck for hours, blocking queries

2017-02-22 Thread Jeff Janes
On Fri, Feb 17, 2017 at 10:36 AM, Tim Bellis wrote: > > > > > *From:* Jeff Janes [mailto:jeff.ja...@gmail.com] > *Sent:* 17 February 2017 02:59 > *To:* Tim Bellis > *Cc:* pgsql-general@postgresql.org > *Subject:* Re: [GENERAL] Autovacuum

Re: [GENERAL] NOTIFY command impact

2017-02-22 Thread David G. Johnston
On Wed, Feb 22, 2017 at 3:05 PM, Rob Brucks wrote: > So, long-term, you don't see any negative impacts to the master cluster? > > I just don't want to implement this as a streaming "push" mechanism and > then have my cluster crash in 12 months because it hit some

[GENERAL] Postgres HA

2017-02-22 Thread Dylan Luong
Hi I am a DBA at the University of South Australia. For PostgreSQL High Availability, we currently have setup a Master/Slave across two datacenters using PostgreSQL (WAL) streaming replication. We use an LTM (load balancer) server that sits between the application servers and the PostgreSQL

Re: [GENERAL] bloat indexes - opinion

2017-02-22 Thread Jeff Janes
On Tue, Feb 21, 2017 at 1:44 PM, Patrick B wrote: > Hi guys, > > I've got a lot of bloat indexes on my 4TB database. > > Let's take this example: > > Table: seg > Index: ix_filter_by_tree > Times_used: 1018082183 > Table_size: 18 GB -- wrong. The table is mostly on

Re: [GENERAL] NOTIFY command impact

2017-02-22 Thread Rob Brucks
Thank you Tom. So, long-term, you don't see any negative impacts to the master cluster? I just don't want to implement this as a streaming "push" mechanism and then have my cluster crash in 12 months because it hit some obscure problem with notifications. This turned out to be a really

Re: [GENERAL] Autovacuum stuck for hours, blocking queries

2017-02-22 Thread Jeff Janes
On Mon, Feb 20, 2017 at 5:40 PM, Merlin Moncure wrote: > > > On Thursday, February 16, 2017, Tom Lane wrote: > >> Tim Bellis writes: >> > Even though this is a read only query, is it also expected to be >> blocked behind the

Re: [GENERAL] NOTIFY command impact

2017-02-22 Thread Tom Lane
=?utf-8?Q?Fran=C3=A7ois_Beaulieu?= writes: >> On Feb 21, 2017, at 6:03 PM, Tom Lane wrote: >> (The reason it goes into the WAL stream is so that you can have listeners >> on replication slaves, not for recovery purposes.) > Are we sure that replication

Re: [GENERAL] NOTIFY command impact

2017-02-22 Thread François Beaulieu
> On Feb 21, 2017, at 6:03 PM, Tom Lane wrote: > > Rob Brucks writes: >> If a notify is sent and then PG is immediately shut down, wouldn't PG want >> to save that message for processing after startup? >> Or is the message just discarded? > >

Re: [GENERAL] Strange Errors...

2017-02-22 Thread Adrian Klaver
On 02/22/2017 09:16 AM, Jerry LeVan wrote: There is a setting in the Mac System Preferences that will allow you to turn off smart quotes. Aah, Apple trying to be 'helpful'. Assumes everyone wants to output print copy everywhere. I did this and the program is acting properly once more

Re: [GENERAL] Strange Errors...

2017-02-22 Thread Jerry LeVan
> On Feb 22, 2017, at 10:08 AM, Jerry LeVan wrote: > >> >> On Feb 22, 2017, at 9:49 AM, Adrian Klaver wrote: >> >> On 02/22/2017 07:32 AM, Jerry LeVan wrote: >>> On Feb 22, 2017, at 9:20 AM, Adrian Klaver

Re: [GENERAL] Strange Errors...

2017-02-22 Thread Jerry LeVan
> On Feb 22, 2017, at 9:49 AM, Adrian Klaver wrote: > > On 02/22/2017 07:32 AM, Jerry LeVan wrote: >> >>> On Feb 22, 2017, at 9:20 AM, Adrian Klaver >>> wrote: >>> >>> On 02/22/2017 07:09 AM, Jerry LeVan wrote: Sorry I accidentally

Re: [GENERAL] Indexes and MVCC

2017-02-22 Thread Jeff Janes
On Sun, Feb 19, 2017 at 8:52 AM, Rakesh Kumar wrote: > > https://www.youtube.com/watch?v=8mKpfutwD0U=1741s > > Somewhere around 13th minute, Chris Tavers mentions this: > > 1 - In the queuing table, the application deletes lot of rows (typical for > a queuing table).

Re: [GENERAL] Strange Errors...

2017-02-22 Thread Adrian Klaver
On 02/22/2017 07:32 AM, Jerry LeVan wrote: On Feb 22, 2017, at 9:20 AM, Adrian Klaver wrote: On 02/22/2017 07:09 AM, Jerry LeVan wrote: Sorry I accidentally posted this to pgsql-general-owners earlier today… How can this happen ( from the postgresql.log

Re: [GENERAL] Strange Errors...

2017-02-22 Thread Adrian Klaver
On 02/22/2017 07:32 AM, Jerry LeVan wrote: On Feb 22, 2017, at 9:20 AM, Adrian Klaver wrote: On 02/22/2017 07:09 AM, Jerry LeVan wrote: Sorry I accidentally posted this to pgsql-general-owners earlier today… How can this happen ( from the postgresql.log

Re: [GENERAL] Strange Errors...

2017-02-22 Thread Jerry LeVan
> On Feb 22, 2017, at 9:20 AM, Adrian Klaver wrote: > > On 02/22/2017 07:09 AM, Jerry LeVan wrote: >> Sorry I accidentally posted this to pgsql-general-owners earlier today… >> >> How can this happen ( from the postgresql.log file) >> >> LOG: statement:

Re: [GENERAL] NOTIFY command impact

2017-02-22 Thread Rob Brucks
Thanks Tom, Can you answer my original question too: If I am issuing NOTIFY commands every 30 seconds (and immediately committing) and there are no listeners, will that have a negative impact on the cluster? I'm using the NOTIFY to force streaming replication to update the

Re: [GENERAL] Strange Errors...

2017-02-22 Thread Adrian Klaver
On 02/22/2017 07:09 AM, Jerry LeVan wrote: Sorry I accidentally posted this to pgsql-general-owners earlier today… How can this happen ( from the postgresql.log file) LOG: statement: select * from knives where manufacturer=‘Boker’ ERROR: column "‘boker’" does not exist at character

[GENERAL] Strange Errors...

2017-02-22 Thread Jerry LeVan
Sorry I accidentally posted this to pgsql-general-owners earlier today… How can this happen ( from the postgresql.log file) LOG: statement: select * from knives where manufacturer=‘Boker’ ERROR: column "‘boker’" does not exist at character 41 Some background: I am trying to move from

Re: [GENERAL] Multiply ON CONFLICT ON CONSTRAINT

2017-02-22 Thread Adrian Klaver
On 02/21/2017 02:49 PM, Arnold Somogyi wrote: Ccing list. I want OR. I do not think that is possible, then again I have not used this feature enough to know everything that is possible. On Tue, Feb 21, 2017 at 12:33 AM, Adrian Klaver

Re: [GENERAL] Move rows from one database to other

2017-02-22 Thread Adrian Klaver
On 02/22/2017 04:51 AM, Thomas Güttler wrote: I have other concerns: atomar transaction. Movement should happen completely or not all. I don't think you can do this reliable (atomic transaction) with "copy table_name". You can if you wrap it in a transaction: I want to **move** the data. The

Re: [GENERAL] Move rows from one database to other

2017-02-22 Thread Thomas Güttler
I have other concerns: atomar transaction. Movement should happen completely or not all. I don't think you can do this reliable (atomic transaction) with "copy table_name". You can if you wrap it in a transaction: I want to **move** the data. The data should get deleted on the satellite

Re: [GENERAL] Move rows from one database to other

2017-02-22 Thread Thomas Güttler
I misunderstood your original intent, I thought this was a one time process to move data to the central database. Given that it is to be a continuous process a FDW may not be the answer, one of the reasons being the above question. You will be denied the data in the remote table during the