Re: [GENERAL] PK Index - Removal

2016-08-10 Thread Venkata Balaji N
On Thu, Aug 11, 2016 at 1:30 PM, Patrick B wrote: > Hi guys, > > I got the following index: > > CREATE INDEX "ix_mo_pk" ON "mo" USING "btree" ((("id")::"text")) > > > The "ID" is my primary key: > >> "mo_pkey" PRIMARY KEY, "btree" ("id") > > > The ix_mo_pk index is not

Re: [GENERAL] Logical Decoding Failover

2016-08-09 Thread Venkata Balaji N
> Now the logical decoding client connects to B (the new primary). The > replication slot doesn't exist. So, it creates it and starts streaming. > This is where the problem lies - as it would begin streaming from LSN 4 > (anything after what has already been committed), because I have no way >

Re: [GENERAL] Logical Decoding Failover

2016-08-08 Thread Venkata Balaji N
On Sun, Aug 7, 2016 at 9:29 PM, Colin Morelli wrote: > Venkata, > > Thanks for the reply. Unfortunately something like PgPool still won't > create the replication slots on all hosts, and record the LSN in a way that > is reusable on the secondary. > Yes, thats correct,

Re: [GENERAL] Logical Decoding Failover

2016-08-06 Thread Venkata Balaji N
On Sat, Aug 6, 2016 at 1:17 PM, Colin Morelli wrote: > Hey all, > > I'm using logical decoding in my application to capture change streams and > ship them to Kafka. However, logical replication slots aren't included in > the WAL and thus don't make it to replicas. In the

Re: [GENERAL] Question about wal files / pg_xlogs

2016-08-03 Thread Venkata Balaji N
> > I use a bash script to ship them. The script hasn't being changed So > it isn't the problem. > > > *postgresql.conf:* > >> archive_command = 'exec nice -n 19 ionice -c 2 -n 7 archive_command.bash >> "%p" slave01 slave02' > > *archive_command.bash:* > > Basically we use TAR to ship through

Re: [GENERAL] How to best archetect Multi-Tenant SaaS application using Postgres

2016-08-02 Thread Venkata Balaji N
possible that, 1000s of requests can be served and those being concurrent will be far from real with kind of hardware capacity you have. So, the solution would be to have appropriate tuning and benchmarking process in place. Regards, Venkata B N Fujitsu, Australia > On August 1, 2016 at 10:30:48

Re: [GENERAL] How to best archetect Multi-Tenant SaaS application using Postgres

2016-08-01 Thread Venkata Balaji N
On Sun, Jul 31, 2016 at 12:07 PM, Silk Parrot wrote: > Hi, > > We are trying build a multi tenant application and are debating which > approach we should take: (also my understanding is based on that pgbouncer > connection pool doesn’t work across different user/database

Re: [GENERAL] Slony error please help

2016-06-16 Thread Venkata Balaji N
On Fri, Jun 17, 2016 at 5:36 AM, avi Singh wrote: > I am working on a project to upgrade postgresql from 9.4 to 9.5 we use > slony for replication > > > Phase 1 problem > > 1. We had slony version slony1-94-2.2.2-1.rhel5.x86_64 installed when i > tried testing upgrade

Re: [GENERAL] High availability and load balancing ...

2016-06-09 Thread Venkata Balaji N
On Thu, Jun 9, 2016 at 8:01 PM, Sunil N Shinde wrote: > Thanks Venkata. > > > > I am considering latest version now i.e. 9.4 or 9.5 on Linux 6. > > Is there any difference in setup from 9.1 to 9.5? > There is no difference in the setup. Streaming Replication in the

Re: [GENERAL] High availability and load balancing ...

2016-06-08 Thread Venkata Balaji N
> > > > I need to do the setup for High availability function. > > Also want to implement load balancing for 02 nodes. > You will have to build streaming replication which was introduced in PostgreSQL-9.0 > I think PGPool will be require for that. Can I use PGPool without cost. > pgpool-II is

Re: [GENERAL] Slave claims requested WAL segment already removed - but it wasn't

2016-06-02 Thread Venkata Balaji N
On Thu, Jun 2, 2016 at 11:43 AM, Jeff Beck wrote: > Hi- > We have a master (pg 9.4.4 on Ubuntu 14.10) and a slave (pg 9.4.8 on > Centos 7). During a period of heavy use, the slave began complaining > that the “requested WAL segment xx has already been removed”. But > the

Re: [GENERAL] After replication failover: could not read block X in file Y read only 0 of 8192 bytes

2016-05-31 Thread Venkata Balaji N
Oops, i missed including pgsql-general in my earlier replies.. > > > I have data_checksums switched on so am suspecting a streaming > > > > > replication bug. Anyone know of a recent bug which could have > caused > > > > > this? > > > > > > > > > > > > > I cannot conclude at this point. I

Re: [GENERAL] Checkpoint Err on Startup of Rsynced System

2016-05-31 Thread Venkata Balaji N
On Wed, Jun 1, 2016 at 3:13 AM, Jim Longwill wrote: > I am trying to setup a 2nd, identical, db server (M2) for development and > I've run into a problem with starting up the 2nd Postgres installation. > > Here's what I've done: > 1) did a 'clone' of 1st (production)

Re: [GENERAL] After replication failover: could not read block X in file Y read only 0 of 8192 bytes

2016-05-31 Thread Venkata Balaji N
On Mon, May 30, 2016 at 11:37 PM, Brian Sutherland wrote: > I'm running a streaming replication setup with PostgreSQL 9.5.2 and have > started seeing these errors on a few INSERTs: > > ERROR: could not read block 8 in file "base/3884037/3885279": read > only 0 of

Re: [GENERAL] postgresql-9.5.3 compilation on Solaris SPARC

2016-05-22 Thread Venkata Balaji N
On Sun, May 22, 2016 at 6:38 PM, Venkata Balaji N <nag1...@gmail.com> wrote: > > On Sun, May 22, 2016 at 1:59 AM, Tom Lane <t...@sss.pgh.pa.us> wrote: > >> Venkata Balaji N <nag1...@gmail.com> writes: >> > On Sat, May 21, 2016 at 1:04 AM, Tom L

Re: [GENERAL] postgresql-9.5.3 compilation on Solaris SPARC

2016-05-22 Thread Venkata Balaji N
Hi Asif, Sorry, i should have responded first. Thanks for inputs and my replies are inline - > Any help would be appreciated. Do i need to give any particular CFLAGS ? >> >> >> Below is the *configure *command - >> >> >> ./configure --prefix=/opt/postgres/9.5.3 CC=/opt/SUNWspro/bin/cc >>

Re: [GENERAL] postgresql-9.5.3 compilation on Solaris SPARC

2016-05-22 Thread Venkata Balaji N
On Sun, May 22, 2016 at 1:59 AM, Tom Lane <t...@sss.pgh.pa.us> wrote: > Venkata Balaji N <nag1...@gmail.com> writes: > > On Sat, May 21, 2016 at 1:04 AM, Tom Lane <t...@sss.pgh.pa.us> wrote: > >> http://www.unix.com/man-page/opensolaris/3c/atomic_cas/ > >

Re: [GENERAL] postgresql-9.5.3 compilation on Solaris SPARC

2016-05-20 Thread Venkata Balaji N
On Sat, May 21, 2016 at 1:04 AM, Tom Lane <t...@sss.pgh.pa.us> wrote: > Venkata Balaji N <nag1...@gmail.com> writes: > > "make" command is generating the following error while compiling > > postgresql-9.5.3 on Solaris SPARC. > > > Undefined

[GENERAL] postgresql-9.5.3 compilation on Solaris SPARC

2016-05-19 Thread Venkata Balaji N
Hi, "make" command is generating the following error while compiling postgresql-9.5.3 on Solaris SPARC. I tried compiling 9.2 and 9.3, works fine. This is only happening on 9.5. ../../src/port/libpgport_srv.a ../../src/common/libpgcommon_srv.a -lnsl -lrt -lsocket -lm -o postgres Undefined

Re: [GENERAL] Connections - Postgres 9.2

2016-05-16 Thread Venkata Balaji N
On Tue, May 17, 2016 at 6:28 AM, Lucas Possamai wrote: > hmm.. thanks for all the answers guys... > > > One more question: Those IDLE connections.. are using the server's > resources? > To solve that problem I would need a Pool connection, right? > > Would the pool

Re: [GENERAL] Streaming replication, master recycling

2016-05-15 Thread Venkata Balaji N
On Sat, May 14, 2016 at 5:38 PM, Venkata Balaji N <nag1...@gmail.com> wrote: > > On Wed, May 11, 2016 at 9:04 PM, <fred...@huitfeldt.com> wrote: > >> I apologise for the missing data. >> >> we are running 9.1.15 on debian servers. >> > > Ther

Re: [GENERAL] tx canceled on standby despite infinite max_standby_streaming_delay

2016-05-14 Thread Venkata Balaji N
On Sat, May 14, 2016 at 12:27 PM, Jay Howard wrote: > I'm seeing long-running transactions (pg_dump) canceled on the standby > when there are a lot of inserts happening on the master. This despite my > having set max_standby_streaming_delay to -1 on the standby. > Do

Re: [GENERAL] Streaming replication, master recycling

2016-05-14 Thread Venkata Balaji N
On Wed, May 11, 2016 at 9:04 PM, wrote: > I apologise for the missing data. > > we are running 9.1.15 on debian servers. > There is a possibility of making the old master standby if you have promoted standby after clean-shutting down the master. I I tested this in 9.2.x

Re: [GENERAL] Streaming replication, master recycling

2016-05-11 Thread Venkata Balaji N
On Wed, May 11, 2016 at 2:31 PM, wrote: > Hi All, > > we are currently using streaming replication on multiple node pairs. We > are seeing some issues, but I am mainly interrested in clarification. > > When a failover occurs, we touch the trigger file, promoting the

Re: [GENERAL] Shipping big WAL archives to hot standby

2016-04-10 Thread Venkata Balaji N
> What would be the effect of suddenly introducing a 1-2 GB of WAL archives > to the WAL restore folder on the slave? Would there be a big performance > effect on the incoming queries to the slave? Would the slave be available > for queries while the WAL logs are restored into the DB? > If the

Re: [GENERAL] Live steraming replication setup issue!

2016-02-22 Thread Venkata Balaji N
On Tue, Feb 23, 2016 at 10:02 AM, Ashish Chauhan wrote: > Thanks Venkata, I am able to setup replication now. Just wondering when I > check replication_delay and lag, I am getting negative number, any idea why? > > > > receive|replay| replication_delay |

Re: [GENERAL] Why is my database so big?

2016-02-21 Thread Venkata Balaji N
On Mon, Feb 22, 2016 at 3:20 PM, Andrew Smith wrote: > Hello, > > I am setting up a proof of concept database to store some historical > data. Whilst I've used PostgreSQL a bit in the past this is the first time > I've looked into disk usage due to the amount of data that

Re: [GENERAL] Live steraming replication setup issue!

2016-02-21 Thread Venkata Balaji N
On Fri, Feb 19, 2016 at 6:24 PM, Ashish Chauhan wrote: > Below is recovery.conf on slave > > > #--- > # STANDBY SERVER PARAMETERS > >

Re: [GENERAL] Live steraming replication setup issue!

2016-02-18 Thread Venkata Balaji N
> > How do I setup replication between DR server and slave server while slave > server and master server are running? I cannot stop master server. Can > someone please guide with steps? > > > Steps are pretty much similar. You can setup replication between slave and DR by using the backup of

Re: [GENERAL] Multiple databases and shared_buffers

2016-02-17 Thread Venkata Balaji N
On Thu, Feb 18, 2016 at 1:54 AM, Data Cruncher wrote: > We will be creating multiple databases in a cluster (instance). Is there > any way to separate shared_buffers for each database? Looks like not since > PG does not allow user created shared buffers. shared_buffers

Re: [GENERAL] pg_restore encounter deadlock since PostgreSQL bringing up

2015-11-16 Thread Venkata Balaji N
On Tue, Nov 17, 2015 at 3:24 PM, zh1029 wrote: > Hi, > > While start PostgreSQL(9.3.6) and execute pg_restore soon after PostgreSQL > bringing up. I encounter pg_restore failure because of deadlock detected. > > postgres[2737]: [3-1] LOG: process 2737 detected deadlock while

Re: [GENERAL] postgres sometimes returns no data

2015-11-12 Thread Venkata Balaji N
On Fri, Nov 13, 2015 at 6:49 AM, db042190 wrote: > Hi. We have a postgres 9.1 query in a pentaho job (table input component > contains the query and is followed by various switches) that runs nightly. > More and more frequently (about half the time now), the query

[GENERAL] Advise on memory usage limitation by PostgreSQL on Windows

2015-09-22 Thread Venkata Balaji N
be upgraded to 9.4.x. After a detailed analysis on memory usage by OS and other processes, is it safe to advise on configuring shared_buffers to 2 GB ? Any advise will be appreciated. Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] Import Problem

2015-09-17 Thread Venkata Balaji N
On Thu, Sep 17, 2015 at 1:27 AM, Ramesh T wrote: > Hi All, >I'm using or2pg tool ,I exported data but I have to change the > schema import to postgres database.exported data more than gb. > Can you please let me know, how to do the change the name in

Re: [GENERAL] avoid lock conflict between SELECT and TRUNCATE

2015-09-10 Thread Venkata Balaji N
need to be careful regarding privileges/grants and dependencies on the table. Or the second approach would be -- Create a table called users_orig from the "users" table and execute SELECT on user_orig table and let the TRUNCATE/data-repopulation operation run on "users" table. This will be a problem if the data is huge. It might take up your hardware resources. Third and simple approach would be to - Execute SELECT and TRUNCATE at different times. All of the above approaches are without considering data-size and other critical aspects of environment, which you need to worry about. Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] Disconnected but query still running

2015-07-13 Thread Venkata Balaji N
not to continue anymore at the database-end, then, you need to manually kill it at the database end too using pg_cancel_backend() or pg_terminate_backend(). Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] pg_xlog on a hot_stanby slave

2015-06-16 Thread Venkata Balaji N
. Do you see master and standby in sync ? You can check that by getting the current pg_xlog position in standby. Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] Missing WALs when doing pg_basebackup from slave...

2015-06-10 Thread Venkata Balaji N
can be advised straight without knowing your replication configuration/architecture details. Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] Queries for unused/useless indexes

2015-05-22 Thread Venkata Balaji N
, indexrelname; Not sure why do you have 200 Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] Strange replication problem - segment restored from archive but still requested from master

2015-05-21 Thread Venkata Balaji N
On Fri, May 22, 2015 at 6:52 AM, Piotr Gasidło qua...@barbara.eu.org wrote: Got strange problem. Unable to repeat, but got logs. Simple master-slave using streaming replication. Master is running. Slave is down. Segment 00044C4D0090 was successfully archived and send from master

Re: [GENERAL] pg_xlog Concern

2015-05-20 Thread Venkata Balaji N
as expected. It is the checkpoint process which cleans up the WAL files from pg_xlog, if that is not happening Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] pg_xlog Concern

2015-05-19 Thread Venkata Balaji N
have ? Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] Standby problem after restore_command Implementation

2015-05-05 Thread Venkata Balaji N
On Tue, May 5, 2015 at 7:57 AM, Edson F. Lidorio ed...@openmailbox.org wrote: On 04-05-2015 00:46, Venkata Balaji N wrote: You do not see the above WAL file in the archive directory ? /mnt/server/archivedir is shared between master and slave databases ? The file may have been removed from

Re: [GENERAL] How to keep pg_largeobject from growing endlessly

2015-04-14 Thread Venkata Balaji N
, then frequent VACUUM FULL is not ideal. Regards, Venkata Balaji N Fujitsu Australia

Re: [GENERAL] Where does vacuum FULL write temp-files?

2015-04-14 Thread Venkata Balaji N
). As VACUUMING is a data change operation, pg_xlog will also have only the WAL data (modifications) written at the time of VACUUMING. http://www.postgresql.org/docs/9.4/static/sql-vacuum.html Regards, Venkata Balaji N Fujitsu Australia