Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
> 1. Do I need to set up the "/etc/pgbouncer.ini.rpmnew" as > "/etc/pgbouncer.ini" and then change settings in it? What do I change? > How? The FAQ is super geeky and unhelpful. As is the sparse info on > the PG Wiki on pgbouncer. How can I tune pgbouner settings? Just a quick update. By googlin

[GENERAL] Postgres 9.0.4 replication issue: FATAL: requested WAL segment 0000000100000B110000000D has already been removed

2011-11-19 Thread Ashish Gupta
Hi, Database streaming is not taking place. The WAL segment that slave is looking for does not exist on Master. Both Master and Slave are EC2 instances with Postgres version 9.0.04 and Ubuntu 10.04. As per my understanding, DB replication was stalled for around 3 months. On Master new 16 MB WAL i

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Raymond O'Donnell
On 18/11/2011 23:58, Andrus wrote: >> How did you uninstall 8.4? From below it would seem it is still >> around. > > Thank you. After adding -t switch to apt-get I was able to install > 9.1. > > To start it I invoked /etc/init.d/postgresql manually. > > How to force it to start after server is

[GENERAL] Replacement for tgisconstraint? (Upgrade from 8.4 to 9.0.5)

2011-11-19 Thread Ken Tanzer
I just upgraded from Fedora 14 to Fedora 15. (Which is Postgres 8.4.? to 9.0.5) I tried starting Postgres, and then as directed, I installed the postgresql-upgrade package. (My postgresql packages are all current, at version 9.0.5-1.fc15.x86_64) I then ran "service postgresql upgrade", which chug

Re: [GENERAL] Postgres 9.0.4 replication issue: FATAL: requested WAL segment 0000000100000B110000000D has already been removed

2011-11-19 Thread Tomas Vondra
Hi, On 19 Listopad 2011, 10:44, Ashish Gupta wrote: > I searched on various forums, where people encountered similar error, > however in all such issues WAL file existed on Master. In this case Master > is not retaining the WAL file required by the Slave. > > I am unable to understand as to why Ma

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Andrus
To check whether this is the case, look in the appropriate /etc/rc*.d directory for the runlevel you're using, and see if there is an "S" symlink to /etc/init.d/postgresql-9.1 (or something like that) in there. Thank you. There are S18postgresql symlinks in may rc?.d directories. They seems

Re: [GENERAL] Replacement for tgisconstraint? (Upgrade from 8.4 to 9.0.5)

2011-11-19 Thread Tom Lane
Ken Tanzer writes: > 1) Can anyone suggest equivalent PG9 replacement for those statements, or > at least give me some hints? Per http://git.postgresql.org/gitweb/?p=postgresql.git&a=commitdiff&h=9a915e596 I also replaced the tgisconstraint column with tgisinternal; the old mean

Re: [GENERAL] Replacement for tgisconstraint? (Upgrade from 8.4 to 9.0.5)

2011-11-19 Thread Ken Tanzer
Not being the author of that view, I confess some ignorance of pg internals, and just what the intended nuance was. As a little more explanation, the view is meant to list all the tables that have a trigger ending in _alert_notify, as created per this function: CREATE OR REPLACE FUNCTION alert_n

[GENERAL] invalid byte sequence for encoding "UTF8": 0x00

2011-11-19 Thread pawel_kukawski
Hi, Is there any way I can store NULL character (\u) in string ? Or there is only one option that I have change every text field to bytea. Regards, Paweł -- View this message in context: http://postgresql.1045698.n5.nabble.com/invalid-byte-sequence-for-encoding-UTF8-0x00-tp5007173p5007173.

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Adrian Klaver
On Saturday, November 19, 2011 12:20:07 am Phoenix Kiula wrote: > > service postgres start > service pgbouncer start > > > When the two "services" are started like the above, are they working > together? The manual says psql should be restarted with the pgbouncer > port number, for these to be

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Adrian Klaver
On Friday, November 18, 2011 3:58:26 pm Andrus wrote: > >How did you uninstall 8.4? > >From below it would seem it is still around. > > Thank you. > After adding -t switch to apt-get I was able to install 9.1. > > To start it I invoked /etc/init.d/postgresql manually. > > How to force it to sta

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Andrus
Adrian, For tuning tips a good start is: http://wiki.postgresql.org/wiki/Performance_Optimization In particular: http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server For books take a look at: http://www.postgresql.org/docs/books/ thank you very much. Reading them requires lot of time.

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 2:13 AM, Adrian Klaver wrote: > > http://pgbouncer.projects.postgresql.org/doc/config.html > > I have never used pgbouncer, but from above it would seem you need to set up a > [databases] section to tie pgbouncer to the Postgres server. > See: > SECTION [databases] Thank

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 2:39 AM, Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 2:13 AM, Adrian Klaver > wrote: >> >> http://pgbouncer.projects.postgresql.org/doc/config.html >> >> I have never used pgbouncer, but from above it would seem you need to set up >> a >> [databases] section to tie pg

Re: [GENERAL] How could I find the last modified procedure in the database?

2011-11-19 Thread Rob_pg
Try this: select proname,oid, xmin from pg_catalog.pg_proc order by xmin::text desc; regards Robert Bernier > Andreas Kretschmer writes: > > Dhimant Patel wrote: > >> I also created several procedures/functions and now I don't remember the > >> last > >> procedure I worked on! - I thought I

Re: [GENERAL] How could I find the last modified procedure in the database?

2011-11-19 Thread Rob_pg
Correction, try this: select proname,oid, xmin from pg_catalog.pg_proc order by xmin::text::int desc; regards Robert Bernier > Andreas Kretschmer writes: > > Dhimant Patel wrote: > >> I also created several procedures/functions and now I don't remember the last > >> procedure I worked on!

Re: [GENERAL] Huge number of INSERTs

2011-11-19 Thread Phoenix Kiula
On Fri, Nov 18, 2011 at 10:41 AM, Tomas Vondra wrote: > > That has nothing to do with the inserts, it means the number of connection > requests exceeds the max_connections. You've set it to 350, and that seems > too high - the processes are going to struggle for resources (CPU, I/O and > memory) a

[GENERAL] Logging not working

2011-11-19 Thread Phoenix Kiula
Hi. PG 9.0.5, on CentOS 5 with 64 bit. Here's the logging related items from my config file: log_directory = 'pg_log' log_filename= 'pglog.postgresql-%Y-%m-%d_%H%M%S.log' log_rotation_age= 1d log_min_duration_statement = 5000 # In m

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Adrian Klaver
On Saturday, November 19, 2011 10:39:42 am Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 2:13 AM, Adrian Klaver wrote: > > http://pgbouncer.projects.postgresql.org/doc/config.html > > > > I have never used pgbouncer, but from above it would seem you need to set > > up a [databases] section to t

Re: [GENERAL] Logging not working

2011-11-19 Thread Tomas Vondra
On 19 Listopad 2011, 20:29, Phoenix Kiula wrote: > Hi. PG 9.0.5, on CentOS 5 with 64 bit. > > Here's the logging related items from my config file: > > log_directory = 'pg_log' > log_filename= 'pglog.postgresql-%Y-%m-%d_%H%M%S.log' > log_rotation_age

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Adrian Klaver
On Saturday, November 19, 2011 10:36:37 am Andrus wrote: > Adrian, > > >For tuning tips a good start is: > >http://wiki.postgresql.org/wiki/Performance_Optimization > >In particular: > >http://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server > >For books take a look at: > >http://www.postgre

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Adrian Klaver
On Saturday, November 19, 2011 5:34:59 am Andrus wrote: > >To check whether this is the case, look in the appropriate /etc/rc*.d > > directory for the runlevel you're using, and see if there is an "S" > symlink to /etc/init.d/postgresql-9.1 (or something like that) in there. > > Thank you. >

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Andrus
From here(look familiar): http://wiki.postgresql.org/wiki/Performance_Optimization http://linuxfinances.info/info/quickstart.html http://www.westnet.com/~gsmith/content/postgresql/pg-5minute.htm Thank you. I tried # sysctl -w kernel.shmmax=419430400 kernel.shmmax = 419430400 # sysctl -n kernel.

Re: [GENERAL] Huge number of INSERTs

2011-11-19 Thread Tomas Vondra
On 19 Listopad 2011, 20:27, Phoenix Kiula wrote: > On Fri, Nov 18, 2011 at 10:41 AM, Tomas Vondra wrote: >> >> That has nothing to do with the inserts, it means the number of >> connection >> requests exceeds the max_connections. You've set it to 350, and that >> seems >> too high - the processes

Re: [GENERAL] How to install latest stable postgresql on Debian

2011-11-19 Thread Scott Marlowe
2011/11/19 Andrus : >> From here(look familiar): >> http://wiki.postgresql.org/wiki/Performance_Optimization >> http://linuxfinances.info/info/quickstart.html >> http://www.westnet.com/~gsmith/content/postgresql/pg-5minute.htm > > Thank you. > I tried > > # sysctl -w kernel.shmmax=419430400 > kerne

Re: [GENERAL] Is it ever necessary to vacuum a table that only gets inserts/updates?

2011-11-19 Thread Gavin Flower
On 19/11/11 11:32, Adam Cornett wrote: On Fri, Nov 18, 2011 at 2:56 PM, Gavin Flower mailto:gavinflo...@archidevsys.co.nz>> wrote: On 18/11/11 04:59, Tom Lane wrote: Craig Ringermailto:ring...@ringerc.id.au>> writes: On Nov 17, 2011 1:32 PM, "Tom Lane"mailto:t...@s

Re: [GENERAL] Huge number of INSERTs

2011-11-19 Thread Phoenix Kiula
On Sat, Nov 19, 2011 at 1:29 AM, Steve Crawford wrote: > On 11/18/2011 04:30 AM, Phoenix Kiula wrote: >> >> On Fri, Nov 18, 2011 at 9:25 AM, Steve Crawford >>  wrote: >> >> Database only? Or is it also your webserver? >> >> It's my webserver and DB. Webserver is nginx, proxying all PHP >> re

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 3:35 AM, Adrian Klaver wrote: > > Well in the .ini file you posted there is no [databases] section. From what I > read lack of one would explain the problem you are seeing. Yes. Because that's private to post on a public mailing list like this. Here's my INI file below,

Re: [GENERAL] Is it ever necessary to vacuum a table that only gets inserts/updates?

2011-11-19 Thread Scott Marlowe
On Sat, Nov 19, 2011 at 12:53 PM, Gavin Flower wrote: > On 19/11/11 11:32, Adam Cornett wrote: > > On Fri, Nov 18, 2011 at 2:56 PM, Gavin Flower > wrote: >> >> On 18/11/11 04:59, Tom Lane wrote: >>> >>> Craig Ringer  writes: On Nov 17, 2011 1:32 PM, "Tom Lane"  wrote: > > If it'

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Adrian Klaver
On Saturday, November 19, 2011 2:44:04 pm Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 3:35 AM, Adrian Klaver wrote: > > Well in the .ini file you posted there is no [databases] section. From > > what I read lack of one would explain the problem you are seeing. > > Yes. Because that's private

Re: [GENERAL] Logging not working

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 3:38 AM, Tomas Vondra wrote: > > What about log_destination and log_collector? Thanks. This was it! Much appreciated. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Amitabh Kant
On Sun, Nov 20, 2011 at 4:14 AM, Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 3:35 AM, Adrian Klaver > wrote: > > [databases] > MYDB = host=127.0.0.1 dbname=MYDB user=MYUSER client_encoding=utf8 > port=5432 > > ;; Configuation section > [pgbouncer] > logfile = /var/log/pgbouncer.log > pidfile

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 8:08 AM, Adrian Klaver wrote: > > You have pgbouncer listening on 127.0.0.1. In your psql connection string you > are not specifying a host, so if you are on a Unix platform it is trying to > connect to a socket which would account for the error. I found when working > wit

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 10:33 AM, Amitabh Kant wrote: > > I am assuming the difference in the port numbers between your config file > and php code is a typing error. > Does the auth file (/var/lib/pgsql/pgbouncer.txt) contain valid login > credentials to your database? If I remember correctly, it

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Adrian Klaver
On Saturday, November 19, 2011 6:35:11 pm Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 8:08 AM, Adrian Klaver wrote: > > You have pgbouncer listening on 127.0.0.1. In your psql connection string > > you are not specifying a host, so if you are on a Unix platform it is > > trying to connect to a

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 10:37 AM, Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 10:33 AM, Amitabh Kant wrote: >> >> I am assuming the difference in the port numbers between your config file >> and php code is a typing error. >> Does the auth file (/var/lib/pgsql/pgbouncer.txt) contain valid logi

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 10:51 AM, Adrian Klaver wrote: > > I don't see a user specified. You sure you are connecting as correct user? > Remember absent a -U the user will be either your system user name or what is > specified in a ENV variable. Adrian, all this is not helping. To be sure, I tri

Re: [GENERAL] Huge number of INSERTs

2011-11-19 Thread Tomas Vondra
Dne 19.11.2011 23:34, Phoenix Kiula napsal(a): > On Sat, Nov 19, 2011 at 1:29 AM, Steve Crawford > wrote: >> You still didn't answer what "massive traffic" means. > > > Thousands of website hits per minute. (At peak time) > > Average is a few hundred per minute. This is pretty vague descriptio

Re: [GENERAL] Huge number of INSERTs

2011-11-19 Thread Tomas Vondra
Dne 18.11.2011 13:30, Phoenix Kiula napsal(a): > Full DB: 32GB > The big table referenced above: 28 GB > > It's inserts into this one that are taking time. Hm, in that case the shared_buffers is probably too low. It'd be nice to have at least the indexes on the table in the buffers, an

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Tomas Vondra
Dne 20.11.2011 04:21, Phoenix Kiula napsal(a): >> tail -4 /var/log/pgbouncer.log > 2011-11-19 22:16:49.139 26439 WARNING server login failed: FATAL > password authentication failed for user "MYDB_MYDB" > 2011-11-19 22:16:49.139 26439 LOG S-0x15b61fe0: > MYDB/MYDB_MYDB@127.0.0.1:5432 closing because

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Amitabh Kant
On Sun, Nov 20, 2011 at 12:12 PM, Tomas Vondra wrote: > Dne 20.11.2011 04:21, Phoenix Kiula napsal(a): > > My guess is that you actually require a password when connecting to the > database, but you haven't specified a password in the pgbouncer.ini > file. You have to specify it in the MYDB line

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 1:57 PM, Amitabh Kant wrote: > > On Sun, Nov 20, 2011 at 12:12 PM, Tomas Vondra wrote: >> >> Dne 20.11.2011 04:21, Phoenix Kiula napsal(a): >> >> My guess is that you actually require a password when connecting to the >> database, but you haven't specified a password in t

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 2:16 PM, Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 1:57 PM, Amitabh Kant wrote: >> >> On Sun, Nov 20, 2011 at 12:12 PM, Tomas Vondra wrote: >>> >>> Dne 20.11.2011 04:21, Phoenix Kiula napsal(a): >>> >>> My guess is that you actually require a password when connectin

Re: [GENERAL] Performance degradation 8.4 -> 9.1

2011-11-19 Thread Joseph S
More info: I upgraded the database from 8.4 to 9.1 using pg_upgrade, so I have no way of running explain using 8.4. I don't want to do an EXPLAIN ANALYZE because it would bog down the server for too long. I know what it is doing, it's doing a seqscan. This is a table with ~ 5.5 million rows

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Amitabh Kant
On Sun, Nov 20, 2011 at 12:02 PM, Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 2:16 PM, Phoenix Kiula > wrote: > > On Sun, Nov 20, 2011 at 1:57 PM, Amitabh Kant > wrote: > >> > >> On Sun, Nov 20, 2011 at 12:12 PM, Tomas Vondra wrote: > >>> > >>> Dne 20.11.2011 04:21, Phoenix Kiula napsal(a):

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 2:45 PM, Amitabh Kant wrote: > On Sun, Nov 20, 2011 at 12:02 PM, Phoenix Kiula > wrote: > > Just a trial: try password without quotes in your pgbouncer config file. > That's how I have specified in mine, and it is working. Already done. Same problem. -- Sent via pgsql-

Re: [GENERAL] Installed. Now what?

2011-11-19 Thread Phoenix Kiula
On Sun, Nov 20, 2011 at 2:32 PM, Phoenix Kiula wrote: > On Sun, Nov 20, 2011 at 2:16 PM, Phoenix Kiula > wrote: >> On Sun, Nov 20, 2011 at 1:57 PM, Amitabh Kant wrote: >>> >>> On Sun, Nov 20, 2011 at 12:12 PM, Tomas Vondra wrote: Dne 20.11.2011 04:21, Phoenix Kiula napsal(a): >