Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Andy Erskine
Hi, So the basebackup pulls the data directory over from the master. I am pulling over anther copy of the data directory using basebackup On 07/01/2015 05:51 PM, Andy Erskine wrote: > If i grep for errors i get some invalid page header in block 56072 of > relation base/16385/77373 errors. > >

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Adrian Klaver
On 07/01/2015 05:51 PM, Andy Erskine wrote: If i grep for errors i get some invalid page header in block 56072 of relation base/16385/77373 errors. But not sure what else to look for ? Well the above seems to be the smoking gun. You have a corrupted $DATA directory in the standby and the WAL

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Andy Erskine
If i grep for errors i get some invalid page header in block 56072 of relation base/16385/77373 errors. But not sure what else to look for ? On 2 July 2015 at 10:41, Adrian Klaver wrote: > On 07/01/2015 05:20 PM, Andy Erskine wrote: > >> I initially populated the directory using basebackup and

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Adrian Klaver
On 07/01/2015 05:20 PM, Andy Erskine wrote: I initially populated the directory using basebackup and pulled the data directory across from the master. So what does the standby log show? On 2 July 2015 at 10:13, Adrian Klaver mailto:adrian.kla...@aklaver.com>> wrote: On 07/01/2015 05:04

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Andy Erskine
I initially populated the directory using basebackup and pulled the data directory across from the master. On 2 July 2015 at 10:13, Adrian Klaver wrote: > On 07/01/2015 05:04 PM, Andy Erskine wrote: > >> the cmd you listed did work it didn't like the -d option >> >> however on the master : >> >>

Re: [GENERAL] Error message in Pgpool repmgr cluster

2015-07-01 Thread Adrian Klaver
On 07/01/2015 01:13 PM, shibly wrote: Hi, We have configured PostgreSQL cluster with repmgr 3.0.1 and PgPool2 3.2 on Ubuntu 14.04. Now we are getting the following error messages in the log file. ERROR: duplicate key value violates unique constraint "pk_os_currentstep" ERROR: cached plan must

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Adrian Klaver
On 07/01/2015 05:04 PM, Andy Erskine wrote: the cmd you listed did work it didn't like the -d option however on the master : data]$ du -h 7.9M./pg_clog 168K./pg_subtrans 232K./pg_multixact/members 120K./pg_multixact/offsets 356K./pg_multixact 12K ./pg_notify 1.9G./pg

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Andy Erskine
the cmd you listed did work it didn't like the -d option however on the master : data]$ du -h 7.9M./pg_clog 168K./pg_subtrans 232K./pg_multixact/members 120K./pg_multixact/offsets 356K./pg_multixact 12K ./pg_notify 1.9G./pg_log 127G./base/16385 6.3M./base/12865

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Joshua D. Drake
On 07/01/2015 02:59 PM, Scott Marlowe wrote: postgresql. When I try via terminal apt-get install postgresql-9.3 there are the same messages about postgresql-common (>= 142~) ... defect packages ... This isn't really a postgresql problem this is a problem with an ubuntu machine with a broken

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Scott Marlowe
On Wed, Jul 1, 2015 at 3:05 AM, Urs Berner wrote: > Am 01.07.2015 um 09:08 schrieb Charles Clavadetscher: >> >> Hello Urs >> >> I could install PostgreSQL 9.4 on Ubuntu 14.04 without adding repositories >> (actually it was an upgrade and I had to move the data manually from 9.3 to >> 9.4). You may

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Jan de Visser
On July 1, 2015 02:51:37 PM Urs G. Berner wrote: > Am 01.07.15 um 14:08 schrieb Jan de Visser: > > On July 1, 2015 07:39:59 AM Urs Berner wrote: > . > . > > > I would uninstall the stock (Ubuntu) version before installing the pgdg > > version. > > There is no postgresql at all installed - nor can

[GENERAL] Running PostgreSQL with ZFS ZIL

2015-07-01 Thread Joseph Kregloh
We recently built a new server for our Production database. The machine is top of the line with 128GB of RAM, dual E5-2650. We also included NVME drives for ZIL and L2ARC. Currently we have 3 zpools. First one holds the FreeBSD install. Second holds the jails, and third holds all of the database da

[GENERAL] Error message in Pgpool repmgr cluster

2015-07-01 Thread shibly
Hi, We have configured PostgreSQL cluster with repmgr 3.0.1 and PgPool2 3.2 on Ubuntu 14.04. Now we are getting the following error messages in the log file. ERROR: duplicate key value violates unique constraint "pk_os_currentstep" ERROR: cached plan must not change result type Any suggestion

Re: [GENERAL] Text to interval conversion can silently truncate data

2015-07-01 Thread Tom Lane
Jack Christensen writes: > jack=# select '1.51 years'::interval = '1.52 years'::interval; > ?column? > -- > t > (1 row) > This is surprising. Once I looked at the C code for Interval it makes > more sense given that it cannot represent fractional years, months, or > days. Wouldn't i

[GENERAL] Text to interval conversion can silently truncate data

2015-07-01 Thread Jack Christensen
jack=# select '1.51 years'::interval = '1.52 years'::interval; ?column? -- t (1 row) This is surprising. Once I looked at the C code for Interval it makes more sense given that it cannot represent fractional years, months, or days. Wouldn't it make more sense to raise an invalid input

Re: [GENERAL] Which replication is the best for our case ?

2015-07-01 Thread Arthur Silva
On Wed, Jul 1, 2015 at 7:08 AM, ben.play wrote: > In fact, the cron job will : > -> select about 10 000 lines from a big table (>100 Gb of data). 1 user has > about 10 lines. > -> each line will be examinate by an algorithm > -> at the end of each line, the cron job updates a few parameters for t

Re: [GENERAL] Which replication is the best for our case ?

2015-07-01 Thread John R Pierce
On 7/1/2015 3:08 AM, ben.play wrote: In fact, the cron job will : -> select about 10 000 lines from a big table (>100 Gb of data). 1 user has about 10 lines. -> each line will be examinate by an algorithm -> at the end of each line, the cron job updates a few parameters for the user (add some poi

Re: [GENERAL] Systemd vs logging collector

2015-07-01 Thread Tom Lane
Andomar writes: > Thanks for your reply, log_destination is set to "stderr". And > logging_collector is "on". > On CentOS, this results in regular Postgres log files. On Arch Linux, > the results end up in the system journal. It looks like the Postgres > logging collector somehow misses out

Re: [GENERAL] Systemd vs logging collector

2015-07-01 Thread Adrian Klaver
On 07/01/2015 05:26 AM, Andomar wrote: are you just missing this parameter: #log_destination = 'stderr' # Valid values are combinations of # stderr, csvlog, syslog, and eventlog, # depending on platform

Re: [GENERAL] Systemd vs logging collector

2015-07-01 Thread Adrian Klaver
On 07/01/2015 12:22 AM, Andomar wrote: In Arch Linux, Postgres is started by systemd. If you configure logging_collector in postgresql.conf this has no effect. All of the logging output is send to the journal, where you can read it with “journalctl -u postgresql”. The configuration for system

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Adrian Klaver
On 07/01/2015 05:51 AM, Urs G. Berner wrote: Am 01.07.15 um 14:08 schrieb Jan de Visser: On July 1, 2015 07:39:59 AM Urs Berner wrote: . . I would uninstall the stock (Ubuntu) version before installing the pgdg version. There is no postgresql at all installed - nor can I install the stock no

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Adrian Klaver
On 07/01/2015 06:24 AM, Andy Erskine wrote: CCing list Yes that's configured on the master So the segments would pile up there not on the standby. You do not say what OS you are using, but if it is a Unixen variation, then run: du -h on the master and standby directories to see where the

Re: [GENERAL] Streaming Questions and Sizing

2015-07-01 Thread Adrian Klaver
On 06/30/2015 09:14 PM, Andy Erskine wrote: I have db of 123GB Currently and this is streaming to a secondary DB which also shows a size of 123GB (Using pgAdmin) The db's both reside on a 250GB directorys and on the Master i'm using 60% of capacity which seems expected On the secondary i am usin

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Urs G. Berner
Am 01.07.15 um 14:08 schrieb Jan de Visser: > On July 1, 2015 07:39:59 AM Urs Berner wrote: . . > I would uninstall the stock (Ubuntu) version before installing the pgdg > version. > There is no postgresql at all installed - nor can I install the stock nor the pgdg version -- Sent via pgsql

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Charles Clavadetscher
I need to check that when I get home. Suddendly I have the impression that I may have added a repository to check 9.4 before it was released. I will get back at that if nobody else can offer a solution, but it may take some time. Bye Charles > -Original Message- > From: pgsql-general-ow

Re: [GENERAL] Systemd vs logging collector

2015-07-01 Thread Andomar
are you just missing this parameter: #log_destination = 'stderr' # Valid values are combinations of # stderr, csvlog, syslog, and eventlog, # depending on platform. csvlog

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Jan de Visser
On July 1, 2015 07:39:59 AM Urs Berner wrote: > I installed Ubuntu 14.04 LTS > apg-get update ... apt-get upgrade ... > > and looked at > www.postgresql.org/download/linux/ubuntu > then added apt repository /etc/apt/sources.list.d/pgdg.list > > When I try > > apt-get install postgresql-9.4 > >

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Urs Berner
Am 01.07.2015 um 09:08 schrieb Charles Clavadetscher: Hello Urs I could install PostgreSQL 9.4 on Ubuntu 14.04 without adding repositories (actually it was an upgrade and I had to move the data manually from 9.3 to 9.4). You may want to try it that way? Bye Charles the Ubuntu-Software Cente

[GENERAL] Strange situation on slave server

2015-07-01 Thread Condor
Hello, I have master - slave replication hot standby. Both server are linux slackware64 current with postgresql 9.4.4. Today when I logged to check some things on slave server I see on top memory taken 26%. That was strange for me and I restart server. Well, I checked after 40 minute and I s

Re: [GENERAL] Which replication is the best for our case ?

2015-07-01 Thread ben.play
In fact, the cron job will : -> select about 10 000 lines from a big table (>100 Gb of data). 1 user has about 10 lines. -> each line will be examinate by an algorithm -> at the end of each line, the cron job updates a few parameters for the user (add some points for example) -> Then, it inserts

Re: [GENERAL] very slow queries and ineffective vacuum

2015-07-01 Thread Sameer Kumar
On Wed, Jul 1, 2015 at 4:51 AM Pavel Stehule wrote: > Hi > > What is an output of VACUUM VERBOSE statement? > > VACUUM can be blocked by some forgotten transaction. Check your > pg_stat_activity table for some old process in "idle in transaction" state. > Then connection should not be reused, and

Re: [GENERAL] very slow queries and ineffective vacuum

2015-07-01 Thread Sameer Kumar
On Wed, Jul 1, 2015 at 3:37 AM Lukasz Wrobel < lukasz.wro...@motorolasolutions.com> wrote: > Hello. > > I have multiple problems with my database, the biggest of which is how to > find out what is actually wrong. > > First of all I have a 9.3 postgres database that is running for about a > month.

Re: [GENERAL] Systemd vs logging collector

2015-07-01 Thread Marc Mamin
> -Original Message- > From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general- > ow...@postgresql.org] On Behalf Of Andomar > Sent: Mittwoch, 1. Juli 2015 09:22 > To: pgsql-general@postgresql.org > Subject: [GENERAL] Systemd vs logging collector > > In Arch Linux, Postgres is sta

Re: [GENERAL] how to extract the page "address" from the ctid

2015-07-01 Thread Marc Mamin
> -Original Message- > From: Michael Paquier [mailto:michael.paqu...@gmail.com] > Sent: Mittwoch, 1. Juli 2015 07:05 > To: Marc Mamin > Cc: Postgres General > Subject: Re: [GENERAL] how to extract the page "address" from the ctid > > On Tue, Jun 30, 2015 at 10:56 PM, Marc Mamin > wrote:

[GENERAL] Systemd vs logging collector

2015-07-01 Thread Andomar
In Arch Linux, Postgres is started by systemd. If you configure logging_collector in postgresql.conf this has no effect. All of the logging output is send to the journal, where you can read it with “journalctl -u postgresql”. The configuration for systemd contains a StandardError option. I’ve t

Re: [GENERAL] Ubuntu 14.04 LTS install problem

2015-07-01 Thread Charles Clavadetscher
Hello Urs I could install PostgreSQL 9.4 on Ubuntu 14.04 without adding repositories (actually it was an upgrade and I had to move the data manually from 9.3 to 9.4). You may want to try it that way? Bye Charles > -Original Message- > From: pgsql-general-ow...@postgresql.org [mailto:pg