Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 10:05 PM, Joe Van Dyk wrote: >> I meant all the replication settings, see [1]. And pg_stat_statements >> when there is a problem, preferable the error, because when everything >> is okay it is not very useful actually. > > I don't understand, how is pg_stat_statements helpf

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Joe Van Dyk
On Mon, Dec 30, 2013 at 9:11 PM, Sergey Konoplev wrote: > On Mon, Dec 30, 2013 at 8:56 PM, Joe Van Dyk wrote: > > On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev > wrote: > >> On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk wrote: > >> > On Sun, Dec 29, 2013 at 10:52 PM, Sergey Konoplev > >>

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Scott Marlowe
On Wed, Dec 18, 2013 at 1:51 PM, Adrian Klaver wrote: > On 12/18/2013 12:15 PM, Joe Van Dyk wrote: >> >> A possibly related question: >> >> I've set wal_keep_segments to 10,000 and also have archive_command >> running wal-e. I'm seeing my wal files disappear from pg_xlog after 30 >> minutes. Is th

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 8:56 PM, Joe Van Dyk wrote: > On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev wrote: >> On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk wrote: >> > On Sun, Dec 29, 2013 at 10:52 PM, Sergey Konoplev >> > wrote: >> >> On Sun, Dec 29, 2013 at 9:56 PM, Joe Van Dyk wrote: >>

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Joe Van Dyk
On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev wrote: > On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk wrote: > > On Sun, Dec 29, 2013 at 10:52 PM, Sergey Konoplev > wrote: > >> On Sun, Dec 29, 2013 at 9:56 PM, Joe Van Dyk wrote: > >> > On Wed, Dec 18, 2013 at 3:39 PM, Sergey Konoplev > >>

Re: [GENERAL] bulk loading table via join of 2 large staging tables

2013-12-30 Thread Andrew Sullivan
On Mon, Dec 30, 2013 at 07:53:06PM -0600, Seb wrote: > Given that the process involves a full join, I'm not sure I can do this > in chunks (say breaking down the files into smaller pieces). Any > suggestions would be greatly appreciated. First, what I would probably do is merge the two files outsi

Re: [GENERAL] bulk loading table via join of 2 large staging tables

2013-12-30 Thread David Johnston
Quick thoughts: On both tables: Convert your date-time varchar fields into a single epoch/integer field. Create an index of that epoch/integer field. David J. -- View this message in context: http://postgresql.1045698.n5.nabble.com/bulk-loading-table-via-join-of-2-large-staging-tables-tp57

[GENERAL] bulk loading table via join of 2 large staging tables

2013-12-30 Thread Seb
Hi, I have two large CSV files that need to be merged and loaded into a single table of a database in Postgresql 9.3. I thought I'd do this by first staging the data in these files in two temporary tables: ------ CREATE TEMPORA

[GENERAL] pgModeler the new Open source data modeling for PostgreSQL

2013-12-30 Thread Raphael Araújo e Silva
Hello guys! I'm here to spread my project called PostgreSQL Database Modeler, or simply, pgModeler. Developed in C++ using the Qt framework the tool is currently in the version 0.6.2. It runs fine on Linux, Windows and MacOS being capable to easily create models and generate SQL scripts in all ve

Re: [GENERAL] Replication: GZIP compression in WAL sender/receiver processes communication?

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 9, 2013 at 3:13 PM, Dmitry Koterov wrote: > Is there a way to compress the traffic between master and slave during the > replication?.. The streaming gzip would be quite efficient for that. Take a look at the ssh_tunnel.sh [1] tool. This is a wrapper around SSH tunnel with compression

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Jeff Silberberg
Well, [~]# uname -a Linux s17-dallas.accountservergroup.com 3.2.45-grsec #1 SMP Thu May 23 08:37:40 CDT 2013 x86_64 x86_64 x86_64 GNU/Linux An it's Apache / Wordpress -- All I think they need to to do is pecl install pdo_pgsql-1.0.2 But that looks for pg_config and libpg-fe.hwhich means ins

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Gary Chambers
Jeff, Via my post here, I am wondering what others are doing for hosting options that include both wordpress & php-pgsql If shared hosting is acceptable for your databases, have you considered a VPS? -- G. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make change

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Joseph Kregloh
I used Site5 for the longest, maybe until 5 or 6 years ago. The problem with shared hosting is that many times they are unwilling to install software because they don't really know what it does or they don't want to support it. Basically they don't want to affect the rest of the server just by help

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Moshe Jacobson
On Mon, Dec 30, 2013 at 2:02 PM, Tom Lane wrote: > I've committed fixes for these Will these fixes appear in 9.3.3? Thanks. Moshe Jacobson Manager of Systems Engineering, Nead Werx Inc. 2323 Cumberland Parkway · Suite 201 · Atlanta, GA 30339 "Quality is not an act

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Raymond O'Donnell
On 30/12/2013 20:28, Scott Marlowe wrote: > On Mon, Dec 30, 2013 at 1:20 PM, Jeff Silberberg wrote: >> >> >> Good afternoon, >> >> I moved a number of sites a few months ago to site5 web hosting but >> have run into an issue where they refuse to include the support for pgsql >> into the php

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Scott Marlowe
On Mon, Dec 30, 2013 at 1:20 PM, Jeff Silberberg wrote: > > > Good afternoon, > > I moved a number of sites a few months ago to site5 web hosting but > have run into an issue where they refuse to include the support for pgsql > into the php environment. Although they did try to install it w

[GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Jeff Silberberg
Good afternoon, I moved a number of sites a few months ago to site5 web hosting but have run into an issue where they refuse to include the support for pgsql into the php environment. Although they did try to install it with pecl that failed with no pg_config and missing libpg-fe.h. It app

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread Janek Sendrowski
Hi Salah Jubeh,   I'm not in hurry ;) Thanks for your answer. Thats what I've been searching for.   Janek Sendrwoski -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Moshe Jacobson
On Mon, Dec 30, 2013 at 2:02 PM, Tom Lane wrote: > there seem to be two distinct bugs: CREATE EVENT TRIGGER forgets > to mark the event trigger as a member of its extension, and pg_dump > doesn't pay any attention anyway when deciding whether to dump the event > trigger. I've committed fixes for

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Tom Lane
Moshe Jacobson writes: > PostgreSQL 9.3.2 > I created an extension that owns an event trigger. > When I dump the database, it puts the event trigger into the dump output > even though it's owned by the extension. > When I restore the database, the extension creates the event trigger and > the rest

Re: [GENERAL] what does the error mean?

2013-12-30 Thread Raghavendra
On Tue, Dec 31, 2013 at 12:20 AM, AI Rumman wrote: > Hi, > > What does the error message mean? > > ERROR: unexpected chunk number 1 (expected 2) for toast value 179638221 > in pg_toast_16700 > > Please let me know. > > Thanks. > Well explained here... http://www.databasesoup.com/2013/10/de-cor

[GENERAL] what does the error mean?

2013-12-30 Thread AI Rumman
Hi, What does the error message mean? ERROR: unexpected chunk number 1 (expected 2) for toast value 179638221 in pg_toast_16700 Please let me know. Thanks.

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 12:27 AM, Albe Laurenz wrote: > Joe Van Dyk wrote: >> If I run "COPY (select * from complicate_view) to stdout" on the standby, >> I've noticed that sometimes >> halts replication updates to the slave. >> >> For example, that's happening right now and "now() - >> pg_last_

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Tom Lane
Moshe Jacobson writes: > PostgreSQL 9.3.2 > I created an extension that owns an event trigger. > When I dump the database, it puts the event trigger into the dump output > even though it's owned by the extension. > When I restore the database, the extension creates the event trigger and > the rest

[GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Moshe Jacobson
PostgreSQL 9.3.2 I created an extension that owns an event trigger. When I dump the database, it puts the event trigger into the dump output even though it's owned by the extension. When I restore the database, the extension creates the event trigger and the restore causes errors because the event

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread salah jubeh
>>Hello Janek, >>>which inserts many rows it doesn't do anything if one row violates the >>>unique contraint. >>You insert your data in a transactional way, this is the default behaviour . >>To work around it,  do not insert data like >>INSERT INTO VALUES (),()...; >>but >>INSERT INTO VALUES

Re: [GENERAL] postgres for disconnected environment

2013-12-30 Thread John R Pierce
On 12/30/2013 7:37 AM, Joey Quinn wrote: Most of the installations I have seen reach out to the Internet during the process. How hard is it to build a Postgres installation in a completely isolated environment? I have an internal network with not Internet connectivity that I would like to set u

Re: [GENERAL] postgres for disconnected environment

2013-12-30 Thread Adrian Klaver
On 12/30/2013 07:37 AM, Joey Quinn wrote: Most of the installations I have seen reach out to the Internet during the process. How hard is it to build a Postgres installation in a completely isolated environment? I have an internal network with not Internet connectivity that I would like to set up

Re: [GENERAL] postgres for disconnected environment

2013-12-30 Thread Alvaro Herrera
Joey Quinn escribió: > Most of the installations I have seen reach out to the Internet during the > process. How hard is it to build a Postgres installation in a completely > isolated environment? I have an internal network with not Internet > connectivity that I would like to set up Postgres on.

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread Janek Sendrowski
Hi Salah Jubeh,   My files don't have this format. Could it make sense to create such a file with php and import the data from it? Or ist also possible the get certain rows from the file with regexp?   Janek -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes t

[GENERAL] postgres for disconnected environment

2013-12-30 Thread Joey Quinn
Most of the installations I have seen reach out to the Internet during the process. How hard is it to build a Postgres installation in a completely isolated environment? I have an internal network with not Internet connectivity that I would like to set up Postgres on. Joey

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread Andy Colson
On 12/30/2013 8:14 AM, Janek Sendrowski wrote: Hi, I want to insert data in my table and I want to insert the rows, which don't violates the unique contraint of my id. I'm using a 64bit hash for my it. If I do one insert statement, which inserts many rows it doesn't do anything if one row viol

[GENERAL] bulk insert unique contraint

2013-12-30 Thread Janek Sendrowski
Hi,   I want to insert data in my table and I want to insert the rows, which don't violates the unique contraint of my id. I'm using a 64bit hash for my it. If I do one insert statement, which inserts many rows it doesn't do anything if one row violates the unique contraint. Is there a faster way

Re: [GENERAL] ON_ERROR_EXIT and interactive mode (or, how to force interactive mode off)

2013-12-30 Thread Tim Kane
Thanks Chris. I didn’t realise psycopg2 had a COPY interface, that’s quite handy. I’ll have a play, cheers. Tim From: Chris Curvey Reply-To: Date: Friday, 27 December 2013 21:18 To: Tim Kane Cc: pgsql-general General Subject: Re: [GENERAL] ON_ERROR_EXIT and interactive mode (or, how to

Re: [GENERAL] AutoVacuum Daemon

2013-12-30 Thread Leonardo M . Ramé
On 2013-12-30 13:45:43 +, Haribabu kommi wrote: > On 30 December 2013 19:11 Leonardo M. Ramé wrote: > > Hi, I want know if I should run the auto-vacuum daemon (from > > /etc/init.d/) or it runs automatically and transparently if configured > > in postgres.conf?. If it must be configured manuall

Re: [GENERAL] AutoVacuum Daemon

2013-12-30 Thread Haribabu kommi
On 30 December 2013 19:11 Leonardo M. Ramé wrote: > Hi, I want know if I should run the auto-vacuum daemon (from > /etc/init.d/) or it runs automatically and transparently if configured > in postgres.conf?. If it must be configured manually, what is the > script to be run, I didn't find pg_autovacu

[GENERAL] AutoVacuum Daemon

2013-12-30 Thread Leonardo M . Ramé
Hi, I want know if I should run the auto-vacuum daemon (from /etc/init.d/) or it runs automatically and transparently if configured in postgres.conf?. If it must be configured manually, what is the script to be run, I didn't find pg_autovacuum or similar. I didn't find information about this on t

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Albe Laurenz
Joe Van Dyk wrote: > If I run "COPY (select * from complicate_view) to stdout" on the standby, > I've noticed that sometimes > halts replication updates to the slave. > > For example, that's happening right now and "now() - > pg_last_xact_replay_timestamp()" is 22 minutes. > There's many transac