Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Albe Laurenz
Joe Van Dyk wrote: If I run COPY (select * from complicate_view) to stdout on the standby, I've noticed that sometimes halts replication updates to the slave. For example, that's happening right now and now() - pg_last_xact_replay_timestamp() is 22 minutes. There's many transactions per

[GENERAL] AutoVacuum Daemon

2013-12-30 Thread Leonardo M . Ramé
Hi, I want know if I should run the auto-vacuum daemon (from /etc/init.d/) or it runs automatically and transparently if configured in postgres.conf?. If it must be configured manually, what is the script to be run, I didn't find pg_autovacuum or similar. I didn't find information about this on

Re: [GENERAL] AutoVacuum Daemon

2013-12-30 Thread Haribabu kommi
On 30 December 2013 19:11 Leonardo M. Ramé wrote: Hi, I want know if I should run the auto-vacuum daemon (from /etc/init.d/) or it runs automatically and transparently if configured in postgres.conf?. If it must be configured manually, what is the script to be run, I didn't find pg_autovacuum

Re: [GENERAL] AutoVacuum Daemon

2013-12-30 Thread Leonardo M . Ramé
On 2013-12-30 13:45:43 +, Haribabu kommi wrote: On 30 December 2013 19:11 Leonardo M. Ramé wrote: Hi, I want know if I should run the auto-vacuum daemon (from /etc/init.d/) or it runs automatically and transparently if configured in postgres.conf?. If it must be configured manually,

Re: [GENERAL] ON_ERROR_EXIT and interactive mode (or, how to force interactive mode off)

2013-12-30 Thread Tim Kane
Thanks Chris. I didn’t realise psycopg2 had a COPY interface, that’s quite handy. I’ll have a play, cheers. Tim From: Chris Curvey ch...@chriscurvey.com Reply-To: ch...@chriscurvey.com Date: Friday, 27 December 2013 21:18 To: Tim Kane tim.k...@gmail.com Cc: pgsql-general General

[GENERAL] bulk insert unique contraint

2013-12-30 Thread Janek Sendrowski
Hi,   I want to insert data in my table and I want to insert the rows, which don't violates the unique contraint of my id. I'm using a 64bit hash for my it. If I do one insert statement, which inserts many rows it doesn't do anything if one row violates the unique contraint. Is there a faster

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread Andy Colson
On 12/30/2013 8:14 AM, Janek Sendrowski wrote: Hi, I want to insert data in my table and I want to insert the rows, which don't violates the unique contraint of my id. I'm using a 64bit hash for my it. If I do one insert statement, which inserts many rows it doesn't do anything if one row

[GENERAL] postgres for disconnected environment

2013-12-30 Thread Joey Quinn
Most of the installations I have seen reach out to the Internet during the process. How hard is it to build a Postgres installation in a completely isolated environment? I have an internal network with not Internet connectivity that I would like to set up Postgres on. Joey

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread Janek Sendrowski
Hi Salah Jubeh,   My files don't have this format. Could it make sense to create such a file with php and import the data from it? Or ist also possible the get certain rows from the file with regexp?   Janek -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes

Re: [GENERAL] postgres for disconnected environment

2013-12-30 Thread Alvaro Herrera
Joey Quinn escribió: Most of the installations I have seen reach out to the Internet during the process. How hard is it to build a Postgres installation in a completely isolated environment? I have an internal network with not Internet connectivity that I would like to set up Postgres on.

Re: [GENERAL] postgres for disconnected environment

2013-12-30 Thread Adrian Klaver
On 12/30/2013 07:37 AM, Joey Quinn wrote: Most of the installations I have seen reach out to the Internet during the process. How hard is it to build a Postgres installation in a completely isolated environment? I have an internal network with not Internet connectivity that I would like to set

Re: [GENERAL] postgres for disconnected environment

2013-12-30 Thread John R Pierce
On 12/30/2013 7:37 AM, Joey Quinn wrote: Most of the installations I have seen reach out to the Internet during the process. How hard is it to build a Postgres installation in a completely isolated environment? I have an internal network with not Internet connectivity that I would like to set

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread salah jubeh
Hello Janek, which inserts many rows it doesn't do anything if one row violates the unique contraint. You insert your data in a transactional way, this is the default behaviour . To work around it,  do not insert data like INSERT INTO TABLE VALUES (),()...; but INSERT INTO TABLE VALUES ();

[GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Moshe Jacobson
PostgreSQL 9.3.2 I created an extension that owns an event trigger. When I dump the database, it puts the event trigger into the dump output even though it's owned by the extension. When I restore the database, the extension creates the event trigger and the restore causes errors because the

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Tom Lane
Moshe Jacobson mo...@neadwerx.com writes: PostgreSQL 9.3.2 I created an extension that owns an event trigger. When I dump the database, it puts the event trigger into the dump output even though it's owned by the extension. When I restore the database, the extension creates the event trigger

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 12:27 AM, Albe Laurenz laurenz.a...@wien.gv.at wrote: Joe Van Dyk wrote: If I run COPY (select * from complicate_view) to stdout on the standby, I've noticed that sometimes halts replication updates to the slave. For example, that's happening right now and now() -

[GENERAL] what does the error mean?

2013-12-30 Thread AI Rumman
Hi, What does the error message mean? ERROR: unexpected chunk number 1 (expected 2) for toast value 179638221 in pg_toast_16700 Please let me know. Thanks.

Re: [GENERAL] what does the error mean?

2013-12-30 Thread Raghavendra
On Tue, Dec 31, 2013 at 12:20 AM, AI Rumman rumman...@gmail.com wrote: Hi, What does the error message mean? ERROR: unexpected chunk number 1 (expected 2) for toast value 179638221 in pg_toast_16700 Please let me know. Thanks. Well explained here...

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Tom Lane
Moshe Jacobson mo...@neadwerx.com writes: PostgreSQL 9.3.2 I created an extension that owns an event trigger. When I dump the database, it puts the event trigger into the dump output even though it's owned by the extension. When I restore the database, the extension creates the event trigger

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Moshe Jacobson
On Mon, Dec 30, 2013 at 2:02 PM, Tom Lane t...@sss.pgh.pa.us wrote: there seem to be two distinct bugs: CREATE EVENT TRIGGER forgets to mark the event trigger as a member of its extension, and pg_dump doesn't pay any attention anyway when deciding whether to dump the event trigger. I've

Re: [GENERAL] bulk insert unique contraint

2013-12-30 Thread Janek Sendrowski
Hi Salah Jubeh,   I'm not in hurry ;) Thanks for your answer. Thats what I've been searching for.   Janek Sendrwoski -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

[GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Jeff Silberberg
Good afternoon, I moved a number of sites a few months ago to site5 web hosting but have run into an issue where they refuse to include the support for pgsql into the php environment. Although they did try to install it with pecl that failed with no pg_config and missing libpg-fe.h. It

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Scott Marlowe
On Mon, Dec 30, 2013 at 1:20 PM, Jeff Silberberg j...@dapage.net wrote: Good afternoon, I moved a number of sites a few months ago to site5 web hosting but have run into an issue where they refuse to include the support for pgsql into the php environment. Although they did try to

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Raymond O'Donnell
On 30/12/2013 20:28, Scott Marlowe wrote: On Mon, Dec 30, 2013 at 1:20 PM, Jeff Silberberg j...@dapage.net wrote: Good afternoon, I moved a number of sites a few months ago to site5 web hosting but have run into an issue where they refuse to include the support for pgsql into the php

Re: [GENERAL] pg_dump dumps EVENT TRIGGER owned by extension

2013-12-30 Thread Moshe Jacobson
On Mon, Dec 30, 2013 at 2:02 PM, Tom Lane t...@sss.pgh.pa.us wrote: I've committed fixes for these Will these fixes appear in 9.3.3? Thanks. Moshe Jacobson Manager of Systems Engineering, Nead Werx Inc. http://www.neadwerx.com 2323 Cumberland Parkway · Suite 201 · Atlanta, GA 30339

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Joseph Kregloh
I used Site5 for the longest, maybe until 5 or 6 years ago. The problem with shared hosting is that many times they are unwilling to install software because they don't really know what it does or they don't want to support it. Basically they don't want to affect the rest of the server just by

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Gary Chambers
Jeff, Via my post here, I am wondering what others are doing for hosting options that include both wordpress php-pgsql If shared hosting is acceptable for your databases, have you considered a VPS? -- G. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make

Re: [GENERAL] Fwd: Web Hosting support for pgsql in PHP

2013-12-30 Thread Jeff Silberberg
Well, [~]# uname -a Linux s17-dallas.accountservergroup.com 3.2.45-grsec #1 SMP Thu May 23 08:37:40 CDT 2013 x86_64 x86_64 x86_64 GNU/Linux An it's Apache / Wordpress -- All I think they need to to do is pecl install pdo_pgsql-1.0.2 But that looks for pg_config and libpg-fe.hwhich means

Re: [GENERAL] Replication: GZIP compression in WAL sender/receiver processes communication?

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 9, 2013 at 3:13 PM, Dmitry Koterov dmi...@koterov.ru wrote: Is there a way to compress the traffic between master and slave during the replication?.. The streaming gzip would be quite efficient for that. Take a look at the ssh_tunnel.sh [1] tool. This is a wrapper around SSH tunnel

[GENERAL] pgModeler the new Open source data modeling for PostgreSQL

2013-12-30 Thread Raphael Araújo e Silva
Hello guys! I'm here to spread my project called PostgreSQL Database Modeler, or simply, pgModeler. Developed in C++ using the Qt framework the tool is currently in the version 0.6.2. It runs fine on Linux, Windows and MacOS being capable to easily create models and generate SQL scripts in all

[GENERAL] bulk loading table via join of 2 large staging tables

2013-12-30 Thread Seb
Hi, I have two large CSV files that need to be merged and loaded into a single table of a database in Postgresql 9.3. I thought I'd do this by first staging the data in these files in two temporary tables: ---cut here---start-- CREATE

Re: [GENERAL] bulk loading table via join of 2 large staging tables

2013-12-30 Thread David Johnston
Quick thoughts: On both tables: Convert your date-time varchar fields into a single epoch/integer field. Create an index of that epoch/integer field. David J. -- View this message in context:

Re: [GENERAL] bulk loading table via join of 2 large staging tables

2013-12-30 Thread Andrew Sullivan
On Mon, Dec 30, 2013 at 07:53:06PM -0600, Seb wrote: Given that the process involves a full join, I'm not sure I can do this in chunks (say breaking down the files into smaller pieces). Any suggestions would be greatly appreciated. First, what I would probably do is merge the two files outside

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Joe Van Dyk
On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk j...@tanga.com wrote: On Sun, Dec 29, 2013 at 10:52 PM, Sergey Konoplev gray...@gmail.com wrote: On Sun, Dec 29, 2013 at 9:56 PM, Joe Van Dyk j...@tanga.com wrote: On

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 8:56 PM, Joe Van Dyk j...@tanga.com wrote: On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk j...@tanga.com wrote: On Sun, Dec 29, 2013 at 10:52 PM, Sergey Konoplev gray...@gmail.com wrote: On

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Scott Marlowe
On Wed, Dec 18, 2013 at 1:51 PM, Adrian Klaver adrian.kla...@gmail.com wrote: On 12/18/2013 12:15 PM, Joe Van Dyk wrote: A possibly related question: I've set wal_keep_segments to 10,000 and also have archive_command running wal-e. I'm seeing my wal files disappear from pg_xlog after 30

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Joe Van Dyk
On Mon, Dec 30, 2013 at 9:11 PM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 8:56 PM, Joe Van Dyk j...@tanga.com wrote: On Mon, Dec 30, 2013 at 10:27 AM, Sergey Konoplev gray...@gmail.com wrote: On Mon, Dec 30, 2013 at 12:02 AM, Joe Van Dyk j...@tanga.com wrote: On

Re: [GENERAL] Replication failed after stalling

2013-12-30 Thread Sergey Konoplev
On Mon, Dec 30, 2013 at 10:05 PM, Joe Van Dyk j...@tanga.com wrote: I meant all the replication settings, see [1]. And pg_stat_statements when there is a problem, preferable the error, because when everything is okay it is not very useful actually. I don't understand, how is