Re: [GENERAL] An example needed for Serializable conflict...

2009-07-07 Thread Andres Freund
Hi durumdara, On Tuesday 07 July 2009 12:10:52 durumdara wrote: Another question if I use only SELECTS can I get some Serialization Error? No. For example: I need a report tool that can show the actual state of the business. Because of I use value-dependent logic, I MUST use consistent

Re: [GENERAL] SELECT DISTINCT very slow

2009-07-09 Thread Andres Freund
On Thursday 09 July 2009 17:09:13 Ben Harper wrote: Hi, Can anybody explain this: Records: 600,000 Field Width: Approximately 20 UTF8 characters - type is VARCHAR(25) Field is Indexed. SELECT DISTINCT field FROM table; Takes about 6 seconds. There are 111 distinct items. On Sqlite, and

Re: [GENERAL] is autovacuum recommended?

2009-07-09 Thread Andres Freund
Hi, On Thursday 09 July 2009 19:25:15 Willy-Bas Loos wrote: Whenever i start a big action, like inserting millions of recs or doing a large update, the autovacuum fires on top of that. You can configure autovacuum to use less resources.

Re: [GENERAL] How can I find out the space used on disk for a table/index

2009-07-12 Thread Andres Freund
On Sunday 12 July 2009 21:07:56 Viktor Rosenfeld wrote: Hi, I want to judge the performance gain of additional indexes against the space they consume on disk. Currently I do a VACUUM FULL ANALYZE and then take the space used by the base directory and do some calculations. This is time

Re: [GENERAL] Best practices for moving UTF8 databases

2009-07-13 Thread Andres Freund
On Sunday 12 July 2009 13:19:50 Phoenix Kiula wrote: Hi. I *always* get an error moving my current fully utf-8 database data into a new DB. My server has the version 8.3 with a five year old DB. Everything, all collation, LC_LOCALE etc are all utf8. When I install a new Postgresql 8.4 on my

Re: [GENERAL] Best practices for moving UTF8 databases

2009-07-14 Thread Andres Freund
On Tuesday 14 July 2009 11:36:57 Jasen Betts wrote: On 2009-07-13, Andres Freund and...@anarazel.de wrote: On Sunday 12 July 2009 13:19:50 Phoenix Kiula wrote: Hi. I *always* get an error moving my current fully utf-8 database data into a new DB. My server has the version 8.3

Re: [GENERAL] Best practices for moving UTF8 databases

2009-07-14 Thread Andres Freund
On Tuesday 14 July 2009 15:52:29 Alvaro Herrera wrote: Andres Freund wrote: On Tuesday 14 July 2009 11:36:57 Jasen Betts wrote: if you do an ascii dump and the dump starts out SET CLIENT ENCODING 'UTF8' or similar but you still get errors. Do you mean that a dump from SQL_ASCII can

Re: [GENERAL] overwrite the encoding of a database

2009-07-16 Thread Andres Freund
On Thursday 16 July 2009 10:53:37 Massa, Harald Armin wrote: Hello, I have an old PostgreSQL Database which was created with encoding = SQL_ASCII. That is an old sin of mine; 9years ago I did not know better. Now I know better than to use SQL_ASCII. On the bright side: I am totally sure

Re: [GENERAL] Using the GEQO

2009-07-16 Thread Andres Freund
On Thursday 16 July 2009 09:02:53 Ms swati chande wrote: 1. Since the value of geqo_threshold is12, does the geqo get automatically activated for queries with 12 or more joins? No, not directly. It will get used for 12 joins with no predefined order. This is a bit complicated by the fact

Re: [GENERAL] [PERFORM] Incr/Decr Integer

2009-07-16 Thread Andres Freund
On Thursday 16 July 2009 19:56:47 William Scott Jordan wrote: Hey all! Is there a better way to increase or decrease the value of an integer than doing something like: --- UPDATE the_table SET the_int = the_int + 1 WHERE the_id = 123 ; --- We seem to be getting a lot of deadlocks using

Re: [GENERAL] [PERFORM] Incr/Decr Integer

2009-07-16 Thread Andres Freund
On Thursday 16 July 2009 23:20:34 William Scott Jordan wrote: Hi Andrew, That's a very good guess. We are in fact updating this table multiple times within the same triggered function, which is being called on an INSERT. Essentially, we're using this to keep a running total of the number

Re: [GENERAL] Query with rightmost function does not use index

2011-08-08 Thread Andres Freund
Hi, On Monday, August 08, 2011 15:40:20 - - wrote: explain analyze select * from filter_item where filter_hash = MD5(''); QUERY PLAN

Re: [GENERAL] are there any methods to disable updating index before inserting large number tuples?

2011-11-22 Thread Andres Freund
Hi, On Tuesday 22 Nov 2011 19:01:02 John R Pierce wrote: On 11/22/11 7:52 AM, Andrew Sullivan wrote: But I think performance on that table is going to be pretty bad. I suspect that COPY is going to be your friend here. indeed. 20M rows/hour is 5500 rows/second. you'd better have a

Re: [GENERAL] Enumeration of tables is very slow in largish database

2012-01-11 Thread Andres Freund
On Wednesday, January 11, 2012 11:07:23 AM Kirill Müller wrote: Hi all, we have a Postgres/PostGIS database with 100+ schemas and 200+ tables in each schema, generated automatically. When adding a new PostGIS layer in QGis, the application obviously enumerates all tables, and this takes

Re: [GENERAL] Enumeration of tables is very slow in largish database

2012-01-11 Thread Andres Freund
On Wednesday, January 11, 2012 02:53:06 PM Guillaume Lelarge wrote: On Wed, 2012-01-11 at 14:44 +0100, Andres Freund wrote: On Wednesday, January 11, 2012 11:07:23 AM Kirill Müller wrote: Hi all, we have a Postgres/PostGIS database with 100+ schemas and 200+ tables in each schema

Re: [GENERAL] High checkpoint_segments

2012-02-15 Thread Andres Freund
On Wednesday, February 15, 2012 10:38:23 AM Venkat Balaji wrote: On Wed, Feb 15, 2012 at 12:21 PM, Scott Marlowe scott.marl...@gmail.comwrote: On Tue, Feb 14, 2012 at 10:57 PM, Venkat Balaji venkat.bal...@verse.in all of these 1000 files get filled up in less than 5 mins, there are

Re: [GENERAL] Problem with reading data from standby server ?

2012-04-21 Thread Andres Freund
On Friday, April 20, 2012 10:39:25 AM Condor wrote: array_accumulate aggregate is: CREATE AGGREGATE array_accumulate ( sfunc = array_append, basetype = anyelement, stype = anyarray, initcond = '{}' ); Btw, if you replace that by array_agg which is builtin in any

Re: [GENERAL][postgis-users] pg_dump -s should use add_geometrycolumn(...)

2012-08-29 Thread Andres Freund
with postgres 2 anymore as far as I understand things? Greetings, Andres -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your

Re: [GENERAL][postgis-users] pg_dump -s should use add_geometrycolumn(...)

2012-08-29 Thread Andres Freund
On Wednesday, August 29, 2012 05:41:07 PM Willy-Bas Loos wrote: On Wed, Aug 29, 2012 at 5:23 PM, Andres Freund and...@2ndquadrant.comwrote: That shouldn't be a problem with postgres 2 anymore as far as I understand things? Argh, postgis 2. Two things: * the geometry_columns table

Re: [GENERAL][postgis-users] pg_dump -s should use add_geometrycolumn(...)

2012-08-29 Thread Andres Freund
On Wednesday, August 29, 2012 06:02:24 PM Tom Lane wrote: Andres Freund and...@2ndquadrant.com writes: On Wednesday, August 29, 2012 04:44:14 PM Willy-Bas Loos wrote: pg_dump -s should use add_geometrycolumn(...) instead of creating a column+constraints with normal DDL Because, when you

Re: [GENERAL] More buffers used than a relation's relpages

2013-06-04 Thread Andres Freund
value? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [HACKERS] [GENERAL] Insert result does not match record count

2013-07-24 Thread Andres Freund
afterwards since the values will be about as bogus. I am more worried about code that does range checks like java's string conversion routines... I think fixing this for 9.4 is fine, but due to the compat issues I think it's to late for 9.3. Greetings, Andres Freund -- Andres Freund

Re: [GENERAL] Speed up Switchover

2013-07-26 Thread Andres Freund
need d) and e) anymore and you can replace it with a regular promotion which will be noticeably faster. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list

Re: [GENERAL] Bottlenecks with large number of relation segment files

2013-08-05 Thread Andres Freund
. That limit is about max_user_watches, not the general cost of an fd. Afair they take up a a good more than that. Also, there are global limits to the amount of filehandles that can simultaneously opened on a system. Greetings, Andres Freund -- Andres Freund http://www

Re: [HACKERS] [GENERAL] Bottlenecks with large number of relation segment files

2013-08-06 Thread Andres Freund
On 2013-08-06 19:19:41 +0900, KONDO Mitsumasa wrote: (2013/08/05 21:23), Tom Lane wrote: Andres Freund and...@2ndquadrant.com writes: ... Also, there are global limits to the amount of filehandles that can simultaneously opened on a system. Yeah. Raising max_files_per_process puts

Re: [GENERAL] Read data from WAL

2013-08-09 Thread Andres Freund
me the time it takes to patch Postgres to do that. There's an in-development project doing that... Submitted to the last commitfests and all. Search for changeset extraction et al. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL

Re: [GENERAL] v9.3.0: bug with pgdump -s?

2013-09-15 Thread Andres Freund
follow the public rules. The likely reason you're seing the problem with the opclasses being output incompletely is that internal entries don't all have full dependency information. What did you actually try to find out? Greetings, Andres Freund -- Andres Freund http://www

Re: [GENERAL] v9.3.0: bug with pgdump -s?

2013-09-15 Thread Andres Freund
On 2013-09-15 15:24:57 -0400, Eric B. Ridge wrote: On 09/15/2013 02:11 PM, Andres Freund wrote: What did you actually try to find out? Greetings, Andres Freund I was just trying to mentally sync up http://www.postgresql.org/docs/9.3/static/xindex.html with (more) concrete examples

Re: [GENERAL] upgrade from 9.2.x to 9.3 causes significant performance degradation

2013-09-17 Thread Andres Freund
chance you compile with --enable-cassert or somesuch? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes

Re: [GENERAL] GIN fast update technique and work_mem

2013-10-24 Thread Andres Freund
, which one is it - work_mem or maintenance_work_mem? Or are these things unrelated? Yes. One is about the initial index creation, the other about insertions into an existing index. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development

Re: [GENERAL] Will modifications to unlogged tables also be flused to disk?

2014-02-15 Thread Andres Freund
unlogged tables are modified? No fsyncs will be issued in the common paths, and they won't be written to disk by !shutdown checkpoints. But they *will* be written to disk if there's not enough space in shared_buffers for all the data. Greetings, Andres Freund -- Andres Freund

Re: [GENERAL] checkpoints/bgwriter tuning verification

2009-11-20 Thread Andres Freund
On Friday 30 October 2009 15:30:34 Vick Khera wrote: I really don't think I'm saturating the disk bandwidth. I see spikes of 18MB/s or more, but it usually hovers at under 3MB/s according to iostat output. Looking at the iostat -x output is often more interesting - especially the utilization

Re: [GENERAL] PostgreSQL Write Performance

2010-01-05 Thread Andres Freund
Hi, On Tuesday 05 January 2010 04:36:10 Yan Cheng Cheok wrote: I make the following single write operation through pgAdmin : ... It takes 16ms to write a single row according to Query Editor (bottom right corner) In my experience the times presented by pgadmin vary wildly and seldomly do

Re: [GENERAL] ERROR row is too big size 9336, exceeds size 8160 when populating record with tsquery and tsvector fields

2010-11-18 Thread Andres Freund
On Thursday 18 November 2010 05:37:51 Allan Kamau wrote: Hi, I am experiencing the row is too big error (with postgreSQL-9.0.1) when populating a table having a tsquery and tsvector fields. Are fields of tsquery and tsvector datatypes affected by this row size restriction? Looks like you

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Andres Freund
Hi, On Saturday, February 26, 2011 12:11:19 AM Gary Fu wrote: wal_buffers = 16MB sensible checkpoint_segments = 256 A setting that high seems unlikely to be beneficial... I suggest you configure log_checkpoints to monitor this. effective_cache_size = 30GB Not likely to matter in this case.

Re: [GENERAL] slow building index and reference after Sybase to Pg

2011-02-28 Thread Andres Freund
Hi, On Wednesday 23 February 2011 19:31:58 Gary Fu wrote: I'm testing on converting a big Sybase db to Pg. It took about 45 hours to convert all sybase tables (bcp) to Pg (copy) without index and reference. After that I built the index (one by one, sequentially) and it took about 25 hours

Re: [GENERAL] Poor performance of btrfs with Postgresql

2011-04-21 Thread Andres Freund
On Thursday, April 21, 2011 12:16:04 PM Henry C. wrote: I've done some testing of PostgreSQL on different filesystems, and with different filesystem mount options. Since Pg is already journalling, why bother duplicating (and pay the performance penalty, whatever that penalty may be) the

Re: [GENERAL] New feature: skip row locks when table is locked.

2011-04-29 Thread Andres Freund
On Thursday, April 28, 2011 11:44:37 PM Jeff Davis wrote: On Thu, 2011-04-28 at 07:29 +0200, pasman pasmański wrote: Hi. Yesterday i have an idea, that sometimes row locks may be skipped, when table is already locked with LOCK command. It may to reduce an overhead from row locks. What do

Re: [GENERAL] pervasiveness of surrogate (also called synthetic) keys

2011-05-02 Thread Andres Freund
On Thursday, April 28, 2011 08:31:09 PM Scott Ribe wrote: Well, natural keys are quite obviously the way to go, when they exist. The problem is, they usually don't really exist. What's usually proposed as a natural key, will upon further investigation, either not be guaranteed unique, or not

Re: [GENERAL] Configure Postgres From SQL

2010-07-12 Thread Andres Freund
On Monday 12 July 2010 15:29:14 Tom Wilcox wrote: Hi, Is it possible to configure postgres from SQL? I am interested in turning off fsync for a set of queries (that take ages to run) and then turn fsync back on again afterwards. disabling fsync is nearly never a good idea. What you can

Re: [GENERAL] Need help in reclaiming disk space by deleting the selected records

2012-09-14 Thread Andres Freund
btw. These days VACUUM FULL does the same thing CLUSTER does just without sorting. Greetings, Andres -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org

Re: [GENERAL] Memory issues

2012-09-27 Thread Andres Freund
process for connection: Cannot allocate memory* could not fork new process for connection: Cannot allocate memory and execute failed: ERROR: out of memory DETAIL: Failed on request of size 968. [for Statement SELECT DISTINCT could you show cat /proc/meminfo? Greetings, Andres -- Andres

Re: [GENERAL] Unexplained Major Vacuum Archive Activity During Vacuum

2012-11-03 Thread Andres Freund
to do. Thats not really possible with freeze vacuums. When the table is older than the applicable freeze age its scanned completely instead of only the parts that are sensible according to the vacuum map. The more expensive scans really only happen when they make sense... Andres -- Andres

Re: [GENERAL] Comparing txid_current() to xmin

2012-11-07 Thread Andres Freund
On Tue, Nov 06, 2012 at 02:55:40PM -0800, Mike Lewis wrote: I am trying to make a trigger that updates a row once and only once per transaction (even if this trigger gets fired multiple times). The general idea is that for a user we have a version number. When we modify the user's data, the

Re: [GENERAL] Comparing txid_current() to xmin

2012-11-08 Thread Andres Freund
On Thu, Nov 08, 2012 at 11:47:37AM +0200, Marko Kreen wrote: On Wed, Nov 7, 2012 at 10:21 AM, Andres Freund and...@anarazel.de wrote: On Tue, Nov 06, 2012 at 02:55:40PM -0800, Mike Lewis wrote: I am trying to make a trigger that updates a row once and only once per transaction (even

Re: [GENERAL] Does PostgreSQL have complete functional test cases?

2012-11-08 Thread Andres Freund
On 2012-11-08 10:47:18 -0800, Tianyin Xu wrote: (p.s., in the default configuration, all the test suites are passed.) What did you change? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services

Re: [GENERAL] Revoke drop database even for superusers?

2012-11-09 Thread Andres Freund
to copy that database not only its owner/superuser. I think there might be even more unexpected consequences of playing that trick. Greetings, Andres Freund -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [GENERAL] 'alternatives'

2012-11-28 Thread Andres Freund
13))) Check the first item of http://www.postgresql.org/docs/current/interactive/release-9-2.html#AEN110503 Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing

Re: [GENERAL] 'alternatives'

2012-11-28 Thread Andres Freund
can be pessimal in comparison to a explicit check if only a few values come in, so this can be checked at runtime after the above commit... Greetings, Andres Freund -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] unlooged tables

2012-12-07 Thread Andres Freund
records in the table while changing to unlogged. Nope, thats not enough, won't create the init fork, so your next restart will probably fail. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services

Re: [GENERAL] Default timezone changes in 9.1

2012-12-16 Thread Andres Freund
to be functional again. Setting the timezone to 'localtime' seems to work as well, even without a patch. I haven't found any documentation about it and I am not completely sure about the semantics, but it looks ok on a first glance. Greetings, Andres Freund -- Andres Freund

Re: [GENERAL] Default timezone changes in 9.1

2012-12-16 Thread Andres Freund
On 2012-12-16 12:25:13 -0500, Tom Lane wrote: Andres Freund and...@2ndquadrant.com writes: Setting the timezone to 'localtime' seems to work as well, even without a patch. I haven't found any documentation about it and I am not completely sure about the semantics, but it looks ok on a first

Re: [GENERAL] Simple Query Very Slow

2012-12-22 Thread Andres Freund
- that's still sub-second performance (0.176s). Is that explain from the correct table? According to the results there are but 53 thousand rows in it, not anywhere near 5 million. Well, thats the estimate *after* applying the restriction, so that seems sensible. Greetings, Andres Freund

Re: [GENERAL] how to completely disable toasted table in postgresql and best practices to follow

2013-04-05 Thread Andres Freund
such issues. Why do you want to do that? It is not possible to completely disable the usage of toast tables, but maybe explaining the real reason of you wanting that helps us to give you another solution. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com

Re: [GENERAL] how to completely disable toasted table in postgresql and best practices to follow

2013-04-05 Thread Andres Freund
On 2013-04-05 15:53:40 +0200, Szymon Guz wrote: On 5 April 2013 15:49, Andres Freund and...@2ndquadrant.com wrote: On 2013-04-05 18:32:47 +0530, Zahid Quadri wrote: Dear admin, please help me i want to completely disable Toasted tables in postgresql as per your suggestion i have

Re: [GENERAL] Segmentation fault with core dump

2013-04-10 Thread Andres Freund
) q Could you show the output of 'bt full'? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your

Re: [GENERAL] Segmentation fault with core dump

2013-04-10 Thread Andres Freund
and then do 'print *portal'? Thanks, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] Segmentation fault with core dump

2013-04-10 Thread Andres Freund
printtup_prepare_info won't normally be called in an held cursor. But if some concurrent DDL changed the number of columns in typeinfo vs thaose in the the receiver that could explain the issue and why its not seen all the time, right? Greetings, Andres Freund -- Andres Freund http

Re: [GENERAL] Segmentation fault with core dump

2013-04-10 Thread Andres Freund
; then the second query executes with a portal (and resource owner) created to execute the FETCH command, not directly on the held portal. But in that path CurrentResourceOwner gets reset to portal-resowner as well (see PortalRunFetch())? Greetings, Andres Freund -- Andres Freund

Re: [GENERAL] Segmentation fault with core dump

2013-04-10 Thread Andres Freund
printtup_prepare_info(myState, typeinfo, natts); (gdb) print *myState, *myState-attrinfo, *typeinfo value has been optimized out Hm. Make that a print *(DR_printtup *) self print *((DR_printtup *) self)-attrinfo print *slot-tts_tupleDescriptor then. Thanks, Andres Freund -- Andres Freund

Re: [GENERAL] Segmentation fault with core dump

2013-04-10 Thread Andres Freund
protocol Execute command against a pre-existing portal. (I had thought psqlOBC went through libpq, but maybe it's playing some games here.) Hm. PQexecPrepared() looks like it can do that. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL

Re: [GENERAL] Segmentation fault with core dump

2013-04-10 Thread Andres Freund
On 2013-04-10 19:29:06 -0400, Tom Lane wrote: Andres Freund and...@2ndquadrant.com writes: On 2013-04-10 19:06:12 -0400, Tom Lane wrote: And the answer is they're not testing this code path at all, because if you do DECLARE c CURSOR WITH HOLD FOR ... FETCH ALL FROM c; then the second

Re: [GENERAL] Segmentation fault with core dump

2013-04-12 Thread Andres Freund
, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Negative replication lag?

2013-04-22 Thread Andres Freund
in that time. Given the short timeframe it only happens every now and then. Did you check the pg_stat_replication view on the primary? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent

Re: [GENERAL] Replication terminated due to PANIC

2013-04-25 Thread Andres Freund
Freund in the end of the discussion. The issues don't look related. Three weeks have passed after I installed the patched version and it looks like the patch fixed my issue. Oh, cool! Thanks for verifying. Greetings, Andres Freund -- Andres Freund http://www

Re: [GENERAL] Toast and slice of toast

2014-02-17 Thread Andres Freund
will solve your problem. Note that you need to prevent your type/column from being compressed for that being effective. Check the storage options for CREATE TABLE et al. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support

Re: [GENERAL] hot standby data folder bigger than primary

2014-04-17 Thread Andres Freund
multitransaction data used for shared row locks. Is there some process that can clean these two folder when the lock is not needed? Which version are you using? that might be recently (9.3.2 and corresponding releases) fixed problem. Greetings, Andres Freund -- Andres Freund

Re: [GENERAL] a row not deletes

2014-04-27 Thread Andres Freund
(Consider using an AFTER trigger instead of a BEFORE trigger to propagate changes to other rows.))); Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list

Re: [GENERAL] C++, Postgres , libpqxx huge query

2014-05-04 Thread Andres Freund
is very slow (due to swapping I guess). Is there any way to tell the C++ to load rows at batches, without waiting the entire dataset? With Java I never had these issues before, due to the probably better JDBC driver. Try looking into either using a serverside cursor or COPY. Greetings, Andres Freund

Re: [GENERAL] Shared memory changes in 9.4?

2014-05-26 Thread Andres Freund
what may have changed? I suspect the solution here is tweaking some LXC setting, but I was hoping someone can point me in the right direction. It sounds like you're not allowing posix shared memory. Possibly just by not mounting /dev/shm. Greetings, Andres Freund -- Andres Freund

Re: [GENERAL] Backups over slave instead master?

2014-05-29 Thread Andres Freund
, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql

Re: [GENERAL] out of memory errors

2014-06-16 Thread Andres Freund
contents? My guess is that the CommitLimit is too low... Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes

Re: [GENERAL] pg_restore: custom archiver unexpected end of file , ERROR: missing data for column

2014-06-17 Thread Andres Freund
the transfer of the existing dump file. Any chance there was windows in the mix somewhere? IIRC there were bugs with large dumps there for a while... Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training

Re: [GENERAL] Repeated semop calls

2014-06-27 Thread Andres Freund
If it is what I am guessing at, then the top anonymous address is probably coming from LWLockAcquire, and those are coming from HeapTupleSatisfiesMVCC. I don't know how to verify that, though. Recompile postgres with -fno-omit-frame-pointers and use perf record -g. Greetings, Andres Freund

Re: [GENERAL] Bi-Directional replication client awareness

2014-07-12 Thread Andres Freund
supported by BDR today. The more complex thing is support for performing transactions that, when the COMMIT returns successfully, can't have conflicts. That's *not* yet supported, but we're thinking of implementing it for individual transactions. Greetings, Andres Freund -- Andres Freund

Re: [GENERAL] Bi-Directional replication client awareness

2014-07-12 Thread Andres Freund
On 2014-07-12 13:23:08 +0200, Martin Gudmundsson wrote: 12 jul 2014 kl. 12:33 skrev Andres Freund and...@2ndquadrant.com: On 2014-07-12 18:22:30 +0800, Craig Ringer wrote: On 07/12/2014 02:24 PM, Martin Gudmundsson wrote: Any ideas giving BDR an option to be synchronous. I mean

Re: [GENERAL] Bi-Directional replication client awareness

2014-07-12 Thread Andres Freund
(CAP theorem et al) to make that generally useful/applicable. I think we (as in postgres) will probably get the ability to run individual transactions in such a mode, but you surely wouldn't want to run every transaction in it. Greetings, Andres Freund -- Andres Freund http

Re: [GENERAL] We've been affected by a pg_upgrade bug. What do we do next?

2014-07-16 Thread Andres Freund
, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql

Re: [GENERAL] WAL receive process dies

2014-08-29 Thread Andres Freund
connects to the right postgres instance? Did you possibly have a failover or something like that? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql

Re: [GENERAL] WAL receive process dies

2014-08-29 Thread Andres Freund
'. Could you run, on the standby that's having problems, the following command: psql 'host=127.0.0.1 port=5445 user=XXX password=XXX' -c 'IDENTIFY_SYSTEM;' Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training

Re: [GENERAL] BDR DML Only

2014-09-16 Thread Andres Freund
missing DDL on the slave. As Christoph wrote this pretty much is already possible. Even if it could be prettier. What I'd like to know is what the exact use case you want it for is. Could you quickly explain? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com

Re: [GENERAL] BDR Error recovery

2014-09-16 Thread Andres Freund
pg_replication_identifier_advance(). Which requires some fiddling around. It's on our roadmap to make a) skipping the replication of a transaction easier b) allow to skip individual problematic actions in a transaction Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com

Re: [GENERAL] BDR DML Only

2014-09-16 Thread Andres Freund
to replicate these. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [GENERAL] BDR DML Only

2014-09-16 Thread Andres Freund
valuable. Cool! Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] pg_multixact issues

2014-09-17 Thread Andres Freund
On 2014-09-17 17:46:05 +0530, Dev Kumkar wrote: On one my machine the pg_multixact directory size has grown up to 5 GB and am not sure how to clean up this directory. Which version of postgres are you using? Greetings, Andres Freund -- Andres Freund http://www

Re: [GENERAL] [SQL] pg_multixact issues

2014-09-18 Thread Andres Freund
of 'SELECT oid, datname, relfrozenxid, age(relfrozenxid), relminmxid FROM pg_database;'? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] [SQL] pg_multixact issues

2014-09-19 Thread Andres Freund
On 2014-09-18 22:52:57 +0530, Dev Kumkar wrote: On Thu, Sep 18, 2014 at 6:20 PM, Dev Kumkar devdas.kum...@gmail.com wrote: On Thu, Sep 18, 2014 at 4:03 PM, Andres Freund and...@2ndquadrant.com wrote: I don't think that's relevant for you. Did you upgrade the database using

Re: [GENERAL] fmgr_oldstyle in extensions

2014-09-23 Thread Andres Freund
think we should get rid of v0 functions. I've seen errors like this far too many, and they really don't buy us much. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general

Re: [GENERAL] BDR Global Sequences

2014-09-30 Thread Andres Freund
planning to add that. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] Integrating C++ singletons into postgresql extensions???

2014-10-18 Thread Andres Freund
*great* care that exception, *NEVER* permeate through postgres code. Doing so will cause bad things. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list

Re: [GENERAL] pg killed by oom-killer, invalid contrecord length 2190 at A6C/331AAA90 on slaves

2014-10-28 Thread Andres Freund
the problem. Is this something that was fixed in 9.3.5? We have really no information to answer that question accurately. So you really need to provide logs and such. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support

[GENERAL] Re: [BUGS] [HACKERS] COPY TO returning empty result with parallel ALTER TABLE

2014-11-04 Thread Andres Freund
hangups to keep all the necessary tuples + ctid chains around. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes

Re: [GENERAL] recovering from too many failures wal error

2014-12-01 Thread Andres Freund
around checkpoints - you could force one by manually issuing a 'CHECKPOINT;' statement. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] PG94RC1- plv8 functions - problem with input parameter length

2014-12-01 Thread Andres Freund
/postgres -D ... You should compile postgres with --enable-cassert to debug. Other wierd thing problem hapens just if input parametar length is 200-255. 256 work fine. That sounds a bit like it might be toast related. Maybe plv8's parameter handling isn't entirely correct? Greetings, Andres Freund

Re: [GENERAL] bdr_init_copy fails when starting 2nd BDR node

2014-12-30 Thread Andres Freund
indicates that it tries to connect to port 5432 on localhost - but the copy was taken from 'main_node_ip'. Perhaps you forgot to specify th ehost in the config? What does 'git describe --tags' return? Greetings, Andres Freund -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] bdr_init_copy fails when starting 2nd BDR node

2014-12-31 Thread 'Andres Freund'
configuration it has to be primary_replica_local_dsn. Could you a) try to explicitly set unix_socket_directory=/tmp in postgresql.conf and host=/tmp in the above config? Also, please attach postgresql.conf. Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com

Re: [GENERAL] BDR Error restarted

2015-01-20 Thread Andres Freund
Hi, On 2015-01-13 02:43:26 -0700, deans wrote: Hi Craig, any insight on this issue? :) You've, afaics, not posted your configuration. Could you do so? Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training

Re: [GENERAL] BDR Monitoring, missing pg_stat_logical_decoding view

2015-02-18 Thread Andres Freund
to install/create that view? It has been renamed since - it's part of postgresql 9.4 and named pg_replication_slots. It seems most of the page refers to it by the correct name, just a subsection doesn't... Sorry for that. Greetings, Andres Freund -- Andres Freund http://www

Re: [GENERAL] Logical decoding output plug-in questions

2015-01-26 Thread Andres Freund
the replication slot is being created and false otherwise. parameteroptions/parameter points to a struct of options that output plugins can set: Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services

Re: [GENERAL] Logical decoding output plug-in questions

2015-01-26 Thread Andres Freund
On 2015-01-26 15:35:39 -0800, Christophe Pettus wrote: On Jan 26, 2015, at 2:24 PM, Andres Freund and...@2ndquadrant.com wrote: What's in the old tuple depends on the configured replica identity. My apologies, but... configured replica identity? Search for postgres and replica identity

  1   2   3   >