Re: [HACKERS] Is there a good reason we don't have INTERVAL 'infinity'?

2011-11-03 Thread kris
On 2 November 2011 16:35, Brar Piening b...@gmx.de wrote: See http://de.wikipedia.org/wiki/Unendlichkeit#Analysis (Sorry for linking the german wikipedia - the english text is ways less verbose on this.) Google Translate has come a very long way. I can read that whole section easily with my

Re: [HACKERS] Multiple queries in transit

2011-11-03 Thread Marko Kreen
On Mon, Oct 31, 2011 at 7:09 PM, Tom Lane t...@sss.pgh.pa.us wrote: Heikki Linnakangas heikki.linnakan...@enterprisedb.com writes: On 31.10.2011 17:44, Mark Hills wrote: Could libpq be reasonably modified to allow this? I believe it's doable in theory, no-one has just gotten around to it.

Re: [HACKERS] Range Types - typo + NULL string constructor

2011-11-03 Thread Heikki Linnakangas
On 17.10.2011 01:09, Jeff Davis wrote: On Sat, 2011-10-15 at 01:46 +0300, Heikki Linnakangas wrote: * Do we really need non_empty(anyrange) ? You can just do NOT empty(x) To make it a searchable (via GiST) condition, I need an operator. I could either remove that operator (as it's not

Re: [HACKERS] pg_upgrade if 'postgres' database is dropped

2011-11-03 Thread Bruce Momjian
Robert Haas wrote: On Wed, Nov 2, 2011 at 8:31 PM, Bruce Momjian br...@momjian.us wrote: Robert Haas wrote: If nobody objects, I'll go do that. ?Hopefully that should be enough to put this problem to bed more or less permanently. All right, I've worked up a (rather boring and

Re: [HACKERS] Re: [COMMITTERS] pgsql: Reduce checkpoints and WAL traffic on low activity database serv

2011-11-03 Thread Simon Riggs
On Thu, Nov 3, 2011 at 12:21 AM, Greg Smith g...@2ndquadrant.com wrote: With some trivial checkpoints containing a small amount of data skipped now, aren't there some cases where less WAL data will be written than before?  In that case, the user visible behavior here would be different.  I'd

Re: [HACKERS] heap vacuum cleanup locks

2011-11-03 Thread Simon Riggs
On Sun, Jun 5, 2011 at 4:03 AM, Robert Haas robertmh...@gmail.com wrote: We've occasionally seen problems with VACUUM getting stuck for failure to acquire a cleanup lock due to, for example, a cursor holding a pin on the buffer page.  In the worst case, this can cause an undetected deadlock,

Re: [HACKERS] Re: [COMMITTERS] pgsql: Reduce checkpoints and WAL traffic on low activity database serv

2011-11-03 Thread Robert Haas
On Wed, Nov 2, 2011 at 8:21 PM, Greg Smith g...@2ndquadrant.com wrote: In cases where there are little or no writes to the WAL, checkpoints will be skipped even if checkpoint_timeout has passed.  At least one new WAL segment must have been created before an automatic checkpoint occurs.  The

Re: GiST for range types (was Re: [HACKERS] Range Types - typo + NULL string constructor)

2011-11-03 Thread Heikki Linnakangas
On 03.11.2011 10:42, Jeff Davis wrote: On Wed, 2011-11-02 at 22:59 +0200, Heikki Linnakangas wrote: This seems to be coming from the selectivity estimation function. The selectivity function for@ is scalargtsel, which is usually used for scalar and=. That doesn't seem right. But what do we

Re: [HACKERS] heap vacuum cleanup locks

2011-11-03 Thread Robert Haas
On Thu, Nov 3, 2011 at 7:15 AM, Simon Riggs si...@2ndquadrant.com wrote: A while back, someone (Greg Stark? me?) floated the idea of not waiting for the cleanup lock.  If we can't get it immediately, or within some short period of time, then we just skip the page and continue on. Separately,

Re: [HACKERS] heap vacuum cleanup locks

2011-11-03 Thread Simon Riggs
On Thu, Nov 3, 2011 at 1:26 PM, Robert Haas robertmh...@gmail.com wrote: I think that should be OK, but: - It looks to me like you haven't done anything about the second heap pass.  That should probably get a similar fix. I was assuming this worked with Pavan's patch to remove second pass.

Re: [HACKERS] removing =(text, text) in 9.2

2011-11-03 Thread Dimitri Fontaine
Robert Haas robertmh...@gmail.com writes: Hmm, I was kind of expecting that to be wrong at least in some minor way. +/* contrib/hstore/hstore-1.0-1.1.sql */ + +-- complain if script is sourced in psql, rather than via CREATE EXTENSION +\echo Use ALTER EXTENSION hstore to load this file.

Re: [HACKERS] heap vacuum cleanup locks

2011-11-03 Thread Robert Haas
On Thu, Nov 3, 2011 at 9:52 AM, Simon Riggs si...@2ndquadrant.com wrote: On Thu, Nov 3, 2011 at 1:26 PM, Robert Haas robertmh...@gmail.com wrote: I think that should be OK, but: - It looks to me like you haven't done anything about the second heap pass.  That should probably get a similar

Re: [HACKERS] Your review of pg_receivexlog/pg_basebackup

2011-11-03 Thread Magnus Hagander
On Tue, Nov 1, 2011 at 05:53, Fujii Masao masao.fu...@gmail.com wrote: On Tue, Nov 1, 2011 at 3:08 AM, Magnus Hagander mag...@hagander.net wrote: On Fri, Oct 28, 2011 at 08:46, Fujii Masao masao.fu...@gmail.com wrote: On Thu, Oct 27, 2011 at 11:14 PM, Magnus Hagander mag...@hagander.net

[HACKERS] Term positions in GIN fulltext index

2011-11-03 Thread Yoann Moreau
Hello, I'm using a GIN index for a text column on a big table. I use it to rank the rows, but I also need to get the term positions for each document of a subset of documents for one or more terms. I suppose these positions are stored in the index as the to_tsvector shows them :

Re: [HACKERS] heap vacuum cleanup locks

2011-11-03 Thread Simon Riggs
On Thu, Nov 3, 2011 at 2:22 PM, Robert Haas robertmh...@gmail.com wrote: On Thu, Nov 3, 2011 at 9:52 AM, Simon Riggs si...@2ndquadrant.com wrote: On Thu, Nov 3, 2011 at 1:26 PM, Robert Haas robertmh...@gmail.com wrote: I think that should be OK, but: - It looks to me like you haven't done

Re: [HACKERS] Term positions in GIN fulltext index

2011-11-03 Thread Kevin Grittner
Yoann Moreau yoann.mor...@univ-avignon.fr wrote: I'd need a function like this : select term_positions(text, 'get') from docs; id_doc | positions +--- 1 | {2,6} 2 | {3} I'd like to add this function in my database, for experimental purpose. I

[HACKERS] Refactor xlog.c #2 - xlog functions

2011-11-03 Thread Simon Riggs
Patch strips out all user visible functions into a new xlogfuncs.c file. --  Simon Riggs   http://www.2ndQuadrant.com/  PostgreSQL Development, 24x7 Support, Training Services refactor_xlog_funcs.v1.patch Description: Binary data -- Sent via pgsql-hackers mailing list

Re: GiST for range types (was Re: [HACKERS] Range Types - typo + NULL string constructor)

2011-11-03 Thread David E. Wheeler
On Nov 3, 2011, at 4:59 AM, Heikki Linnakangas wrote: I've committed this now, after some more cleanup. I removed the selectivity estimation functions from operators where they were bogus, so writing those is a clear TODO. But that can well be done as a separate patch. Thanks! Woo!

Re: [HACKERS] pg_upgrade if 'postgres' database is dropped

2011-11-03 Thread Bruce Momjian
Bruce Momjian wrote: I fixed this a different way. I originally thought I could skip over the 'postgres' database in the new cluster if it didn't exist in the old cluster, but we have do things like check it is empty, so that was going to be awkward. It turns out there was only one place

[HACKERS] Storing hot members of PGPROC out of the band

2011-11-03 Thread Pavan Deolasee
Hi All, While working on some of the performance issues on HP-UX, I noticed a significant data cache misses for accessing PGPROC members. On a close inspection, it was quite evident that for large number (even few 10s) of clients, the loop inside GetSnapshotData will cause data cache miss for

Re: [HACKERS] Term positions in GIN fulltext index

2011-11-03 Thread Florian Pflug
On Nov3, 2011, at 16:52 , Yoann Moreau wrote: I'm using a GIN index for a text column on a big table. I use it to rank the rows, but I also need to get the term positions for each document of a subset of documents for one or more terms. I suppose these positions are stored in the index as

[HACKERS] Further plans to refactor xlog.c

2011-11-03 Thread Simon Riggs
Next steps in refactoring are bigger steps, but not huge ones. I propose this * everything to do with XLOG rmgr into a file called xlogrmgr.c Thats xlog_redo() and most everything to do with checkpoints * everything to do with reading WAL files into a file called xlogread.c That will allow us

Re: GiST for range types (was Re: [HACKERS] Range Types - typo + NULL string constructor)

2011-11-03 Thread Florian Pflug
On Nov3, 2011, at 18:54 , David E. Wheeler wrote: On Nov 3, 2011, at 4:59 AM, Heikki Linnakangas wrote: I've committed this now, after some more cleanup. I removed the selectivity estimation functions from operators where they were bogus, so writing those is a clear TODO. But that can well

Re: [HACKERS] Term positions in GIN fulltext index

2011-11-03 Thread Tom Lane
Yoann Moreau yoann.mor...@univ-avignon.fr writes: I'm using a GIN index for a text column on a big table. I use it to rank the rows, but I also need to get the term positions for each document of a subset of documents for one or more terms. I suppose these positions are stored in the index

Re: [HACKERS] Term positions in GIN fulltext index

2011-11-03 Thread Marcin Mańk
On Thu, Nov 3, 2011 at 4:52 PM, Yoann Moreau yoann.mor...@univ-avignon.fr wrote: I'd need a function like this : select term_positions(text, 'get') from docs;  id_doc | positions +---      1 |     {2,6}      2 |       {3} check this out:

Re: [HACKERS] Term positions in GIN fulltext index

2011-11-03 Thread Alexander Korotkov
On Thu, Nov 3, 2011 at 11:01 PM, Tom Lane t...@sss.pgh.pa.us wrote: Yoann Moreau yoann.mor...@univ-avignon.fr writes: I'm using a GIN index for a text column on a big table. I use it to rank the rows, but I also need to get the term positions for each document of a subset of documents for

Re: [HACKERS] warning in pg_upgrade

2011-11-03 Thread Kevin Grittner
Kevin Grittner kevin.gritt...@wicourts.gov wrote: Untested patch attached for purposes of discussion. I got in a little testing on it -- not only does this patch eliminate the compile-time warning, but if you try to run pg_upgrade when another session has removed your current working

Re: GiST for range types (was Re: [HACKERS] Range Types - typo + NULL string constructor)

2011-11-03 Thread Alexander Korotkov
On Thu, Nov 3, 2011 at 3:59 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: I've committed this now, after some more cleanup. I removed the selectivity estimation functions from operators where they were bogus, so writing those is a clear TODO. But that can well be done as a

Re: [HACKERS] ts_count

2011-11-03 Thread Andrew Dunstan
On 06/04/2011 04:51 PM, Oleg Bartunov wrote: Well, there are several functions available around tsearch2. so I suggest somebody to collect all of them and create one extension - ts_addon. For example, these are what I remember: 1. tsvector2array 2. noccurences(tsvector, tsquery) - like your

[HACKERS] Strange behavior on to_tsquery()

2011-11-03 Thread Rodrigo Hjort
Hello PG hackers, I created a *custom dictionary* (based on dict_int) and a search configuration and a strange behavior happens on *PostgreSQL 8.4.9*. When I invoke the following instruction several times,* to_tsquery()*returns distinct results: catalog= SELECT to_tsquery('custom', 'pi');

Re: [HACKERS] Strange behavior on to_tsquery()

2011-11-03 Thread Tom Lane
Rodrigo Hjort rodrigo.hj...@gmail.com writes: I created a *custom dictionary* (based on dict_int) and a search configuration and a strange behavior happens on *PostgreSQL 8.4.9*. ... Therefore, when I use *@@ operator* over a *tsvector* column in my table the result set is not always the

[HACKERS] isolationtester patch

2011-11-03 Thread Alvaro Herrera
Just noticed that I broke the buildfarm with that isolationtester commit I did earlier today. I'm out for dinner now but I'll try to fix it when I'm back .. sorry. -- Álvaro Herrera alvhe...@alvh.no-ip.org -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes

Re: [HACKERS] Storing hot members of PGPROC out of the band

2011-11-03 Thread Simon Riggs
On Thu, Nov 3, 2011 at 6:12 PM, Pavan Deolasee pavan.deola...@gmail.com wrote: When PGPROC array is allocated, we also allocate another array of PGPROC_MINIMAL structures of the same size. While accessing the ProcArray, a simple pointer mathematic can get us the corresponding PGPROC_MINIMAL

Re: [HACKERS] Online base backup from the hot-standby

2011-11-03 Thread Josh Berkus
On 10/25/11 5:03 AM, Magnus Hagander wrote: If we want something to go in early, that could be as simple as a version of pg_basebackup that runs against the slave but only if full_page_writes=on on the master. If it's not, it throws an error. Then we can improve upon that by adding handling of

[HACKERS] Review comments for Patch: exclude-table-data option for pg_dump

2011-11-03 Thread Josh Berkus
Hackers, Andrew produced a version for this patch which builds against 9.0. I've tested that version on a production installation of PostgreSQL, including: * dumping and reloading a production database with over 200 objects, 500GB of data and complex dependancies, 4 times so far * excluding

Re: [HACKERS] Strange behavior on to_tsquery()

2011-11-03 Thread Tom Lane
I wrote: (Just offhand, it rather looks like dict_int and dict_xsyn are both assuming that palloc will give back zeroed space, which is bogus...) Yeah, this is definitely broken. Patches committed; thanks for the report.

Re: [HACKERS] unite recovery.conf and postgresql.conf

2011-11-03 Thread Greg Smith
On 09/24/2011 04:49 PM, Joshua Berkus wrote: Well, we *did* actually come up with a reasonable way, but it died under an avalanche of bikeshedding and we-must-do-everything-the-way-we-always-have-done. I refer, of course, to the configuration directory patch, which was a fine solution, and

Re: [HACKERS] heap_page_prune comments

2011-11-03 Thread Jim Nasby
On Nov 2, 2011, at 11:27 AM, Robert Haas wrote: The following comment - or at least the last sentence thereof - appears to be out of date. /* * XXX Should we update the FSM information of this page ? * * There are two schools of thought here. We may not want

Re: [HACKERS] IDLE in transaction introspection

2011-11-03 Thread Fujii Masao
On Thu, Nov 3, 2011 at 3:18 AM, Scott Mead sco...@openscg.com wrote: ISTM that we're all for:    creating a new column: state    renaming current_query = query    State will display RUNNING, IDLE, IDLE in transaction, etc...    query will display the last query that was executed. The

Re: [HACKERS] DeArchiver process

2011-11-03 Thread Fujii Masao
On Thu, Nov 3, 2011 at 2:52 AM, Simon Riggs si...@2ndquadrant.com wrote: On Wed, Nov 2, 2011 at 5:20 PM, Tom Lane t...@sss.pgh.pa.us wrote: Dimitri Fontaine dimi...@2ndquadrant.fr writes: The only part of your proposal that I don't like is the process name, that deArchiver thing.  wal restore

Re: [HACKERS] Online base backup from the hot-standby

2011-11-03 Thread Fujii Masao
On Fri, Nov 4, 2011 at 8:06 AM, Josh Berkus j...@agliodbs.com wrote: On 10/25/11 5:03 AM, Magnus Hagander wrote: If we want something to go in early, that could be as simple as a version of pg_basebackup that runs against the slave but only if full_page_writes=on on the master. If it's not, it

Re: [HACKERS] Further plans to refactor xlog.c

2011-11-03 Thread Fujii Masao
On Fri, Nov 4, 2011 at 3:14 AM, Simon Riggs si...@2ndquadrant.com wrote: Next steps in refactoring are bigger steps, but not huge ones. I propose this * everything to do with XLOG rmgr into a file called xlogrmgr.c Thats xlog_redo() and most everything to do with checkpoints * everything