Re: [HACKERS] [GENERAL] pg_upgrade problem

2011-09-01 Thread hubert depesz lubaczewski
On Wed, Aug 31, 2011 at 09:54:20PM -0400, Bruce Momjian wrote: Working with depesz, I have found the cause. The code I added to fix pg_upgrade in 9.0.4 and earlier releases didn't handle old 8.3 servers properly. I mistakenly processed toast table with the same pg_dump query as used for

Re: [HACKERS] postgresql.conf archive_command example

2011-09-01 Thread Dimitri Fontaine
Peter Eisentraut pete...@gmx.net writes: Well, we could make initdb patch it up, but that might seem excessive. I sometime wonder if archive_mode shouldn't default to on with the archive_command set to either '/bin/true' or 'rem' for windows. That allows to install proper archiving without

Re: [HACKERS] setlocale() on Windows is broken

2011-09-01 Thread Heikki Linnakangas
On 31.08.2011 16:05, Heikki Linnakangas wrote: While looking through old emails, I bumped into this: http://archives.postgresql.org/message-id/25219.1303306...@sss.pgh.pa.us To recap, setlocale() on Windows is broken for locale names that contain dots or apostrophes in the country name. That

Re: [HACKERS] WIP: Fast GiST index build

2011-09-01 Thread Heikki Linnakangas
On 30.08.2011 13:38, Alexander Korotkov wrote: On Tue, Aug 30, 2011 at 1:08 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: Thanks. Meanwhile, I hacked together my own set of test scripts, and let them run over the weekend. I'm still running tests with ordered data, but

Re: [HACKERS] WIP: Fast GiST index build

2011-09-01 Thread Alexander Korotkov
On Thu, Sep 1, 2011 at 12:59 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: So I changed the test script to generate the table as: CREATE TABLE points AS SELECT random() as x, random() as y FROM generate_series(1, $NROWS); The unordered results are in:

Re: [HACKERS] WIP: Fast GiST index build

2011-09-01 Thread Heikki Linnakangas
On 01.09.2011 12:23, Alexander Korotkov wrote: On Thu, Sep 1, 2011 at 12:59 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: So I changed the test script to generate the table as: CREATE TABLE points AS SELECT random() as x, random() as y FROM generate_series(1, $NROWS);

Re: [HACKERS] postgresql.conf archive_command example

2011-09-01 Thread Robert Haas
2011/9/1 Dimitri Fontaine dimi...@2ndquadrant.fr: Peter Eisentraut pete...@gmx.net writes: Well, we could make initdb patch it up, but that might seem excessive. I sometime wonder if archive_mode shouldn't default to on with the archive_command set to either '/bin/true' or 'rem' for windows.

Re: [HACKERS] WIP: SP-GiST, Space-Partitioned GiST

2011-09-01 Thread Oleg Bartunov
This is updates SP-GiST patch, which fixed one bug and replaced test to the locale independent one. On Wed, 31 Aug 2011, Oleg Bartunov wrote: Hi there, attached is our WIP-patch for 9.2 development source tree, which provides implementation of SP-GiST (prototype was presented at PGCon-2011,

Re: [HACKERS] WIP: SP-GiST, Space-Partitioned GiST

2011-09-01 Thread Alexander Korotkov
Hi! Ie expect some problems in support of comparison operators for text, because locale string comparison can have unexpected behaviour. Let's see the example. Create table with words and add extra leading space to some of them. test=# create table dict(id serial, word text); NOTICE: CREATE

Re: [HACKERS] [v9.1] sepgsql - userspace access vector cache

2011-09-01 Thread Robert Haas
On Fri, Aug 26, 2011 at 5:32 AM, Kohei KaiGai kai...@kaigai.gr.jp wrote: Yes. It also caches an expected security label when a client being labeled as scontext tries to execute a procedure being labeled as tcontext, to reduce number of system call invocations on fmgr_hook and needs_fmgr_hook.

Re: [HACKERS] dblink make fails under postgresql 8.4.4 on mac osx 10.4.11

2011-09-01 Thread Robert Haas
On Wed, Aug 31, 2011 at 9:45 AM, Gary Merkel garymer...@accugenix.com wrote: Having trouble installing dblink under PostgreSQL 8.4.4 on MAC OS X 10.4.11 Running make gives the following error: sed 's,MODULE_PATHNAME,$libdir/dblink,g' dblink.sql.in dblink.sql gcc -no-cpp-precomp -O2 -Wall

Re: [HACKERS] [v9.1] sepgsql - userspace access vector cache

2011-09-01 Thread Kohei Kaigai
On Fri, Aug 26, 2011 at 5:32 AM, Kohei KaiGai kai...@kaigai.gr.jp wrote: Yes. It also caches an expected security label when a client being labeled as scontext tries to execute a procedure being labeled as tcontext, to reduce number of system call invocations on fmgr_hook and

Re: [HACKERS] mb_regress.sh gripes

2011-09-01 Thread Robert Haas
On Thu, Aug 18, 2011 at 6:19 PM, Josh Kupershmidt schmi...@gmail.com wrote: A few gripes about mb_regress.sh:  1. No exit code is specified, so even if there are differences between results/ and expected/ the script will still return 0.  2. The 'dropdb' command is used to wipe out the utf8

Re: [HACKERS] Removal of useless include references

2011-09-01 Thread Bruce Momjian
Bruce Momjian wrote: Bruce Momjian wrote: Tom Lane wrote: Bruce Momjian br...@momjian.us writes: It has been years since I ran src/tools/pginclude/pgrminclude to remove unnecessary include files. (I have already fixed things so include files can be compiled on their own.)

Re: [HACKERS] Removal of useless include references

2011-09-01 Thread Alvaro Herrera
Excerpts from Bruce Momjian's message of jue sep 01 11:04:33 -0300 2011: Bruce Momjian wrote: OK, try #2. I already had code that removed #if/#else/#endif code in *.h files for better testing, so I extended that to all *.c files. This reduces the size of the diff from 6.6k lines to 4.7k

Re: [HACKERS] Removal of useless include references

2011-09-01 Thread Tom Lane
Alvaro Herrera alvhe...@commandprompt.com writes: Excerpts from Bruce Momjian's message of jue sep 01 11:04:33 -0300 2011: I have re-run the script and applied the result, again tested on BSD and Linux. I will monitor the buildfarm for possible failures. I think anything of this sort should

Re: [HACKERS] Removal of useless include references

2011-09-01 Thread Bruce Momjian
Alvaro Herrera wrote: Excerpts from Bruce Momjian's message of jue sep 01 11:04:33 -0300 2011: Bruce Momjian wrote: OK, try #2. I already had code that removed #if/#else/#endif code in *.h files for better testing, so I extended that to all *.c files. This reduces the size of the

Re: [HACKERS] Removal of useless include references

2011-09-01 Thread Bruce Momjian
Tom Lane wrote: Alvaro Herrera alvhe...@commandprompt.com writes: Excerpts from Bruce Momjian's message of jue sep 01 11:04:33 -0300 2011: I have re-run the script and applied the result, again tested on BSD and Linux. I will monitor the buildfarm for possible failures. I think

[HACKERS] help with plug-in function for additional (partition/shard) visibility checks

2011-09-01 Thread Hannu Krosing
Hallow hackers I have the following problem to solve and would like to get advice on the best way to do it. The problem: When growing a pl/proxy based database cluster, one of the main operations is splitting a partition. The standard flow is as follows: 1) make a copy of the partitions

Re: [HACKERS] Informix FDW - anybody working on this?

2011-09-01 Thread Robert Treat
On Wed, Aug 31, 2011 at 8:13 AM, Bernd Helmle maili...@oopsware.de wrote: Out of curiosity, is anybody working on $subject? I'm currently planning to work on such a driver, but given the current stream of new drivers i want to make sure to not duplicate any efforts... The most complete

Re: [HACKERS] stored procedures

2011-09-01 Thread Josh Berkus
On 8/31/11 12:15 PM, Merlin Moncure wrote: An out of process, autonomous transaction type implementation should probably not sit under stored procedures for a number of reasons -- mainly that it's going to expose too many implementation details to the user. For example, does a SP heavy app

Re: [HACKERS] Why buildfarm member anchovy is failing on 8.2 and 8.3 branches

2011-09-01 Thread Tom Lane
I wrote: What *does* seem feasible is to back-port just the single change we actually need, by copying the two relevant macros into one of our config/ source files for the configure script. I've tested that in 8.3 and it seems to work --- at least, the generated configure script changes in

Re: [HACKERS] stored procedures

2011-09-01 Thread Christopher Browne
On Thu, Sep 1, 2011 at 1:18 PM, Josh Berkus j...@agliodbs.com wrote: On 8/31/11 12:15 PM, Merlin Moncure wrote: An out of process, autonomous transaction type implementation should probably not sit under stored procedures for a number of reasons -- mainly that it's going to expose too many

Re: [HACKERS] postgresql.conf archive_command example

2011-09-01 Thread Josh Berkus
Seems like it would be better to fix archive_mode so that it can be changed without a restart. +1 I'm also wondering if providing some shell script examples of a fault-tolerant script to handle archiving would be useful. -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent

Re: [HACKERS] postgresql.conf archive_command example

2011-09-01 Thread Robert Haas
On Thu, Sep 1, 2011 at 3:05 PM, Josh Berkus j...@agliodbs.com wrote: +1 I'm also wondering if providing some shell script examples of a fault-tolerant script to handle archiving would be useful. I think it would. -- Robert Haas EnterpriseDB: http://www.enterprisedb.com The Enterprise

Re: [HACKERS] pg_upgrade automatic testing

2011-09-01 Thread Bruce Momjian
Tom Lane wrote: Peter Eisentraut pete...@gmx.net writes: +# contrib/pg_upgrade/test.sh +# +# Test driver for pg_upgrade. Initializes a new database cluster, +# runs the regression tests (to put in some data), runs pg_dumpall, +# runs pg_upgrade, runs pg_dumpall again, compares the

Re: [HACKERS] pg_upgrade automatic testing

2011-09-01 Thread Bruce Momjian
Peter Eisentraut wrote: On tis, 2011-08-30 at 16:25 -0400, Tom Lane wrote: So I think that as given, this script is only useful for testing pg_upgrade of $currentversion to $currentversion. Which is surely better than no test at all, but it would not for example have caught the 8.3

Re: [HACKERS] sha1, sha2 functions into core?

2011-09-01 Thread Daniel Farina
On Wed, Aug 31, 2011 at 11:12 AM, Ross J. Reedstrom reeds...@rice.edu wrote: Hmm, this thread seems to have petered out without a conclusion. Just wanted to comment that there _are_ non-password storage uses for these digests: I use them in a context of storing large files in a bytea column,

Re: [HACKERS] PATCH: regular logging of checkpoint progress

2011-09-01 Thread Tomas Vondra
I've prepared a significantly simplified version of the patch. The two main changes are (a) it does not update the pg_stat_bgwriter anymore, it just prints an info to the server log (b) a new GUC is not required, it's driven by the log_checkpoints This version will log at least 10 'checkpoint

Re: [HACKERS] strange row number estimates in pg9.1rc1

2011-09-01 Thread Bruce Momjian
Tom Lane wrote: I wrote: Sergey E. Koposov m...@sai.msu.ru writes: I'm seeing something weird which looks like a bug in 9.1rc1 after the upgrade 8.4-9.0-9.1 done using pg_upgrade. Hm, I wonder what pg_upgrade left relpages/reltuples set to ... Sure enough, that's the problem.

Re: [HACKERS] pg_restore --no-post-data and --post-data-only

2011-09-01 Thread Greg Sabino Mullane
-BEGIN PGP SIGNED MESSAGE- Hash: RIPEMD160 It's off topic. But I think custom format would require a major mangling to be able to handle a complete cluster. This isn't just a simple matter of programming, IMNSHO. Oh, I meant just having it create separate custom format files for

[HACKERS] Getting the OID inside the executor

2011-09-01 Thread Fazool
Hello everyone, I am implementing some functionality into Postgresql, where I want to track which row was accessed by a user query. I am implementing the functionality inside Postgres, so that there are no changes required on client side (e.g. re-writing queries). Rows are identified by OIDs, and

Re: [HACKERS] Getting the OID inside the executor

2011-09-01 Thread Tom Lane
Fazool fazoolm...@gmail.com writes: I am implementing some functionality into Postgresql, where I want to track which row was accessed by a user query. I am implementing the functionality inside Postgres, so that there are no changes required on client side (e.g. re-writing queries). Rows are

Re: [HACKERS] Getting the OID inside the executor

2011-09-01 Thread Fazool
Thanks for the reply Tom. As far as I know, the TID of a row can change over time (e.g. when the row is updated). Isn't it so? If so, it wont solve my problem. It says here (http://www.postgresql.org/docs/9.0/static/ddl-system-columns.html) that The OID, or even better a user-defined serial