Re: [HACKERS] Perfomance degradation 9.3 (vs 9.2) for FreeBSD

2014-04-22 Thread Mark Kirkwood
On 22/04/14 09:25, Andres Freund wrote: On 2014-04-21 17:21:20 -0400, Bruce Momjian wrote: On Mon, Apr 21, 2014 at 02:08:51PM -0700, Joshua Drake wrote: If the community had more *BSD presence I think it would be great but it isn't all that viable at this point. I do know however that no-one

Re: [HACKERS] Perfomance degradation 9.3 (vs 9.2) for FreeBSD

2014-04-22 Thread Mark Kirkwood
On 23/04/14 00:19, Andres Freund wrote: Hi, Attached you can find a short (compile tested only ) patch implementing a 'shared_memory_type' GUC, akin to 'dynamic_shared_memory_type'. Will only apply to 9.4, not 9.3, but it should be easy to convert for it. Have just tried this out (on Ubuntu

Re: [HACKERS] four minor proposals for 9.5

2014-03-20 Thread Mark Kirkwood
On 20/03/14 13:28, Josh Berkus wrote: 3. relation limit - possibility to set session limit for maximum size of relations. Any relation cannot be extended over this limit in session, when this value is higher than zero. Motivation - we use lot of queries like CREATE TABLE AS SELECT .. , and some

Re: [HACKERS] four minor proposals for 9.5

2014-03-20 Thread Mark Kirkwood
On 20/03/14 20:08, Pavel Stehule wrote: 2014-03-20 7:25 GMT+01:00 Mark Kirkwood mark.kirkw...@catalyst.net.nz Also I think this would probably only make sense for TEMPORARY tables - otherwise you can get this sort of thing going on: - you create a table and you have set

Re: [HACKERS] Why do we let autovacuum give up?

2014-01-23 Thread Mark Kirkwood
On 24/01/14 09:49, Tom Lane wrote: 2. What have you got that is requesting exclusive lock on pg_attribute? That seems like a pretty unfriendly behavior in itself. regards, tom lane I've seen this sort of problem where every db session was busily creating temporary tables. I never got to the

Re: [HACKERS] Why do we let autovacuum give up?

2014-01-23 Thread Mark Kirkwood
On 24/01/14 10:09, Robert Haas wrote: On Thu, Jan 23, 2014 at 4:03 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: On 24/01/14 09:49, Tom Lane wrote: 2. What have you got that is requesting exclusive lock on pg_attribute? That seems like a pretty unfriendly behavior in itself. regards

Re: [HACKERS] Why do we let autovacuum give up?

2014-01-23 Thread Mark Kirkwood
On 24/01/14 10:16, Mark Kirkwood wrote: On 24/01/14 10:09, Robert Haas wrote: On Thu, Jan 23, 2014 at 4:03 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: On 24/01/14 09:49, Tom Lane wrote: 2. What have you got that is requesting exclusive lock on pg_attribute? That seems like a pretty

Re: [HACKERS] Why do we let autovacuum give up?

2014-01-23 Thread Mark Kirkwood
On 24/01/14 12:13, Jeff Janes wrote: On Thu, Jan 23, 2014 at 1:41 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: On 24/01/14 10:16, Mark Kirkwood wrote: On 24/01/14 10:09, Robert Haas wrote: On Thu, Jan 23, 2014 at 4:03 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote

Re: [HACKERS] Why do we let autovacuum give up?

2014-01-23 Thread Mark Kirkwood
On 24/01/14 12:28, Mark Kirkwood wrote: On 24/01/14 12:13, Jeff Janes wrote: On Thu, Jan 23, 2014 at 1:41 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: On 24/01/14 10:16, Mark Kirkwood wrote: On 24/01/14 10:09, Robert Haas wrote: On Thu, Jan 23, 2014 at 4:03 PM, Mark Kirkwood

Re: [HACKERS] proposal: hide application_name from other users

2014-01-21 Thread Mark Kirkwood
On 22/01/14 13:32, Harold Giménez wrote: On Tue, Jan 21, 2014 at 4:19 PM, Bruce Momjian br...@momjian.us wrote: On Tue, Jan 21, 2014 at 04:06:46PM -0800, Harold Giménez wrote: I don't know of a client where it can't be overridden. The friction occurs when by default it sets it to something

Re: [HACKERS] Standalone synchronous master

2014-01-11 Thread Mark Kirkwood
On 11/01/14 13:25, Stephen Frost wrote: Adrian, * Adrian Klaver (adrian.kla...@gmail.com) wrote: A) Change the existing sync mode to allow the master and standby fall out of sync should a standby fall over. I'm not sure that anyone is argueing for this.. B) Create a new mode that does

Re: [HACKERS] ANALYZE sampling is too good

2013-12-11 Thread Mark Kirkwood
On 11/12/13 19:34, Simon Riggs wrote: Realistically, I never heard of an Oracle DBA doing advanced statistical mathematics before setting the sample size on ANALYZE. You use the default and bump it up if the sample is insufficient for the data. I'm not sure that Oracle's stats and optimizer

Re: [HACKERS] ANALYZE sampling is too good

2013-12-10 Thread Mark Kirkwood
On 11/12/13 09:19, Heikki Linnakangas wrote: On 12/10/2013 10:00 PM, Simon Riggs wrote: On 10 December 2013 19:54, Josh Berkus j...@agliodbs.com wrote: On 12/10/2013 11:49 AM, Peter Geoghegan wrote: On Tue, Dec 10, 2013 at 11:23 AM, Simon Riggs si...@2ndquadrant.com wrote: I don't think that

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 12:14, Heikki Linnakangas wrote: I took a stab at using posix_fadvise() in ANALYZE. It turned out to be very easy, patch attached. Your mileage may vary, but I'm seeing a nice gain from this on my laptop. Taking a 3 page sample of a table with 717717 pages (ie. slightly

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 13:14, Mark Kirkwood wrote: On 10/12/13 12:14, Heikki Linnakangas wrote: I took a stab at using posix_fadvise() in ANALYZE. It turned out to be very easy, patch attached. Your mileage may vary, but I'm seeing a nice gain from this on my laptop. Taking a 3 page sample

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 13:20, Mark Kirkwood wrote: On 10/12/13 13:14, Mark Kirkwood wrote: On 10/12/13 12:14, Heikki Linnakangas wrote: I took a stab at using posix_fadvise() in ANALYZE. It turned out to be very easy, patch attached. Your mileage may vary, but I'm seeing a nice gain from this on my

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 13:53, Mark Kirkwood wrote: On 10/12/13 13:20, Mark Kirkwood wrote: On 10/12/13 13:14, Mark Kirkwood wrote: On 10/12/13 12:14, Heikki Linnakangas wrote: I took a stab at using posix_fadvise() in ANALYZE. It turned out to be very easy, patch attached. Your mileage may vary

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 15:04, Mark Kirkwood wrote: On 10/12/13 13:53, Mark Kirkwood wrote: On 10/12/13 13:20, Mark Kirkwood wrote: On 10/12/13 13:14, Mark Kirkwood wrote: On 10/12/13 12:14, Heikki Linnakangas wrote: I took a stab at using posix_fadvise() in ANALYZE. It turned out to be very easy

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 15:11, Mark Kirkwood wrote: On 10/12/13 15:04, Mark Kirkwood wrote: On 10/12/13 13:53, Mark Kirkwood wrote: On 10/12/13 13:20, Mark Kirkwood wrote: On 10/12/13 13:14, Mark Kirkwood wrote: On 10/12/13 12:14, Heikki Linnakangas wrote: I took a stab at using posix_fadvise

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 15:17, Mark Kirkwood wrote: On 10/12/13 15:11, Mark Kirkwood wrote: On 10/12/13 15:04, Mark Kirkwood wrote: On 10/12/13 13:53, Mark Kirkwood wrote: On 10/12/13 13:20, Mark Kirkwood wrote: On 10/12/13 13:14, Mark Kirkwood wrote: On 10/12/13 12:14, Heikki Linnakangas wrote: I

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 15:32, Mark Kirkwood wrote: On 10/12/13 15:17, Mark Kirkwood wrote: On 10/12/13 15:11, Mark Kirkwood wrote: On 10/12/13 15:04, Mark Kirkwood wrote: On 10/12/13 13:53, Mark Kirkwood wrote: On 10/12/13 13:20, Mark Kirkwood wrote: On 10/12/13 13:14, Mark Kirkwood wrote: On 10/12

Re: [HACKERS] ANALYZE sampling is too good

2013-12-09 Thread Mark Kirkwood
On 10/12/13 17:18, Claudio Freire wrote: On Tue, Dec 10, 2013 at 12:13 AM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: Just one more... The Intel 520 with ext4: Without patch: ANALYZE pgbench_accounts 5s With patch: ANALYZE pgbench_accounts 1s And double checking - With patch

Re: [HACKERS] ANALYZE sampling is too good

2013-12-08 Thread Mark Kirkwood
On 09/12/13 08:03, Josh Berkus wrote: So there's a set of math designed to calculate for the skew introduced by reading *all* of the rows in each block. That's what I meant by block-based sampling; you read, say, 400 pages, you compile statistics on *all* of the rows on those pages, you apply

Re: [HACKERS] ANALYZE sampling is too good

2013-12-07 Thread Mark Kirkwood
On 08/12/13 09:25, Josh Berkus wrote: On 12/07/2013 11:46 AM, Robert Haas wrote: Maybe there's some highly-principled statistical approach which could be taken here, and if so that's fine, but I suspect not. So what I think we should do is auto-tune the statistics target based on the table

Re: [HACKERS] ANALYZE sampling is too good

2013-12-07 Thread Mark Kirkwood
On 08/12/13 12:27, Mark Kirkwood wrote: On 08/12/13 09:25, Josh Berkus wrote: On 12/07/2013 11:46 AM, Robert Haas wrote: Maybe there's some highly-principled statistical approach which could be taken here, and if so that's fine, but I suspect not. So what I think we should do is auto-tune

Re: [HACKERS] why semicolon after begin is not allowed in postgresql?

2013-11-25 Thread Mark Kirkwood
On 26/11/13 09:42, AK wrote: Kevin, I do see your logic now, but this thing is a common mistake - it means that this seems counter-intuitive to some people. What would happen if we applied Occam's razor and just removed this rule? All existing code would continue to work as is, and we would

Re: [HACKERS] why semicolon after begin is not allowed in postgresql?

2013-11-25 Thread Mark Kirkwood
On 26/11/13 12:13, David Johnston wrote: Mark Kirkwood-2 wrote Postgres supports many procedural languages (e.g plperl, plpython) and all So in the case of plpgsql - it needs to follow the Ada grammar, otherwise it would be useless. I do not follow the useless conclusion - what, present day

Re: [HACKERS] [PoC] pgstattuple2: block sampling to reduce physical read

2013-10-21 Thread Mark Kirkwood
On 16/10/13 11:51, Mark Kirkwood wrote: On 11/10/13 17:33, Jaime Casanova wrote: also the name pgstattuple2, doesn't convince me... maybe you can use pgstattuple() if you use a second argument (percentage of the sample) to overload the function +1, that seems much nicer. Oh - and if you

Re: [HACKERS] ERROR : 'tuple concurrently updated'

2013-10-18 Thread Mark Kirkwood
On 18/10/13 18:01, Amit Kapila wrote: On Wed, Oct 16, 2013 at 5:55 PM, Stéphan BEUZE stephan.be...@douane.finances.gouv.fr wrote: The following query is performed concurrently by two threads logged in with two different users: WITH raw_stat AS ( SELECT

Re: [HACKERS] [PoC] pgstattuple2: block sampling to reduce physical read

2013-10-15 Thread Mark Kirkwood
On 11/10/13 17:49, Mark Kirkwood wrote: On 11/10/13 17:08, Satoshi Nagayasu wrote: (2013/10/11 7:32), Mark Kirkwood wrote: On 11/10/13 11:09, Mark Kirkwood wrote: On 16/09/13 16:20, Satoshi Nagayasu wrote: (2013/09/15 11:07), Peter Eisentraut wrote: On Sat, 2013-09-14 at 16:18 +0900, Satoshi

Re: [HACKERS] [PoC] pgstattuple2: block sampling to reduce physical read

2013-10-15 Thread Mark Kirkwood
On 11/10/13 17:33, Jaime Casanova wrote: also the name pgstattuple2, doesn't convince me... maybe you can use pgstattuple() if you use a second argument (percentage of the sample) to overload the function +1, that seems much nicer. Regards Mark -- Sent via pgsql-hackers mailing list

Re: [HACKERS] [PoC] pgstattuple2: block sampling to reduce physical read

2013-10-10 Thread Mark Kirkwood
On 16/09/13 16:20, Satoshi Nagayasu wrote: (2013/09/15 11:07), Peter Eisentraut wrote: On Sat, 2013-09-14 at 16:18 +0900, Satoshi Nagayasu wrote: I'm looking forward to seeing more feedback on this approach, in terms of design and performance improvement. So, I have submitted this for the

Re: [HACKERS] [PoC] pgstattuple2: block sampling to reduce physical read

2013-10-10 Thread Mark Kirkwood
On 11/10/13 11:09, Mark Kirkwood wrote: On 16/09/13 16:20, Satoshi Nagayasu wrote: (2013/09/15 11:07), Peter Eisentraut wrote: On Sat, 2013-09-14 at 16:18 +0900, Satoshi Nagayasu wrote: I'm looking forward to seeing more feedback on this approach, in terms of design and performance

Re: [HACKERS] [PoC] pgstattuple2: block sampling to reduce physical read

2013-10-10 Thread Mark Kirkwood
On 11/10/13 17:08, Satoshi Nagayasu wrote: (2013/10/11 7:32), Mark Kirkwood wrote: On 11/10/13 11:09, Mark Kirkwood wrote: On 16/09/13 16:20, Satoshi Nagayasu wrote: (2013/09/15 11:07), Peter Eisentraut wrote: On Sat, 2013-09-14 at 16:18 +0900, Satoshi Nagayasu wrote: I'm looking forward

Re: [HACKERS] [PoC] pgstattuple2: block sampling to reduce physical read

2013-10-10 Thread Mark Kirkwood
On 11/10/13 17:33, Jaime Casanova wrote: On Thu, Oct 10, 2013 at 5:32 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: Quietly replying to myself - looking at the code the sampler does 3000 random page reads... FWIW, something that bothers me is that there is 3000 random page reads... i

Re: [HACKERS] Add pgbench option: CHECKPOINT before starting benchmark

2013-08-30 Thread Mark Kirkwood
On 30/08/13 19:54, KONDO Mitsumasa wrote: Hi, I add checkpoint option to pgbench. pgbench is simple and useful benchmark for every user. However, result of benchmark greatly changes by some situations which are in executing checkpoint, number of dirty buffers in share_buffers, and so

Re: [HACKERS] [9.4 CF 1] The Commitfest Slacker List

2013-07-04 Thread Mark Kirkwood
On 04/07/13 10:43, Robert Haas wrote: And people who submit patches for review should also review patches: they are asking other people to do work, so they should also contribute work. I think that is an overly simplistic view of things. People submit patches for a variety of reasons, but

Re: [HACKERS] Kudos for Reviewers -- straw poll

2013-06-26 Thread Mark Kirkwood
On 27/06/13 07:12, Josh Berkus wrote: On 06/26/2013 12:02 PM, Alvaro Herrera wrote: See the entry for foreign key locks: Prevent non-key-field row updates from locking foreign key rows (Álvaro Herrera, Noah Misch, Andres Freund, Alexander Shulgin, Marti Raudsepp) I am the author of most

Re: [HACKERS] [9.4 CF 1] The Commitfest Slacker List

2013-06-25 Thread Mark Kirkwood
On 25/06/13 15:56, Tom Lane wrote: Mark Kirkwood mark.kirkw...@catalyst.net.nz writes: One of the reasons for fewer reviewers than submitters, is that it is a fundamentally more difficult job. I've submitted a few patches in a few different areas over the years - however if I grab a patch

Re: [HACKERS] [9.4 CF 1] The Commitfest Slacker List

2013-06-24 Thread Mark Kirkwood
On 25/06/13 03:54, Joshua D. Drake wrote: It is mentioned. Of course now I can't find it but it is there. However, I believe you are taking the wrong perspective on this. This is not a shame wall. It is a transparent reminder of the policy and those who have not assisted in reviewing a patch

Re: [HACKERS] Clean switchover

2013-06-13 Thread Mark Kirkwood
On 14/06/13 07:38, Fujii Masao wrote: On Wed, Jun 12, 2013 at 12:55 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: On 12/06/13 13:15, Stephen Frost wrote: * Fujii Masao (masao.fu...@gmail.com) wrote: The attached patch fixes this problem. It just changes walsender so that it waits

Re: [HACKERS] Clean switchover

2013-06-11 Thread Mark Kirkwood
On 12/06/13 13:15, Stephen Frost wrote: * Fujii Masao (masao.fu...@gmail.com) wrote: The attached patch fixes this problem. It just changes walsender so that it waits for all the outstanding WAL records to be replicated to the standby before closing the replication connection. Seems like a

Re: [HACKERS] [GENERAL] autoanalyze criteria

2013-05-14 Thread Mark Kirkwood
On 24/02/13 10:51, Mark Kirkwood wrote: On 24/02/13 10:12, Stefan Andreatta wrote: On 02/23/2013 09:30 PM, Jeff Janes wrote: Moved discussion from General To Hackers. On Sat, Feb 23, 2013 at 10:41 AM, Stefan Andreatta s.andrea...@synedra.com mailto:s.andrea...@synedra.com wrote: On 02

Re: [HACKERS] Process title for autovac

2013-04-06 Thread Mark Kirkwood
On 07/04/13 08:20, Jeff Janes wrote: I've often wanted to know what the autovacuum worker was doing. The process title seems like the best place to get this information, but the process title tells me what database it is in, but not what table it is working on. The attached patch demonstrates

Re: [HACKERS] initdb ignoring options?

2013-02-26 Thread Mark Kirkwood
Hmm - just did a pull now: $ initdb --version initdb (PostgreSQL) 9.3devel $ initdb --help initdb initializes a PostgreSQL database cluster. Usage: initdb [OPTION]... [DATADIR] ...[snipped rest of help output] So looks like something odd you are doing - are you using any unusual build

Re: [HACKERS] initdb ignoring options?

2013-02-26 Thread Mark Kirkwood
On 27/02/13 12:41, Greg Smith wrote: On 2/26/13 5:51 PM, Mark Kirkwood wrote: So looks like something odd you are doing - are you using any unusual build options? The unusual part looks to be the build environment or libraries of this Mac I'm trying to use. The build options are the normal

Re: [HACKERS] [GENERAL] autoanalyze criteria

2013-02-23 Thread Mark Kirkwood
On 24/02/13 10:12, Stefan Andreatta wrote: On 02/23/2013 09:30 PM, Jeff Janes wrote: Moved discussion from General To Hackers. On Sat, Feb 23, 2013 at 10:41 AM, Stefan Andreatta s.andrea...@synedra.com mailto:s.andrea...@synedra.com wrote: On 02/23/2013 05:10 PM, Jeff Janes wrote:

Re: [HACKERS] Cascading replication: should we detect/prevent cycles?

2013-02-01 Thread Mark Kirkwood
On 01/02/13 20:43, Peter Geoghegan wrote: On Sunday, 27 January 2013, Robert Haas robertmh...@gmail.com mailto:robertmh...@gmail.com wrote: If we're going to start installing safeguards against doing stupid things, there's a long list of scenarios that happen far more regularly than this

Re: [HACKERS] logical changeset generation v4

2013-01-14 Thread Mark Kirkwood
On 15/01/13 14:38, Andres Freund wrote: Hi everyone, Here is the newest version of logical changeset generation. I'm quite interested in this feature - so tried applying the 19 patches to the latest 9.3 checkout. Patch and compile are good. However portals seem busted: bench=# BEGIN;

Re: [HACKERS] logical changeset generation v4

2013-01-14 Thread Mark Kirkwood
On 15/01/13 17:37, Mark Kirkwood wrote: On 15/01/13 14:38, Andres Freund wrote: Hi everyone, Here is the newest version of logical changeset generation. I'm quite interested in this feature - so tried applying the 19 patches to the latest 9.3 checkout. Patch and compile are good

Re: [HACKERS] Autoanalyze of the autovacuum daemon ...

2012-11-01 Thread Mark Kirkwood
On 01/11/12 00:25, Baptiste LHOSTE wrote: Hi All, We are using postgreSQL since 2007 (now we use postgreSQL 8.4) and until recently we used to perform vacuum and analyze tasks by ourself. Nevertheless we reached a point where these tasks are taking so much time that why we decide to use the

[HACKERS] 9.2 Cascading replication after slave promotion

2012-08-13 Thread Mark Kirkwood
Looking at the docs (section 25.2.6 paragraph 6) leads one to believe that downstream standbys can continue to receive and process wal merely by reconnecting after the cascading standby is promoted - but this does not seem to be the case (indeed the same paragraph notes that timelines now no

Re: [HACKERS] 9.2 Cascading replication after slave promotion

2012-08-13 Thread Mark Kirkwood
On 14/08/12 12:32, Josh Berkus wrote: Mark, Looking at the docs (section 25.2.6 paragraph 6) leads one to believe that downstream standbys can continue to receive and process wal merely by reconnecting after the cascading standby is promoted - but this does not seem to be the case (indeed the

Re: [HACKERS] 2GB limit for temp_file_limit on 32bit platform

2012-07-19 Thread Mark Kirkwood
On 20/07/12 09:08, Joshua D. Drake wrote: On 07/19/2012 01:48 PM, Christopher Browne wrote: On Thu, Jul 19, 2012 at 4:29 PM, Joshua D. Drake j...@commandprompt.com wrote: On 07/19/2012 01:04 PM, Pavel Stehule wrote: I did a backport of temp_file_limit feature to 9.1, but when we tested

Re: [HACKERS] 2GB limit for temp_file_limit on 32bit platform

2012-07-19 Thread Mark Kirkwood
On 20/07/12 09:58, Mark Kirkwood wrote: On 20/07/12 09:08, Joshua D. Drake wrote: On 07/19/2012 01:48 PM, Christopher Browne wrote: On Thu, Jul 19, 2012 at 4:29 PM, Joshua D. Drake j...@commandprompt.com wrote: On 07/19/2012 01:04 PM, Pavel Stehule wrote: I did a backport

Re: [HACKERS] 2GB limit for temp_file_limit on 32bit platform

2012-07-19 Thread Mark Kirkwood
On 20/07/12 12:02, Tom Lane wrote: Pavel Stehule pavel.steh...@gmail.com writes: I did a backport of temp_file_limit feature to 9.1, but when we tested this patch, we found very restristrictive limit to 2GB. 2GB is nonsense, because this is session limit of temp files, and these files should be

Re: [HACKERS] xlog filename formatting functions in recovery

2012-07-03 Thread Mark Kirkwood
On 03/07/12 20:24, Daniel Farina wrote: Hello, I've noticed recently that I can't seem to use the convenient xlog filename formatting functions while I'm in a standby. I don't see an incredibly obvious reason why that is the case, so here's a patch that simply removes the ban on being able to

Re: [HACKERS] urgent help required

2012-04-25 Thread Mark Kirkwood
On 19/04/12 06:23, Josh Berkus wrote: Nagaraj, i am nagaraj, i am newbi in this database world. i required your help. 2 dyas back i formatted one of my client system. which is having postgresql 8.2 database that was having data. but i am not taken backup of the data. 1) how to take the data

Re: [HACKERS] WIP patch for parameterized inner paths

2012-01-18 Thread Mark Kirkwood
On 17/01/12 18:06, Tom Lane wrote: Anyway, I'm hoping to keep hacking at this for a couple more days before the CF gets into full swing, and hopefully arrive at something committable for 9.2. I'd really like to get this fixed in this cycle, since it's been a problem for several releases now.

[HACKERS] Rename a database that has connections

2011-11-21 Thread Mark Kirkwood
I've been helping out several customers recently who all seem to be wrestling with the same issue: wanting to update/refresh non-production databases from the latest corresponding prod version. Typically they have (fairly complex) scripts that at some point attempt to restore a dump into new

Re: [HACKERS] Rename a database that has connections

2011-11-21 Thread Mark Kirkwood
On 22/11/11 16:38, Bruce Momjian wrote: Mark Kirkwood wrote: I've been helping out several customers recently who all seem to be wrestling with the same issue: wanting to update/refresh non-production databases from the latest corresponding prod version. Typically they have (fairly complex

Re: [HACKERS] Rename a database that has connections

2011-11-21 Thread Mark Kirkwood
On 22/11/11 16:41, Tom Lane wrote: Mark Kirkwoodmark.kirkw...@catalyst.net.nz writes: I've been helping out several customers recently who all seem to be wrestling with the same issue: wanting to update/refresh non-production databases from the latest corresponding prod version. Typically they

Re: [HACKERS] Rename a database that has connections

2011-11-21 Thread Mark Kirkwood
On 22/11/11 17:24, Mark Kirkwood wrote: I have not been able to find any other problems caused by this... renaming a db (many times) with hundreds of pgbench connections does not give rise to any issues. One point I did miss - the ps listing still uses the old dbname. pg_stat_activity

Re: [HACKERS] Rename a database that has connections

2011-11-21 Thread Mark Kirkwood
On 22/11/11 17:24, Mark Kirkwood wrote: On 22/11/11 16:41, Tom Lane wrote: Mark Kirkwoodmark.kirkw...@catalyst.net.nz writes: I've been helping out several customers recently who all seem to be wrestling with the same issue: wanting to update/refresh non-production databases from the latest

Re: [HACKERS] Measuring relation free space

2011-11-06 Thread Mark Kirkwood
On 07/11/11 10:20, Bernd Helmle wrote: --On 6. November 2011 01:08:11 -0200 Greg Smith g...@2ndquadrant.com wrote: Attached patch adds a new function to the pageinspect extension for measuring total free space, in either tables or indexes. I wonder if that should be done in the

[HACKERS] New releases for back branches 8.4 and 9.0?

2011-09-13 Thread Mark Kirkwood
Recently some pretty significant join optimization improvements have made their way into these branches. Are we looking at cutting an 8.4.9 and 9.0.5 soon? Cheers Mark -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription:

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-07-20 Thread Mark Kirkwood
And I thought I should mention: a big thank you to the the reviewers and interested parties, Cedric, Tatsuo, Robert and Tom who did a review + fixes as he committed the patch - nice work guys! regards Mark -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes

Re: [HACKERS] Re: [COMMITTERS] pgsql: Add temp_file_limit GUC parameter to constrain temporary file sp

2011-07-18 Thread Mark Kirkwood
On 19/07/11 02:36, Tom Lane wrote: Bruce Momjianbr...@momjian.us writes: Tom Lane wrote: Huh? Seems like a waste of text to me. What else would happen? Well, if we exceed work_mem, we spill to temp disk. If we exceed temp disk, we error out. Those different behaviors don't seem obvious

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-07-17 Thread Mark Kirkwood
On 18/07/11 06:25, Tom Lane wrote: Mark Kirkwoodmark.kirkw...@catalyst.net.nz writes: [ temp-files-v6.patch.gz ] I've applied this patch with some editorialization, notably: Awesome, the changes look great! Cheers Mark -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-07-15 Thread Mark Kirkwood
On 15/07/11 14:57, Tatsuo Ishii wrote: Maybe we could add more info regarding current usage and requested amount in addition to the temp file limit value. I mean something like: ERROR: aborting due to exceeding temp file limit. Current usage 9000kB, requested size 1024kB, thus it will exceed

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-07-14 Thread Mark Kirkwood
On 14/07/11 18:48, Tatsuo Ishii wrote: Hi I am the new reviewer:-) I have looked into the v6 patches. One thing I would like to suggest is, enhancing the error message when temp_file_limit will be exceeded. ERROR: aborting due to exceeding temp file limit Is it possible to add the current

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-24 Thread Mark Kirkwood
On 22/06/11 11:13, Mark Kirkwood wrote: On 21/06/11 02:39, Cédric Villemain wrote: 2011/6/20 Robert Haasrobertmh...@gmail.com: On Mon, Jun 20, 2011 at 9:15 AM, Cédric Villemain cedric.villemain.deb...@gmail.com wrote: The feature does not work exactly as expected because the write limit

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-21 Thread Mark Kirkwood
On 21/06/11 02:39, Cédric Villemain wrote: 2011/6/20 Robert Haasrobertmh...@gmail.com: On Mon, Jun 20, 2011 at 9:15 AM, Cédric Villemain cedric.villemain.deb...@gmail.com wrote: The feature does not work exactly as expected because the write limit is rounded per 8kB because we write before

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-16 Thread Mark Kirkwood
On 17/06/11 09:49, Cédric Villemain wrote: I have issues applying it. Please can you remove trailing space? Also, you can generate a cool patch like this : get git-external-diff from postgres/src/tools to /usr/lib/git-core/ chmod +x it export GIT_EXTERNAL_DIFF=git-external-diff git

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-16 Thread Mark Kirkwood
On 17/06/11 13:08, Mark Kirkwood wrote: On 17/06/11 09:49, Cédric Villemain wrote: I have issues applying it. Please can you remove trailing space? Also, you can generate a cool patch like this : get git-external-diff from postgres/src/tools to /usr/lib/git-core/ chmod +x it export

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-14 Thread Mark Kirkwood
On 15/06/11 02:52, Cédric Villemain wrote: 2011/6/3 Mark Kirkwoodmark.kirkw...@catalyst.net.nz: Corrected v4 patch with the test files, for completeness. Note that discussion has moved on and there will be a v5 :-) Mark, can you submit your updated patch ? Thanks for the reminder! Here is

Re: [HACKERS] gcc 4.6 and hot standby

2011-06-08 Thread Mark Kirkwood
On 09/06/11 06:58, Alex Hunsaker wrote: Yeah :-). However ill note it looks like its the default compiler for fedora 15, ubuntu natty and debian sid. FWIW Ubuntu natty uses gcc 4.5.2, probably just as as well in the light of your findings :-) Cheers Mark -- Sent via pgsql-hackers mailing

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-02 Thread Mark Kirkwood
On 02/06/11 18:34, Jaime Casanova wrote: On Wed, Jun 1, 2011 at 6:35 PM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: I've created a new patch (attached) Hi Mark, A few comments: - why only superusers can set this? if this is a per-backend setting, i don't see the problem in allowing

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-02 Thread Mark Kirkwood
On 03/06/11 02:36, Tom Lane wrote: Robert Haasrobertmh...@gmail.com writes: So I'm not sure work_disk is a great name. I agree. Maybe something along the lines of temp_file_limit? Also, once you free yourself from the analogy to work_mem, you could adopt some more natural unit than KB. I'd

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-02 Thread Mark Kirkwood
On 02/06/11 18:34, Jaime Casanova wrote: - the patch adds this to serial_schedule but no test has been added... diff --git a/src/test/regress/serial_schedule b/src/test/regress/serial_schedule index bb654f9..325cb3d 100644 --- a/src/test/regress/serial_schedule +++

[HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-02 Thread Mark Kirkwood
On 03/06/11 12:33, Cédric Villemain wrote: 2011/6/2 Mark Kirkwoodmark.kirkw...@catalyst.net.nz: On 01/06/11 09:24, Cédric Villemain wrote: * I am not sure it is better to add a fileSize like you did or use relationgetnumberofblock() when file is about to be truncated or unlinked, this way the

[HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-01 Thread Mark Kirkwood
On 01/06/11 09:24, Cédric Villemain wrote: Submission review * The patch is not in context diff format. * The patch apply, but contains some extra whitespace. * Documentation is here but not explicit about 'temp tables', maybe worth adding that this won't

Re: [HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-06-01 Thread Mark Kirkwood
On 02/06/11 11:35, Mark Kirkwood wrote: On 01/06/11 09:24, Cédric Villemain wrote: Simple Feature test == either explain buffers is wrong or the patch is wrong: cedric=# explain (analyze,buffers) select * from foo order by 1 desc

[HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-05-31 Thread Mark Kirkwood
On 01/06/11 09:24, Cédric Villemain wrote: Hello here is a partial review of your patch, better than keeping it sleeping in the commitfest queue I hope. Submission review * The patch is not in context diff format. * The patch apply, but contains some extra

[HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-05-31 Thread Mark Kirkwood
On 01/06/11 12:27, Mark Kirkwood wrote: Re the code comments - I agree with most of them. However with respect to the Guc units, I copied the setup for work_mem as that seemed the most related. Also - forget to mention - I *thought* you could specify the temp files size GUC as KB, MB, GB

[HACKERS] Re: patch review : Add ability to constrain backend temporary file space

2011-05-31 Thread Mark Kirkwood
On 01/06/11 12:32, Mark Kirkwood wrote: On 01/06/11 12:27, Mark Kirkwood wrote: Re the code comments - I agree with most of them. However with respect to the Guc units, I copied the setup for work_mem as that seemed the most related. Also - forget to mention - I *thought* you could specify

Re: [HACKERS] increasing collapse_limits?

2011-04-30 Thread Mark Kirkwood
On 01/05/11 11:53, Greg Stark wrote: On Sat, Apr 30, 2011 at 9:21 PM, Tom Lanet...@sss.pgh.pa.us wrote: - it would require a query in which every relation is linked to every other relation by a join clause. But that *can* happen (remember that clauses generated by transitive equality do

Re: [HACKERS] WIP - Add ability to constrain backend temporary file space

2011-03-09 Thread Mark Kirkwood
New version: - adds documentation - adds category RESOURCES_DISK temp-files-v2.patch.gz Description: GNU Zip compressed data -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] WIP - Add ability to constrain backend temporary file space

2011-02-18 Thread Mark Kirkwood
On 19/02/11 02:34, Robert Haas wrote: Please add this to the next CommitFest: https://commitfest.postgresql.org/action/commitfest_view/open With respect to the datatype of the GUC, int seems clearly correct. Why would you want to use a float? Added. With respect to the datatype, using int

Re: [HACKERS] WIP - Add ability to constrain backend temporary file space

2011-02-18 Thread Mark Kirkwood
On 19/02/11 08:48, Josh Berkus wrote: On 2/18/11 11:44 AM, Robert Haas wrote: On Fri, Feb 18, 2011 at 2:41 PM, Josh Berkusj...@agliodbs.com wrote: Second, the main issue with these sorts of macro-counters has generally been their locking effect on concurrent activity. Have you been able to

Re: [HACKERS] WIP - Add ability to constrain backend temporary file space

2011-02-18 Thread Mark Kirkwood
On 19/02/11 10:38, Josh Berkus wrote: To answer the other question, what happens when the limit is exceeded is modeled on statement timeout, i.e query is canceled and a message says why (exceeded temp files size). When does this happen? When you try to allocate the file, or when it does the

Re: [HACKERS] WIP - Add ability to constrain backend temporary file space

2011-02-18 Thread Mark Kirkwood
On 19/02/11 11:30, Josh Berkus wrote: Yeah, the disadvantage is that (like statement timeout) it is a 'bottom of the cliff' type of protection. The advantage is there are no false positives... Yeah, just trying to get a handle on the proposed feature. I have no objections; it seems like a

[HACKERS] WIP - Add ability to constrain backend temporary file space

2011-02-17 Thread Mark Kirkwood
Recently two systems here have suffered severely with excessive temporary file creation during query execution. In one case it could have been avoided by more stringent qa before application code release, whereas the other is an ad-hoc system, and err...yes. In both cases it would have been

[HACKERS] 9.1 (git head) does not compile using --with-libedit-preferred on Ubuntu 10.10

2011-02-15 Thread Mark Kirkwood
Since libedit is getting some attention right now, I figured I'd try using building with it instead of readline. configuring using: ./configure --prefix=/usr/local/pgsql/9.1 --enable-debug --enable-cassert --with-libedit-preferred I get this linking postgres: postmaster/postmaster.o: In

Re: [HACKERS] 9.1 (git head) does not compile using --with-libedit-preferred on Ubuntu 10.10

2011-02-15 Thread Mark Kirkwood
On 16/02/11 14:54, Tom Lane wrote: It's pretty hard to see how those two things would be related. I think more likely libedit is providing a function named setproctitle, which seems like a rather stupid thing for them to have done. You are correct - it defines setproctitle, good grief. --

Re: [HACKERS] 9.1 (git head) does not compile using --with-libedit-preferred on Ubuntu 10.10

2011-02-15 Thread Mark Kirkwood
On 16/02/11 15:05, Mark Kirkwood wrote: On 16/02/11 14:54, Tom Lane wrote: It's pretty hard to see how those two things would be related. I think more likely libedit is providing a function named setproctitle, which seems like a rather stupid thing for them to have done. You are correct

Re: [HACKERS] Re: 9.1 (git head) does not compile using --with-libedit-preferred on Ubuntu 10.10

2011-02-15 Thread Mark Kirkwood
On 16/02/11 15:59, Greg Stark wrote: On Wed, Feb 16, 2011 at 2:43 AM, Mark Kirkwood mark.kirkw...@catalyst.net.nz wrote: What's this libbsd then eh? Sure enough it is this guy that defines these symbols. So it is the way it is being built on the Ubuntu (or Debian) platform. Oh, for what it's

Re: [HACKERS] Linux filesystem performance and checkpoint sorting

2011-02-04 Thread Mark Kirkwood
On 05/02/11 07:31, Greg Smith wrote: Switching to a new thread for this summary since there's some much more generic info here...at this point I've finished exploring the major Linux filesystem and tuning options I wanted to, as part of examining changes to the checkpoint code. You can find

Re: [HACKERS] Apologizing about the ELEPHANTS email.

2011-02-02 Thread Mark Kirkwood
On 03/02/11 10:08, Vaibhav Kaushal wrote: Since postgres has 'Elephants' as its LOGO / ICON, I apologize in particular about that email and request the moderators / admins to kindly forgive me let me stay in the list. I sincerely apologize for the mistake. This is probably the best list to

Re: [HACKERS] REVIEW: EXPLAIN and nfiltered

2011-01-20 Thread Mark Kirkwood
On 21/01/11 15:24, Robert Haas wrote: On Thu, Jan 20, 2011 at 9:17 PM, Kevin Grittner kevin.gritt...@wicourts.gov wrote: Right -- God only knows the number of things were filtered out to leave me with filtered water. What's filtered in this case is what was passed through, not what was

<    1   2   3   4   5   6   >