Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Simon Riggs
On Fri, Apr 27, 2012 at 11:18 PM, Kevin Grittner kevin.gritt...@wicourts.gov wrote: Andres Freund and...@2ndquadrant.com wrote: I'm not convinced that I would rather see the logic fixed inside the master as opposed to being deployable on the master's machine, the slave machine, or even on its

Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Aakash Goel
Aakash, when you get a chance, could you fill in the inch-stones from the GSoC proposal page onto the Wiki page? Sure, http://wiki.postgresql.org/wiki/XReader updated. On Sat, Apr 28, 2012 at 3:48 AM, Kevin Grittner kevin.gritt...@wicourts.gov wrote: Andres Freund and...@2ndquadrant.com

Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Aakash Goel
Hello Andres, The xReader design was based on the idea that it would be nice not to cause load on the master machine, and that by proxying the WAL stream to the HS, using synchronous replication style to write from xReader to the HS, you could use the HS for a source for that data with it

Re: [HACKERS] Future In-Core Replication

2012-04-28 Thread Simon Riggs
On Fri, Apr 27, 2012 at 11:50 PM, Christopher Browne cbbro...@gmail.com wrote: On Fri, Apr 27, 2012 at 4:11 AM, Simon Riggs si...@2ndquadrant.com wrote: What I'm hoping to do is to build a basic prototype of logical replication using WAL translation, so we can inspect it to see what the

Re: [HACKERS] 9.2 release notes, beta time?

2012-04-28 Thread Devrim GÜNDÜZ
Hi, On Fri, 2012-04-27 at 21:17 -0400, Bruce Momjian wrote: We release the alpha with no packaging. I have released RPMs regularly for all alphas before, at least over the last 2 years or so. Regards, -- Devrim GÜNDÜZ Principal Systems Engineer @ EnterpriseDB: http://www.enterprisedb.com

Re: [HACKERS] smart shutdown at end of transaction (was: Default mode for shutdown)

2012-04-28 Thread Peter Eisentraut
On fre, 2012-04-27 at 22:30 +0200, Andres Freund wrote: In the few cases where I investigated it TMs don't use transactions themselves (which I think is correct, they don't need them), so terminating any idle session - which the TM would appear as, as its not using txns - would leave prepared

Re: [HACKERS] smart shutdown at end of transaction (was: Default mode for shutdown)

2012-04-28 Thread Peter Eisentraut
On fre, 2012-04-27 at 18:09 -0400, Tom Lane wrote: Robert Haas robertmh...@gmail.com writes: It seems we need another signal for the new mode, and the obvious candidate is SIGUSR2. But what shall the mapping look like? [Choice #1] SIGUSR2 - slow, SIGTERM - smart, SIGINT - fast, SIGQUIT

Re: [HACKERS] smart shutdown at end of transaction (was: Default mode for shutdown)

2012-04-28 Thread Simon Riggs
On Fri, Apr 27, 2012 at 7:57 PM, Robert Haas robertmh...@gmail.com wrote: I think there is no point at all in having a discussion about this unless we can first agree that the overwhelming majority of people who have commented on this issue on this list are unhappy with the current default

Re: [HACKERS] smart shutdown at end of transaction (was: Default mode for shutdown)

2012-04-28 Thread Simon Riggs
On Fri, Apr 27, 2012 at 8:36 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: All the modes indeed wait (except for immediate), so I think it would make sense to define the modes in terms of *what* they wait for.        wait sessions   - allow existing sessions to finish (old

Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Tom Lane
Simon Riggs si...@2ndquadrant.com writes: Translating WAL is a very hard task. No kidding. I would think it's impossible on its face. Just for starters, where will you get table and column names from? (Looking at the system catalogs is cheating, and will not work reliably anyway.) IMO, if we

Re: [HACKERS] smart shutdown at end of transaction (was: Default mode for shutdown)

2012-04-28 Thread Tom Lane
Peter Eisentraut pete...@gmx.net writes: On fre, 2012-04-27 at 22:30 +0200, Andres Freund wrote: In the few cases where I investigated it TMs don't use transactions themselves (which I think is correct, they don't need them), so terminating any idle session - which the TM would appear as, as

Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Kevin Grittner
Tom Lane wrote: Simon Riggs writes: Translating WAL is a very hard task. No kidding. I would think it's impossible on its face. Just for starters, where will you get table and column names from? (Looking at the system catalogs is cheating, and will not work reliably anyway.) Well, the

Re: [HACKERS] enable_indexonly

2012-04-28 Thread Andrew Dunstan
On 04/27/2012 12:44 PM, Magnus Hagander wrote: Hmm. Forgive me, I pressed the wrong button and looked at current docs rather than dev docs. (Easier when they used to look different...) Maybe we should have the stylesheet watermark the dev docs pages. Are you offering to write the patch?

Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Tom Lane
Kevin Grittner kevin.gritt...@wicourts.gov writes: Tom Lane wrote: Simon Riggs writes: Translating WAL is a very hard task. No kidding. I would think it's impossible on its face. Well, the xReader approach (Aakash's GSoC project) is to serve as a proxy for a WAL stream going to a hot

Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Aakash Goel
Hello Tom, I'm not sure I get the point of logical replication that requires a physical replica as a prerequisite. It would be enormously more performant for the master to be emitting logical replication records to start with, since it already has all the right names etc at hand at

Re: [HACKERS] Welcome 2012 GSOC students

2012-04-28 Thread Aakash Goel
Thanks Josh. It is great to be introduced to the hackers community. My limited experience here has shown me how knowledgeable and helpful the community is. I am looking forward to doing some exciting work this summer with help from the hackers!

Re: [HACKERS] Patch: add timing of buffer I/O requests

2012-04-28 Thread Tom Lane
Robert Haas robertmh...@gmail.com writes: ... You might want to revisit the issue of how the new columns in pg_stat_statements are named, as well. I am not sure I'm happy with that, but neither am I sure that I know what I'd like better. It's not too clear that the timing is specifically for

Re: [HACKERS] Patch: add timing of buffer I/O requests

2012-04-28 Thread Tom Lane
... btw, while I'm criticizing names, how about changing track_iotiming to track_io_timing? The former seems inelegant and unreadable. regards, tom lane -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription:

Re: [HACKERS] 9.2 release notes, beta time?

2012-04-28 Thread Magnus Hagander
On Sat, Apr 28, 2012 at 01:02, Tom Lane t...@sss.pgh.pa.us wrote: Josh Berkus j...@agliodbs.com writes: On 4/27/12 2:29 PM, Bruce Momjian wrote: Someone said one week as not enough, so I assumed a wrap on May 10 with beta release on May 14. Doing a release on May 14 will be a challenge,

Re: [HACKERS] 9.2 release notes, beta time?

2012-04-28 Thread Magnus Hagander
2012/4/28 Josh Berkus j...@agliodbs.com: Ugh.  Maybe the whole idea of getting a beta out before PGCon is doomed. Still, if we don't try for this schedule, we're looking at at least two more weeks' slip, because we're surely not going to wrap during PGCon. We could do it in person! We could

Re: [HACKERS] Re: xReader, double-effort (was: Temporary tables under hot standby)

2012-04-28 Thread Simon Riggs
On Sat, Apr 28, 2012 at 4:43 PM, Tom Lane t...@sss.pgh.pa.us wrote: Kevin Grittner kevin.gritt...@wicourts.gov writes: Tom Lane  wrote: Simon Riggs  writes: Translating WAL is a very hard task. No kidding. I would think it's impossible on its face. Well, the xReader approach (Aakash's GSoC

Re: [HACKERS] Future In-Core Replication

2012-04-28 Thread Hannu Krosing
On Sat, 2012-04-28 at 09:36 +0100, Simon Riggs wrote: On Fri, Apr 27, 2012 at 11:50 PM, Christopher Browne cbbro...@gmail.com wrote: On Fri, Apr 27, 2012 at 4:11 AM, Simon Riggs si...@2ndquadrant.com wrote: What I'm hoping to do is to build a basic prototype of logical replication using

Re: [HACKERS] Future In-Core Replication

2012-04-28 Thread Hannu Krosing
On Sat, 2012-04-28 at 21:40 +0200, Hannu Krosing wrote: On Sat, 2012-04-28 at 09:36 +0100, Simon Riggs wrote: On Fri, Apr 27, 2012 at 11:50 PM, Christopher Browne cbbro...@gmail.com wrote: On Fri, Apr 27, 2012 at 4:11 AM, Simon Riggs si...@2ndquadrant.com wrote: What I'm hoping to

[HACKERS] Re: patch submission: truncate trailing nulls from heap rows to reduce the size of the null bitmap

2012-04-28 Thread Greg Stark
On Fri, Apr 27, 2012 at 1:51 AM, Josh Berkus j...@agliodbs.com wrote: 1. Out of 700 columns, columns 301+ are all Null, so we map them away. 2. User updates column 688 to non-null 3. Suddenly we have a MUCH larger row which will no longer fit on the page. Note that this is only actually 48

Re: [HACKERS] Re: patch submission: truncate trailing nulls from heap rows to reduce the size of the null bitmap

2012-04-28 Thread Robert Haas
On Sat, Apr 28, 2012 at 6:23 PM, Greg Stark st...@mit.edu wrote: On Fri, Apr 27, 2012 at 1:51 AM, Josh Berkus j...@agliodbs.com wrote: 1. Out of 700 columns, columns 301+ are all Null, so we map them away. 2. User updates column 688 to non-null 3. Suddenly we have a MUCH larger row which will

Re: [HACKERS] Patch: add timing of buffer I/O requests

2012-04-28 Thread Robert Haas
On Sat, Apr 28, 2012 at 12:49 PM, Tom Lane t...@sss.pgh.pa.us wrote: Robert Haas robertmh...@gmail.com writes: ... You might want to revisit the issue of how the new columns in pg_stat_statements are named, as well.  I am not sure I'm happy with that, but neither am I sure that I know what I'd

Re: [HACKERS] smart shutdown at end of transaction (was: Default mode for shutdown)

2012-04-28 Thread Robert Haas
On Sat, Apr 28, 2012 at 7:04 AM, Simon Riggs si...@2ndquadrant.com wrote: On Fri, Apr 27, 2012 at 7:57 PM, Robert Haas robertmh...@gmail.com wrote: I think there is no point at all in having a discussion about this unless we can first agree that the overwhelming majority of people who have