[HACKERS] pg_execute_from_file review

2010-11-24 Thread Joshua Tolley
I'd ask. * In the snippet below, it seems best just to use palloc0(): query_string = (char *)palloc((fsize+1)*sizeof(char)); memset(query_string, 0, fsize+1); * Shouldn't it include SPI_push() and SPI_pop()? [1] http://archives.postgresql.org/message-id/m262wf6fnz@2ndquad

Re: [HACKERS] pg_execute_from_file review

2010-11-25 Thread Joshua Tolley
On Thu, Nov 25, 2010 at 10:24:51PM +0100, Dimitri Fontaine wrote: > Joshua Tolley writes: > > I've just looked at pg_execute_from_file[1]. The idea here is to execute all > > the SQL commands in a given file. My comments: > > Thanks for your review. Please find atta

Re: [HACKERS] pg_execute_from_file review

2010-11-29 Thread Joshua Tolley
ich would be fairly clear and nicely > > symmetrical. > > +1, but I think "query" is also a noise word here. > Why not just "pg_execute_file" and "pg_execute_string"? > > regards, tom lane While we're bikeshedding, and since I star

Re: [HACKERS] proposal : cross-column stats

2010-12-13 Thread Joshua Tolley
s "...WHERE foo > 4 AND foo > 5". -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Sync Rep Design

2010-12-30 Thread Joshua Tolley
that currently, even without replication, #2 can happen. For what little it's worth, I vote for this option, because it's a problem that can already happen (as opposed to adding an entirely new type of problem to the mix). -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Patch to add a primary key using an existing index

2011-01-25 Thread Joshua Tolley
reverses the effects of ADD CONSTRAINT might be surprised. > Comments? So you'd manually create an index, attach it to a constraint, drop the constraint, and find that the index had disappeared? ISTM since you created the index explicitly, you should have to drop it explicitly as well. -- Jo

Re: [HACKERS] SSI, simplified

2011-01-25 Thread Joshua Tolley
On Sun, Jan 23, 2011 at 07:48:04PM -0600, Kevin Grittner wrote: > http://www.xtranormal.com/watch/8285377/?listid=20642536 I foresee a whole new set of animated postgres tutorials... -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digi

[HACKERS] Making pg_config and pg_controldata output available via SQL

2010-02-03 Thread Joshua Tolley
e? In particular it's useful to be able to find $libdir without requiring pg_config, as some packagers tend not to include it in anything put the -dev packages, but all those settings seem useful to have on hand, and in at least most cases shouldn't be tough to expose via SQL. Comments? -

Re: [HACKERS] Making pg_config and pg_controldata output available via SQL

2010-02-03 Thread Joshua Tolley
On Wed, Feb 03, 2010 at 02:32:47PM -0500, Tom Lane wrote: > Joshua Tolley writes: > > I'd really like to see the data from pg_config and pg_controldata available > > through SQL, such as by adding output to pg_show_all_settings(), or adding > > new > > SRFs name

Re: [HACKERS] knngist patch support

2010-02-13 Thread Joshua Tolley
archSysCache et al. to SearchSysCache1, etc.? It seems to me that requires changes to all kinds of software without any real need. The four lines of PL/LOLCODE that inspired this thought aren't themselves a great burden, but when combined with everyone else using SearchSysCache already... -- Josh

Re: [HACKERS] machine-readable pg_controldata?

2010-03-04 Thread Joshua Tolley
just haven't gotten around to writing it. But +1 from me, FWIW. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Thoughts on pg_hba.conf rejection

2010-04-08 Thread Joshua Tolley
her it's disallowed by lack of a rule, or by existence of a "reject" rule, or by something else entirely. As long as the message isn't clearly wrong in the "reject" case, as it is now. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

[HACKERS] wal_level and continuous archiving documentation

2010-05-13 Thread Joshua Tolley
hese statements, WAL would not contain enough information for archive recovery." ISTM wal_archive should make an appearance where the docs bring up archive_mode and archive_command, to say "wal_level must be set to 'archive' or 'hot_standby'", so all requir

Re: [HACKERS] Specification for Trusted PLs?

2010-05-21 Thread Joshua Tolley
aunch_missiles() would have a function in an untrusted language to do it, but there's no reason an untrusted language shouldn't be able to say "SELECT launch_missiles()". -- Joshua Tolley / eggyknap End Point Corporation -- Sent via pgsql-hackers mailing list (pgsql-hackers@po

Re: [HACKERS] Specification for Trusted PLs?

2010-05-21 Thread Joshua Tolley
On Fri, May 21, 2010 at 2:04 PM, Tom Lane wrote: > Joshua Tolley writes: >> Agreed. As long as a trusted language can do things outside the >> database only by going through a database and calling some function to >> which the user has rights, in an untrusted language, that

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-09-02 Thread Joshua Tolley
t; discussion. Oracle provides this, among other possible configurations; perhaps that's why it came up earlier. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] [PATCH] Add _PG_init to PL language handler documentation

2010-05-26 Thread Joshua Tolley
ented. +1. How about the attached (which, incidentally, tested successfully on my box, because I've managed to achieve doc building nirvana through blindly flailing about until it worked...)? -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com diff --git a/doc/src/sgml/plha

Re: [HACKERS] [PATCH] Add _PG_init to PL language handler documentation

2010-06-09 Thread Joshua Tolley
On Tue, Jun 08, 2010 at 04:18:08PM -0400, Robert Haas wrote: > On Wed, May 26, 2010 at 11:24 PM, Joshua Tolley wrote: > > On Wed, May 26, 2010 at 03:47:25PM -0400, Robert Haas wrote: > >> On Tue, May 25, 2010 at 4:34 AM, Jonathan Leto wrote: > >> > This tiny

[HACKERS] Out of date comment in xlogutils.c

2010-07-08 Thread Joshua Tolley
al reasons, instead of a ReadBufferMode argument, this only -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] cross column correlation revisted

2010-07-14 Thread Joshua Tolley
es are in analyze.c; no user-visible changes have been introduced. For that matter, there aren't any changes yet actually to use the values once calculated (more unresolved questions get in the way there), but it's a start. [1] http://en.wikipedia.org/wiki/Copula_(statistics)

Re: [HACKERS] cross column correlation revisted

2010-07-14 Thread Joshua Tolley
ven sufficiently effective to merit the increased code size and complexity, we can consider expanding it to joined relations. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] cross column correlation revisted

2010-07-15 Thread Joshua Tolley
t; one side question: does anybody happen to know how this is one in oracle or > db2? Neither appear to handle multi-column statistics in any form. [1] http://download.oracle.com/docs/cd/B13789_01/appdev.101/b10802/d_stats.htm [2] http://www.ibm.com/developerworks/data/library/techarticle/dm-060

Re: [HACKERS] Synchronous replication

2010-07-26 Thread Joshua Tolley
cases. [1] http://download.oracle.com/docs/cd/B28359_01/server.111/b28294/protection.htm#SBYDB02000 alternatively, http://is.gd/dLkq4 -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Synchronous replication

2010-07-27 Thread Joshua Tolley
On Tue, Jul 27, 2010 at 01:41:10PM +0900, Fujii Masao wrote: > On Tue, Jul 27, 2010 at 12:36 PM, Joshua Tolley wrote: > > Perhaps I'm hijacking the wrong thread for this, but I wonder if the quorum > > idea is really the best thing for us. I've been thinking about Oracl

Re: [HACKERS] Synchronous replication

2010-07-27 Thread Joshua Tolley
On Tue, Jul 27, 2010 at 10:53:45PM +0900, Fujii Masao wrote: > On Tue, Jul 27, 2010 at 10:12 PM, Joshua Tolley wrote: > > My concern is that in a quorum system, if the quorum number is less than the > > total number of replicas, there's no way to know *which* replicas composed

[HACKERS] GROUPING SETS revisited

2010-08-02 Thread Joshua Tolley
hackers/2009-05/msg00700.php -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com diff --git a/src/backend/parser/Makefile b/src/backend/parser/Makefile index a8f4c07..fb248a6 100644 *** a/src/backend/parser/Makefile --- b/src/backend/parser/Makefile *** override CPP

Re: [HACKERS] GROUPING SETS revisited

2010-08-03 Thread Joshua Tolley
from that also enclosed. > Yeah, I seem to have done a poor job of producing the patch based on the repository I was working from. That said, it seems Pavel's working actively on a patch anyway, so perhaps my updating the old one isn't all that worthwhile. Pavel, is your code somewhere that we can get to it? -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] GROUPING SETS revisited

2010-08-04 Thread Joshua Tolley
#x27;s useful, but it seems that since Pavel's code is due to appear sometime in the foreseeable future, there's not much point in my doing that. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] GROUPING SETS revisited

2010-08-04 Thread Joshua Tolley
*can* edit comments/docs :) -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] GROUPING SETS revisited

2010-08-05 Thread Joshua Tolley
On Thu, Aug 05, 2010 at 04:46:51PM +0200, Pavel Stehule wrote: > So Joshua, can you look on code? Sure... thanks :) -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] GROUPING SETS revisited

2010-08-06 Thread Joshua Tolley
point, but it hasn't been implemented yet (or no one has figured out how to do it)? -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] grouping sets - updated patch

2010-08-09 Thread Joshua Tolley
aven't made it through the last version much, but I'll poke through this instead. I have a few days of family business coming up, and might be unrespondive during that time. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Grouping Sets

2011-09-19 Thread Joshua Tolley
st bet is probably to get the code from approximately the date of the patch. As far as I know it hasn't been touched in a while, and didn't work well back when it was being actively developed. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com pgpeMKakIJ2SX.p

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-29 Thread Joshua Tolley
On Sat, Nov 28, 2009 at 10:15:40PM -0500, Tom Lane wrote: > Joshua Tolley writes: > > Makes sense on both counts. Thanks for the help. How does the attached look? > > Applied with minor corrections, mainly around the state save/restore > logic. I also put in some code to f

Re: [HACKERS] PL/Python array support

2009-12-01 Thread Joshua Tolley
j...@josh*# create function return_arr() returns int[] as $$ return (1, 2, 3, 4, 5) $$ language plpythonu; CREATE FUNCTION 5432 j...@josh*# select return_arr(); return_arr - {1,2,3,4,5} (1 row) 5432 j...@josh*# select * from return_set(); return_set ---- 1 2

Re: [HACKERS] PL/Python array support

2009-12-02 Thread Joshua Tolley
On Fri, Nov 20, 2009 at 12:00:24AM +0200, Peter Eisentraut wrote: > On fre, 2009-11-13 at 18:46 +0300, Teodor Sigaev wrote: > > CREATE OR REPLACE FUNCTION incr(stuff int[]) RETURNS int[] AS $$ > > for x in stuff: > > yield x+1 > > $$ > > LANGUAGE 'plpythonu'; > > > > # select incr(ARRAY[1,2,3

Re: [HACKERS] Need a mentor, and a project.

2009-12-07 Thread Joshua Tolley
hat consensus early on, rather than after you've written a lot of code. The keyword "proposal" might be a useful search term when digging in the -hackers archives for historical examples. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Time to run initdb is mostly figure-out-the-timezone work

2009-12-18 Thread Joshua Tolley
r. > I have the exact same issue: For whatever it's worth, I get it too, on Ubuntu 9.04... ~4s without TZ vs. ~1.8s with TZ. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

[HACKERS] Hot standby documentation

2010-01-07 Thread Joshua Tolley
-availability.html -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] per-user pg_service.conf

2010-01-13 Thread Joshua Tolley
me. I was similarly surprised to learn the same thing recently, but admit I didn't take the time see how easily it could be changed. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] development setup and libdir

2010-01-30 Thread Joshua Tolley
s one (or two or fifty or so) where you > *will* need it. Not just debug information (the --enable-debug flag to the configure script), but also --enable-cassert, --enable-depend, and/or others you're likely to want to use during development. -- Joshua Tolley / eggyknap End Point Co

[HACKERS] \ef should probably append semicolons

2008-10-10 Thread Joshua Tolley
The new \ef psql command creates nicely usable "CREATE OR REPLACE FUNCTION ..." text based on the function I tell it to edit, but the text it creates *doesn't* include a final semicolon, so when I exit my editor-of-choice after messing with my function, it doesn't run the code I've given it until I

Re: [HACKERS] \ef should probably append semicolons

2008-10-10 Thread Joshua Tolley
On Fri, Oct 10, 2008 at 7:10 PM, Tom Lane <[EMAIL PROTECTED]> wrote: > "Joshua Tolley" <[EMAIL PROTECTED]> writes: >> The new \ef psql command creates nicely usable "CREATE OR REPLACE >> FUNCTION ..." text based on the function I tell it to edit,

Re: [HACKERS] Cross-column statistics revisited

2008-10-15 Thread Joshua Tolley
On Wed, Oct 15, 2008 at 7:51 AM, Gregory Stark <[EMAIL PROTECTED]> wrote: > "Joshua Tolley" <[EMAIL PROTECTED]> writes: > >> I've been interested in what it would take to start tracking >> cross-column statistics. A review of the mailing lists as l

[HACKERS] Cross-column statistics revisited

2008-10-15 Thread Joshua Tolley
I've been interested in what it would take to start tracking cross-column statistics. A review of the mailing lists as linked from the TODO item on the subject [1] suggests the following concerns: 1) What information exactly would be tracked? 2) How would it be kept from exploding in size? 3) For

Re: [HACKERS] Cross-column statistics revisited

2008-10-16 Thread Joshua Tolley
On Thu, Oct 16, 2008 at 2:54 PM, Josh Berkus <[EMAIL PROTECTED]> wrote: > Tom, > >> (I'm not certain of how to do that efficiently, even if we had the >> right stats :-() > > I was actually talking to someone about this at pgWest. Apparently there's > a fair amount of academic algorithms devoted t

Re: [HACKERS] Cross-column statistics revisited

2008-10-16 Thread Joshua Tolley
On Thu, Oct 16, 2008 at 6:32 PM, Tom Lane <[EMAIL PROTECTED]> wrote: > It appears to me that a lot of people in this thread are confusing > correlation in the sense of statistical correlation between two > variables with correlation in the sense of how well physically-ordered > a column is. For wh

Re: [HACKERS] Cross-column statistics revisited

2008-10-16 Thread Joshua Tolley
On Thu, Oct 16, 2008 at 8:38 PM, Tom Lane <[EMAIL PROTECTED]> wrote: > "Joshua Tolley" <[EMAIL PROTECTED]> writes: >> For what it's worth, neither version of correlation was what I had in >> mind. Statistical correlation between two variables is a single &

Re: [HACKERS] Cross-column statistics revisited

2008-10-17 Thread Joshua Tolley
On Fri, Oct 17, 2008 at 3:47 PM, Nathan Boley <[EMAIL PROTECTED]> wrote: Right now our "histogram" values are really quantiles; the statistics_target T for a column determines a number of quantiles we'll keep track of, and we grab values from into an ordered list L so that appro

Re: [HACKERS] Cross-column statistics revisited

2008-10-18 Thread Joshua Tolley
On Fri, Oct 17, 2008 at 7:54 PM, Nathan Boley <[EMAIL PROTECTED]> wrote: >> I'm still working my way around the math, but copulas sound better >> than anything else I've been playing with. > > I think the easiest way to think of them is, in 2-D finite spaces, > they are just a plot of the order sta

Re: [HACKERS] Lisp as a procedural language?

2008-10-20 Thread Joshua Tolley
On Mon, Oct 20, 2008 at 12:56 PM, John DeSoi <[EMAIL PROTECTED]> wrote: > > On Oct 19, 2008, at 1:27 PM, Douglas McNaught wrote: > >> SBCL is a big and very sophisticated program. It's designed to be a >> self-contained Lisp system and has (AFAIK) no concessions to >> "embeddability". It uses thr

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-01 Thread Joshua Tolley
On Mon, Oct 20, 2008 at 4:42 PM, Lawrence, Ramon <[EMAIL PROTECTED]> wrote: > We propose a patch that improves hybrid hash join's performance for large > multi-batch joins where the probe relation has skew. > > Project name: Histojoin > Patch file: histojoin_v1.patch > > This patch implements the H

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-02 Thread Joshua Tolley
On Sun, Nov 2, 2008 at 4:48 PM, Lawrence, Ramon <[EMAIL PROTECTED]> wrote: > Joshua, > > Thank you for offering to review the patch. > > The easiest way to test would be to generate your own TPC-H data and > load it into a database for testing. I have posted the TPC-H generator > at: > > http://pe

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-05 Thread Joshua Tolley
On Mon, Oct 20, 2008 at 03:42:49PM -0700, Lawrence, Ramon wrote: >We propose a patch that improves hybrid hash join's performance for large >multi-batch joins where the probe relation has skew. I'm running into problems with this patch. It applies cleanly, and the technique you provided fo

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-05 Thread Joshua Tolley
On Mon, Oct 20, 2008 at 03:42:49PM -0700, Lawrence, Ramon wrote: >We propose a patch that improves hybrid hash join's performance for large >multi-batch joins where the probe relation has skew. I also recommend modifying docs/src/sgml/config.sgml to include the enable_hashjoin_usestatmcvs

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-05 Thread Joshua Tolley
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Wed, Nov 5, 2008 at 8:20 AM, Tom Lane wrote: > Joshua Tolley writes: >> On Mon, Oct 20, 2008 at 03:42:49PM -0700, Lawrence, Ramon wrote: >>> We propose a patch that improves hybrid hash join's performance for large >>

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-05 Thread Joshua Tolley
On Wed, Nov 05, 2008 at 04:06:11PM -0800, Bryce Cutt wrote: > The error is causes by me Asserting against the wrong variable. I > never noticed this as I apparently did not have assertions turned on > on my development machine. That is fixed now and with the new patch > version I have attached al

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-06 Thread Joshua Tolley
On Wed, Nov 5, 2008 at 5:06 PM, Bryce Cutt <[EMAIL PROTECTED]> wrote: > The error is causes by me Asserting against the wrong variable. I > never noticed this as I apparently did not have assertions turned on > on my development machine. That is fixed now and with the new patch > version I have a

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-06 Thread Joshua Tolley
On Thu, Nov 6, 2008 at 3:52 PM, Simon Riggs <[EMAIL PROTECTED]> wrote: > > On Thu, 2008-11-06 at 15:33 -0700, Joshua Tolley wrote: > >> Stay tuned. > > Minor question on this patch. AFAICS there is another patch that seems > to be aiming at exactly the same use ca

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-06 Thread Joshua Tolley
On Thu, Nov 6, 2008 at 5:31 PM, Lawrence, Ramon <[EMAIL PROTECTED]> wrote: >> -Original Message- >> > Minor question on this patch. AFAICS there is another patch that > seems >> > to be aiming at exactly the same use case. Jonah's Bloom filter > patch. >> > >> > Shouldn't we have a dust off

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-11-10 Thread Joshua Tolley
On Wed, Nov 05, 2008 at 04:06:11PM -0800, Bryce Cutt wrote: > The error is causes by me Asserting against the wrong variable. I > never noticed this as I apparently did not have assertions turned on > on my development machine. That is fixed now and with the new patch > version I have attached al

Re: [HACKERS] Question about SPI_prepare

2008-11-11 Thread Joshua Tolley
On Tue, Nov 11, 2008 at 11:33:41AM -0600, Tim Keitt wrote: > I have an application where I am building a plan with SPI_plan and > then this plan is called multiple times. There is one free parameter > ($1) to the plan. The issue is with the order of the values returned. > If $1 is identical during

[HACKERS] Patch Review Complete: Multi-Batch Hash Join Improvements

2008-11-17 Thread Joshua Tolley
Note: this email is effectively a repeat of an email sent earlier to which there has been less response than I expected. If there's something else I'm supposed to do at this point, someone please let me know, because I don't know what it is :) --- I've finished all

Re: [HACKERS] Patch Review Complete: Multi-Batch Hash Join Improvements

2008-11-18 Thread Joshua Tolley
On Mon, Nov 17, 2008 at 10:42:21PM -0800, Jeff Davis wrote: > On Mon, 2008-11-17 at 23:19 -0700, Joshua Tolley wrote: > > -- it speeds up joins by fairly significant margins in some cases > > The original claim in the message you cite says 10-50% for some data > distributions

Re: [HACKERS] Simple postgresql.conf wizard -- Statistics idea...

2008-11-26 Thread Joshua Tolley
On Tue, Nov 25, 2008 at 06:59:25PM -0800, Dann Corbit wrote: > I do have a statistics idea/suggestion (possibly useful with some future > PostgreSQL 9.x or something): > It is a simple matter to calculate lots of interesting univarate summary > statistics with a single pass over the data (perhaps d

Re: [HACKERS] Simple postgresql.conf wizard

2008-11-27 Thread Joshua Tolley
On Thu, Nov 27, 2008 at 05:15:04PM -0500, Robert Haas wrote: > A random thought: maybe the reason I'm not seeing any benefit is > because my tables are just too small - most contain at most a few > thousand rows, and some are much smaller. Maybe > default_statistics_target should vary with the tab

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-12-22 Thread Joshua Tolley
On Sun, Dec 21, 2008 at 10:25:59PM -0500, Robert Haas wrote: > [Some performance testing.] I (finally!) have a chance to post my performance testing results... my apologies for the really long delay. Unfortunately I'm not seeing wonderful speedups with the particular queries I did in this case.

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-12-23 Thread Joshua Tolley
On Tue, Dec 23, 2008 at 09:22:27AM -0500, Robert Haas wrote: > On Tue, Dec 23, 2008 at 2:21 AM, Bryce Cutt wrote: > > Because there is no nice way in PostgreSQL (that I know of) to derive > > a histogram after a join (on an intermediate result) currently > > usingMostCommonValues is only enabled o

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-Batch Hash Join for Skewed Data Sets

2008-12-23 Thread Joshua Tolley
On Tue, Dec 23, 2008 at 10:14:29AM -0500, Robert Haas wrote: > > It's equivalent to our assumption that distributions of values in > > columns in the same table are independent. Making that assumption in > > this case would probably result in occasional dramatic speed > > improvements similar to th

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-BatchHash Join for Skewed Data Sets

2009-01-07 Thread Joshua Tolley
On Tue, Jan 06, 2009 at 11:49:57PM -0500, Robert Haas wrote: > Josh / eggyknap - > > Can you rerun your performance tests with this version of the patch? > > ...Robert Will do, as soon as I can. signature.asc Description: Digital signature

Re: [HACKERS] Implementation of GROUPING SETS (T431: Extended grouping capabilities)

2009-09-02 Thread Joshua Tolley
certainly wouldn't bother trying to implement it. It's very helpful that you've let us know you're not working on it. That way Pavel, if he finds he has time and interest, or someone else, can work on it without fear of conflicting with what you're doing. Thanks fo

[HACKERS] autovacuum_max_workers docs

2009-09-11 Thread Joshua Tolley
parameter can only be set at server start. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] autovacuum_max_workers docs

2009-09-13 Thread Joshua Tolley
On Sun, Sep 13, 2009 at 10:54:21PM +0300, Peter Eisentraut wrote: > On fre, 2009-09-11 at 07:39 -0600, Joshua Tolley wrote: > While your discovery is accurate and the change makes it consistent with > other similar parameters, note that the previous wording is also > completely co

Re: [HACKERS] WIP: generalized index constraints

2009-09-15 Thread Joshua Tolley
(2), (3); j...@josh*# insert into a values (8), (3), (4); ERROR: duplicate key value violates unique constraint "a_unique" DETAIL: Key (a)=(3) already exists. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] WIP: generalized index constraints

2009-09-15 Thread Joshua Tolley
e that was adequately short-and-sweet, and still conveyed the idea of both "operator" and "index", which seems important so as to designate between these and the constraints we've had all along. Perhaps "indexed operator constraints"? -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Feedback on getting rid of VACUUM FULL

2009-09-17 Thread Joshua Tolley
s get moved > per call. Presumably this couldn't easily be an upper bound on the time spent moving tuples, rather than an upper bound on the number of tuples moved? -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] syslog_line_prefix

2009-09-25 Thread Joshua Tolley
These two logs need not necessarily contain the same information. Loads of people seem to want to be able to have separate per-database log files, which something like this could also allow. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] syslog_line_prefix

2009-09-25 Thread Joshua Tolley
logger know things about the log messages it gets (rather than just having an opaque string), and route messages various places, accordingly. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] syslog_line_prefix

2009-09-25 Thread Joshua Tolley
On Fri, Sep 25, 2009 at 05:04:45PM -0400, Robert Haas wrote: > On Fri, Sep 25, 2009 at 4:58 PM, Joshua Tolley wrote: > > On Fri, Sep 25, 2009 at 03:19:36PM -0400, Tom Lane wrote: > >> However, I don't think I actually believe the premise of this patch, > >> which

Re: [HACKERS] syslog_line_prefix

2009-09-25 Thread Joshua Tolley
On Fri, Sep 25, 2009 at 05:04:45PM -0400, Robert Haas wrote: > On Fri, Sep 25, 2009 at 4:58 PM, Joshua Tolley wrote: > > On Fri, Sep 25, 2009 at 03:19:36PM -0400, Tom Lane wrote: > >> However, I don't think I actually believe the premise of this patch, > >> which

Re: [HACKERS] WIP - syslogger infrastructure changes

2009-09-26 Thread Joshua Tolley
rainstorm It doesn't have anything linking to it right now, which might be a bad thing. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Feature Suggestion: PL/Js

2009-10-07 Thread Joshua Tolley
think Josh Tolley has some slides on how we built PL/LOLCODE that > could prove useful. Said slides are available here: http://www.pgcon.org/2009/schedule/events/159.en.html I hope they can be useful. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com signature.asc Description: Digital signature

Re: [HACKERS] Feature Suggestion: PL/Js

2009-10-07 Thread Joshua Tolley
On Wed, Oct 07, 2009 at 11:29:15AM -0400, Alvaro Herrera wrote: > Joshua Tolley escribió: > > On Wed, Oct 07, 2009 at 10:22:02AM -0400, Alvaro Herrera wrote: > > > Kiswono Prayogo escribió: > > > > by using latest v8 engine from google, is it possible to build PL/Js

[HACKERS] plperl and inline functions -- first draft

2009-11-05 Thread Joshua Tolley
lperl's trusted interpreter initialization works, and have simply copied what looked like important stuff from the original plperl call handler. I tested with this to prove it: DO $$ qx{touch test.txt}; $$ language plperl; This works both with plperl and plperlu. Hints, anyone? Comment

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-05 Thread Joshua Tolley
On Thu, Nov 05, 2009 at 05:51:45PM -0500, Andrew Dunstan wrote: > Joshua Tolley wrote: >> I've been trying to make pl/perl support 8.5's inline functions, with the >> attached patch. > > Wow, this is the second time this week that people have produced patches >

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-09 Thread Joshua Tolley
On Fri, Nov 06, 2009 at 09:53:20PM -0500, Andrew Dunstan wrote: > > > Joshua Tolley wrote: >> I looked through the >> regression tests and didn't find any that used plperl -- should we add one >> for >> this (or for this and all kinds of other stuff)? Is

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-12 Thread Joshua Tolley
On Fri, Nov 06, 2009 at 09:53:20PM -0500, Andrew Dunstan wrote: > Joshua Tolley wrote: >> I looked through the >> regression tests and didn't find any that used plperl -- should we add one >> for >> this (or for this and all kinds of other stuff)? Is there

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-16 Thread Joshua Tolley
PL/Perl mention used the same term. I can accept that argument. The attached patch modifies the documentation, and fixes another inconsistency I found. -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com diff --git a/doc/src/sgml/plperl.sgml b/doc/src/sgml/plperl.sgml i

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-17 Thread Joshua Tolley
On Wed, Nov 18, 2009 at 09:35:35AM +1100, Brendan Jurd wrote: > 2009/11/17 Joshua Tolley : > > On Sun, Nov 15, 2009 at 12:10:33PM +1100, Brendan Jurd wrote: > >> I noticed that there was a fairly large amount of bogus/inconsistent > >> whitespace > ... > > >

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-17 Thread Joshua Tolley
_call_perl_func should be cast to void to avoid a >> possible compiler warning (although It doesn't emit one on my system): >> >> (void) plperl_call_perl_func(&desc, &fake_fcinfo); > > Right. I don't get the warning either, and didn't realize it could

Re: [HACKERS] plperl and inline functions -- first draft

2009-11-19 Thread Joshua Tolley
n both counts. Thanks for the help. How does the attached look? -- Joshua Tolley / eggyknap End Point Corporation http://www.endpoint.com diff --git a/doc/src/sgml/plperl.sgml b/doc/src/sgml/plperl.sgml index 49631f2..ebcb608 100644 *** a/doc/src/sgml/plperl.sgml --- b/doc/src/sgml/plperl.s

Re: [HACKERS] Application name patch - v4

2009-11-28 Thread Joshua Tolley
acket then this wouldn't > be a problem, but we are far from being able to do that. Nothing I've written uses RESET ALL, but if it did, I expect it would be because whatever the connection was being used for in the past differs substantially from whatever I plan to use it for in

Re: [HACKERS] adding stuff to parser, question

2009-01-31 Thread Joshua Tolley
On Sat, Jan 31, 2009 at 05:40:57PM +, Grzegorz Jaskiewicz wrote: > On 31 Jan 2009, at 17:30, Andrew Dunstan wrote: >> But the syntax you posted does not do this at all. Where does it >> restrict the grant to a single schema, like the syntax above? > I am just starting the attempt here, obviou

Re: [HACKERS] adding stuff to parser, question

2009-02-01 Thread Joshua Tolley
On Sun, Feb 01, 2009 at 12:12:47AM +, Grzegorz Jaskiewicz wrote: > On 1 Feb 2009, at 00:05, Joshua Tolley wrote: >> to add new syntax, you might consider writing a function instead. This >> function might take parameters such as the privilege to grant and the >> user to &

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-BatchHash Join for Skewed Data Sets

2009-02-19 Thread Joshua Tolley
On Wed, Feb 18, 2009 at 11:20:03PM -0500, Robert Haas wrote: > On Wed, Jan 7, 2009 at 9:14 AM, Joshua Tolley wrote: > > On Tue, Jan 06, 2009 at 11:49:57PM -0500, Robert Haas wrote: > >> Josh / eggyknap - > >> > >> Can you rerun your performance

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-BatchHash Join for Skewed Data Sets

2009-02-26 Thread Joshua Tolley
On Wed, Feb 25, 2009 at 10:24:21PM -0500, Robert Haas wrote: > I don't think we're really doing this the right way. EXPLAIN ANALYZE > has a measurable effect on the results, and we probably ought to stop > the database and drop the VM caches after each query. Are the Z1-Z7 > datasets on line some

Re: [HACKERS] Proposed Patch to Improve Performance of Multi-BatchHash Join for Skewed Data Sets

2009-02-26 Thread Joshua Tolley
On Thu, Feb 26, 2009 at 08:22:52AM -0500, Robert Haas wrote: > On Thu, Feb 26, 2009 at 4:22 AM, Heikki Linnakangas > wrote: > > Joshua, in the tests that you've been running, did you have to rig the > > planner with "enable_mergjoin=off" or similar, to get the queries to use > > hash joins? > > I

Re: [HACKERS] Make SIGHUP less painful if pg_hba.conf is not readable

2009-03-04 Thread Joshua Tolley
On Wed, Mar 04, 2009 at 09:43:55AM +0100, Magnus Hagander wrote: > So. I've updated the comment, and applied your patch. Thanks! What would it take to get it applied to a few earlier versions as well? - Josh signature.asc Description: Digital signature

Re: [HACKERS] Make SIGHUP less painful if pg_hba.conf is not readable

2009-03-04 Thread Joshua Tolley
On Wed, Mar 04, 2009 at 10:28:42AM +0100, Magnus Hagander wrote: > Joshua Tolley wrote: > > On Wed, Mar 04, 2009 at 09:43:55AM +0100, Magnus Hagander wrote: > >> So. I've updated the comment, and applied your patch. Thanks! > > > > What would it take to get it a

[HACKERS] SYNONYMs revisited

2009-03-04 Thread Joshua Tolley
Way back in this thread[1] one of the arguments against allowing some version of CREATE SYNONYM was that we couldn't create a synonym for an object in a remote database. Will the SQL/MED work make this sort of thing a possibility? I realize since it's not standard anyway, there's still a discussion

  1   2   >