Re: [HACKERS] WIP: multivariate statistics / proof of concept

2016-12-02 Thread Haribabu Kommi
On Tue, Nov 22, 2016 at 2:42 PM, Tomas Vondra wrote: > On 11/21/2016 11:10 PM, Robert Haas wrote: > >> [ reviving an old multivariate statistics thread ] >> >> On Thu, Nov 13, 2014 at 6:31 AM, Simon Riggs >> wrote: >> >>> On 12 October 2014

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2016-11-21 Thread Tomas Vondra
On 11/21/2016 11:10 PM, Robert Haas wrote: [ reviving an old multivariate statistics thread ] On Thu, Nov 13, 2014 at 6:31 AM, Simon Riggs wrote: On 12 October 2014 23:00, Tomas Vondra wrote: It however seems to be working sufficiently well at this

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2016-11-21 Thread Robert Haas
[ reviving an old multivariate statistics thread ] On Thu, Nov 13, 2014 at 6:31 AM, Simon Riggs wrote: > On 12 October 2014 23:00, Tomas Vondra wrote: > >> It however seems to be working sufficiently well at this point, enough >> to get some useful

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2016-01-19 Thread Gavin Flower
On 12/12/14 05:53, Heikki Linnakangas wrote: On 10/13/2014 01:00 AM, Tomas Vondra wrote: Hi, attached is a WIP patch implementing multivariate statistics. Great! Really glad to see you working on this. + * FIXME This sample sizing is mostly OK when computing stats for + *

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-04-28 Thread Jeff Janes
On Mon, Mar 30, 2015 at 5:26 PM, Tomas Vondra tomas.von...@2ndquadrant.com wrote: Hello, attached is a new version of the patch series. Aside from fixing various issues (crashes, memory leaks). The patches are rebased to current master, and I also attach a few SQL scripts I used for testing

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-04-28 Thread Stephen Frost
* Jeff Janes (jeff.ja...@gmail.com) wrote: On Mon, Mar 30, 2015 at 5:26 PM, Tomas Vondra tomas.von...@2ndquadrant.com wrote: attached is a new version of the patch series. Aside from fixing various issues (crashes, memory leaks). The patches are rebased to current master, and I also attach

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-04-28 Thread Jeff Janes
On Tue, Apr 28, 2015 at 9:13 AM, Stephen Frost sfr...@snowman.net wrote: * Jeff Janes (jeff.ja...@gmail.com) wrote: On Mon, Mar 30, 2015 at 5:26 PM, Tomas Vondra tomas.von...@2ndquadrant.com wrote: attached is a new version of the patch series. Aside from fixing various issues

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-04-28 Thread Tomas Vondra
Hi, On 04/28/15 19:36, Jeff Janes wrote: ... Thanks. I think I tried that, but was still having trouble. But it turns out that the trouble was for an unrelated reason, and I got it to compile now. Yeah, a new column was added to pg_proc the day after I submitted the pacth. Will address

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-03-24 Thread Tomas Vondra
Hello, On 03/24/15 06:34, Kyotaro HORIGUCHI wrote: Sorry, not shown above, the *previous* t1 had been done alter table t1 add statistics (a, b, c). Removing t1 didn't remove the setting. reiniting cluster let me do that without error. OK, thanks. My guess is this issue got already fixed in

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-03-20 Thread Tomas Vondra
Hello, On 20.3.2015 09:33, Kyotaro HORIGUCHI wrote: Hello, Patch 0001 needs changes for OIDs since my patch was committed. The attached is compatible with current master. Thanks. I plan to submit a new version of the patch in a few days, with significant progress in various directions.

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-03-20 Thread Kyotaro HORIGUCHI
Hello, Patch 0001 needs changes for OIDs since my patch was committed. The attached is compatible with current master. And I tried this like this, and got the following error on analyze. But unfortunately I don't have enough time to investigate it now. postgres=# create table t1 (a int, b int,

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2015-01-15 Thread Michael Paquier
On Mon, Dec 15, 2014 at 11:55 AM, Michael Paquier michael.paqu...@gmail.com wrote: On Wed, Dec 10, 2014 at 5:15 AM, Tomas Vondra t...@fuzzy.cz wrote: I agree with moving the patch to the next CF - I'm working on the patch, but I will take a bit more time to submit a new version and I can do

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-12-11 Thread Heikki Linnakangas
On 10/13/2014 01:00 AM, Tomas Vondra wrote: Hi, attached is a WIP patch implementing multivariate statistics. Great! Really glad to see you working on this. +* FIXME This sample sizing is mostly OK when computing stats for +* individual columns, but when computing

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-12-11 Thread Tomas Vondra
On 11.12.2014 17:53, Heikki Linnakangas wrote: On 10/13/2014 01:00 AM, Tomas Vondra wrote: Hi, attached is a WIP patch implementing multivariate statistics. Great! Really glad to see you working on this. + * FIXME This sample sizing is mostly OK when computing stats for + *

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-12-09 Thread Tomas Vondra
On 8.12.2014 02:01, Michael Paquier wrote: On Sun, Nov 16, 2014 at 3:35 AM, Tomas Vondra t...@fuzzy.cz wrote: Thanks for the link. I've been looking for a good dataset with such data, and this one is by far the best one. The current version of the patch supports only data types passed by

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-12-07 Thread Michael Paquier
On Sun, Nov 16, 2014 at 3:35 AM, Tomas Vondra t...@fuzzy.cz wrote: Thanks for the link. I've been looking for a good dataset with such data, and this one is by far the best one. The current version of the patch supports only data types passed by value (i.e. no varlena types - text, ), which

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-11-15 Thread Kevin Grittner
Tomas Vondra t...@fuzzy.cz wrote: Dne 13 Listopad 2014, 16:51, Katharina Büchse napsal(a): On 13.11.2014 14:11, Tomas Vondra wrote: The only place where I think this might work are the associative rules. It's simple to specify rules like (ZIP code implies city) and we could even do some

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-11-15 Thread Tomas Vondra
On 15.11.2014 18:49, Kevin Grittner If you eliminate the quals besides the zipcode column you get 61 rows and it gets much stranger, with legal municipalities that are completely surrounded by Madison that the postal service would rather you didn't use in addressing your envelopes, but they

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-11-13 Thread Simon Riggs
On 12 October 2014 23:00, Tomas Vondra t...@fuzzy.cz wrote: It however seems to be working sufficiently well at this point, enough to get some useful feedback. So here we go. This looks interesting and useful. What I'd like to check before a detailed review is that this has sufficient

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-11-13 Thread Tomas Vondra
Dne 13 Listopad 2014, 12:31, Simon Riggs napsal(a): On 12 October 2014 23:00, Tomas Vondra t...@fuzzy.cz wrote: It however seems to be working sufficiently well at this point, enough to get some useful feedback. So here we go. This looks interesting and useful. What I'd like to check

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-11-13 Thread Katharina Büchse
On 13.11.2014 14:11, Tomas Vondra wrote: Dne 13 Listopad 2014, 12:31, Simon Riggs napsal(a): On 12 October 2014 23:00, Tomas Vondra t...@fuzzy.cz wrote: It however seems to be working sufficiently well at this point, enough to get some useful feedback. So here we go. This looks interesting

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-11-13 Thread Tomas Vondra
Dne 13 Listopad 2014, 16:51, Katharina Büchse napsal(a): On 13.11.2014 14:11, Tomas Vondra wrote: The only place where I think this might work are the associative rules. It's simple to specify rules like (ZIP code implies city) and we could even do some simple check against the data to see

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-30 Thread David Rowley
On Thu, Oct 30, 2014 at 12:48 AM, Tomas Vondra t...@fuzzy.cz wrote: Dne 29 Říjen 2014, 12:31, Petr Jelinek napsal(a): I've not really gotten around to looking at the patch yet, but I'm also wondering if it would be simple include allowing functional statistics too. The pg_mv_statistic name

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-30 Thread David Rowley
On Thu, Oct 30, 2014 at 12:21 AM, Tomas Vondra t...@fuzzy.cz wrote: Dne 29 Říjen 2014, 10:41, David Rowley napsal(a): I'm quite interested in reviewing your work on this, but it appears that some of your changes are not C89: src\backend\commands\analyze.c(3774): error C2057: expected

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-30 Thread Tomas Vondra
Dne 30 Říjen 2014, 10:17, David Rowley napsal(a): On Thu, Oct 30, 2014 at 12:48 AM, Tomas Vondra t...@fuzzy.cz wrote: Dne 29 Říjen 2014, 12:31, Petr Jelinek napsal(a): I've not really gotten around to looking at the patch yet, but I'm also wondering if it would be simple include allowing

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-29 Thread David Rowley
On Mon, Oct 13, 2014 at 11:00 AM, Tomas Vondra t...@fuzzy.cz wrote: Hi, attached is a WIP patch implementing multivariate statistics. The code certainly is not ready - parts of it look as if written by a rogue chimp who got bored of attempts to type the complete works of William

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-29 Thread Tomas Vondra
Dne 29 Říjen 2014, 10:41, David Rowley napsal(a): I've not really gotten around to looking at the patch yet, but I'm also wondering if it would be simple include allowing functional statistics too. The pg_mv_statistic name seems to indicate multi columns, but how about stats on

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-29 Thread Petr Jelinek
On 29/10/14 10:41, David Rowley wrote: On Mon, Oct 13, 2014 at 11:00 AM, Tomas Vondra t...@fuzzy.cz The last point is really just unfinished implementation - the syntax I propose is this: ALTER TABLE ... ADD STATISTICS (options) ON (columns) where the options influence the

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-29 Thread Tomas Vondra
Dne 29 Říjen 2014, 12:31, Petr Jelinek napsal(a): On 29/10/14 10:41, David Rowley wrote: On Mon, Oct 13, 2014 at 11:00 AM, Tomas Vondra t...@fuzzy.cz The last point is really just unfinished implementation - the syntax I propose is this: ALTER TABLE ... ADD STATISTICS

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-13 Thread Albe Laurenz
Tomas Vondra wrote: attached is a WIP patch implementing multivariate statistics. I think that is pretty useful. Oracle has an identical feature called extended statistics. That's probably an entirely different thing, but it would be very nice to have statistics to estimate the correlation

Re: [HACKERS] WIP: multivariate statistics / proof of concept

2014-10-13 Thread Tomas Vondra
Hi! On 13.10.2014 09:36, Albe Laurenz wrote: Tomas Vondra wrote: attached is a WIP patch implementing multivariate statistics. I think that is pretty useful. Oracle has an identical feature called extended statistics. That's probably an entirely different thing, but it would be very