Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Pavel Stehule
2014-04-22 19:02 GMT+02:00 Josh Berkus : > On 04/22/2014 06:39 AM, Andrew Dunstan wrote: > > I agree, and indeed that was something like my first reaction to hearing > > about this development - FDW seems like a very odd way to handle this. > > But the notion of builtin columnar storage suggests t

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Josh Berkus
On 04/22/2014 06:39 AM, Andrew Dunstan wrote: > I agree, and indeed that was something like my first reaction to hearing > about this development - FDW seems like a very odd way to handle this. > But the notion of builtin columnar storage suggests to me that we really > need first to tackle how var

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Stephen Frost
* Andrew Dunstan (and...@dunslane.net) wrote: > I agree, and indeed that was something like my first reaction to > hearing about this development - FDW seems like a very odd way to > handle this. But the notion of builtin columnar storage suggests to > me that we really need first to tackle how var

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Simon Riggs
On 22 April 2014 13:15, MauMau wrote: > Great! I'm looking forward to seeing PostgreSQL evolve as an analytics > database for data warehousing. Is there any reason why in-memory database > and MPP is not included? Those ideas are valid; the features are bounded by resource constraints of time

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Andrew Dunstan
On 04/22/2014 08:04 AM, Simon Riggs wrote: On 22 April 2014 00:24, Josh Berkus wrote: On 04/21/2014 03:41 PM, Simon Riggs wrote: Storage Efficiency * Compression * Column Orientation You might look at turning this: http://citusdata.github.io/cstore_fdw/ ... into a more integrated part of P

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Andrew Dunstan
On 04/22/2014 08:15 AM, MauMau wrote: Are you planning to include the above features in 9.5 and 9.6? Are you recommending other developers not implement these features to avoid duplication of work with AXLE? Without pointing any fingers, I should note that I have learned the hard way

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Hannu Krosing
On 04/22/2014 02:04 PM, Simon Riggs wrote: > On 22 April 2014 00:24, Josh Berkus wrote: >> On 04/21/2014 03:41 PM, Simon Riggs wrote: >>> Storage Efficiency >>> * Compression >>> * Column Orientation >> You might look at turning this: >> >> http://citusdata.github.io/cstore_fdw/ >> >> ... into a m

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread MauMau
From: "Simon Riggs" Some of areas of R&D are definitely on the roadmap, others are more flexible. Some of this is in progress, other stuff is not even at the design stage - yet, just a few paragraphs along the lines of "we will look at these topics". If we have room, its possible we may accommod

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Hannu Krosing
On 04/22/2014 01:24 AM, Josh Berkus wrote: > On 04/21/2014 03:41 PM, Simon Riggs wrote: >> Storage Efficiency >> * Compression >> * Column Orientation > You might look at turning this: > > http://citusdata.github.io/cstore_fdw/ > > ... into a more integrated part of Postgres. What would be of more

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Simon Riggs
On 22 April 2014 10:42, Jov wrote: > what about runtime code generation using LLVM? > http://blog.cloudera.com/blog/2013/02/inside-cloudera-impala-runtime-code-generation/ > http://llvm.org/devmtg/2013-11/slides/Wanderman-Milne-Cloudera.pdf Those techniques have been in use for at least 20 years

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Simon Riggs
On 22 April 2014 00:24, Josh Berkus wrote: > On 04/21/2014 03:41 PM, Simon Riggs wrote: >> Storage Efficiency >> * Compression >> * Column Orientation > > You might look at turning this: > > http://citusdata.github.io/cstore_fdw/ > > ... into a more integrated part of Postgres. Of course I'm awar

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-22 Thread Jov
what about runtime code generation using LLVM? http://blog.cloudera.com/blog/2013/02/inside-cloudera-impala-runtime-code-generation/ http://llvm.org/devmtg/2013-11/slides/Wanderman-Milne-Cloudera.pdf Jov blog: http:amutu.com/blog 2014-04-22 6:41 GMT+08:00 Simon Riggs : >

Re: [HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-21 Thread Josh Berkus
On 04/21/2014 03:41 PM, Simon Riggs wrote: > Storage Efficiency > * Compression > * Column Orientation You might look at turning this: http://citusdata.github.io/cstore_fdw/ ... into a more integrated part of Postgres. -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via

[HACKERS] AXLE Plans for 9.5 and 9.6

2014-04-21 Thread Simon Riggs
I've discussed 2ndQuadrant's involvement in the AXLE project a few times publicly, but never on this mailing list. The project relates to innovation and improvement in Business Intelligence for systems based upon PostgreSQL in the range of 10-100TB. Our work will span the 9.5 and 9.6 cycles. We're