Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-15 Thread Mischa Sandberg
Simon Riggs wrote: Jim C. Nasby On Mon, Sep 13, 2004 at 11:07:35PM +0100, Simon Riggs wrote: PostgreSQL's functionality is in many ways similar to Oracle Partitioning. Loading up your data in many similar tables, then creating a view like: CREATE VIEW BIGTABLE (idate, col1, col2, col3...) AS SELECT

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables?

2004-09-15 Thread Simon Riggs
Chris Browne <[EMAIL PROTECTED]> wrote on 15.09.2004, 04:34:53: > [EMAIL PROTECTED] ("Simon Riggs") writes: > > Well, its fairly straightforward to auto-generate the UNION ALL view, and > > important as well, since it needs to be re-specified each time a new > > partition is loaded or an old one i

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Steve Atkins
On Tue, Sep 14, 2004 at 05:33:33PM -0500, Jim C. Nasby wrote: > On Mon, Sep 13, 2004 at 11:07:35PM +0100, Simon Riggs wrote: > > PostgreSQL's functionality is in many ways similar to Oracle Partitioning. > > > > Loading up your data in many similar tables, then creating a view like: > > > > CREAT

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Chris Browne
[EMAIL PROTECTED] ("Simon Riggs") writes: > Well, its fairly straightforward to auto-generate the UNION ALL view, and > important as well, since it needs to be re-specified each time a new > partition is loaded or an old one is cleared down. The main point is that > the constant placed in front of

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Christopher Browne
[EMAIL PROTECTED] ("Simon Riggs") wrote: > The main point is that the constant placed in front of each table > must in some way relate to the data, to make it useful in > querying. If it is just a unique constant, chosen at random, it > won't do much for partition elimination. It just struck me -

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Michael Glaesemann
On Sep 15, 2004, at 8:32 AM, Simon Riggs wrote: The "partitions" are just tables, so no need for other management tools. Oracle treats the partitions as sub-tables, so you need a range of commands to add, swap etc the partitions of the main table. I guess a set of tools that emulates that functi

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Simon Riggs
> Jim C. Nasby > On Mon, Sep 13, 2004 at 11:07:35PM +0100, Simon Riggs wrote: > > PostgreSQL's functionality is in many ways similar to Oracle > Partitioning. > > > > Loading up your data in many similar tables, then creating a view like: > > > > CREATE VIEW BIGTABLE (idate, col1, col2, col3...) AS

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Jim C. Nasby
On Mon, Sep 13, 2004 at 11:07:35PM +0100, Simon Riggs wrote: > PostgreSQL's functionality is in many ways similar to Oracle Partitioning. > > Loading up your data in many similar tables, then creating a view like: > > CREATE VIEW BIGTABLE (idate, col1, col2, col3...) AS > SELECT 200409130800, col

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread aaron werman
From: "Harald Lau (Sector-X)" <[EMAIL PROTECTED]> ... > From: "Mischa Sandberg" <[EMAIL PROTECTED]> > > > If your company is currently happy with MySQL, there probably are > > other (nontechnical) reasons to stick with it. I'm impressed that > > you'd consider reconsidering PG. > > I'd like to seco

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Vivek Khera
> "MC" == Mark Cotner <[EMAIL PROTECTED]> writes: MC> I've finished porting the schema and am importing the MC> data now. My estimates for just two-thirds(60 of the MC> 90 days) of one of our 30 cable systems(MySQL dbs) is MC> estimated to take about 16 hours. This may seem like MC> a lot, b

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Harald Lau (Sector-X)
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > From: "Mischa Sandberg" <[EMAIL PROTECTED]> > > > If your company is currently happy with MySQL, there probably are > > other (nontechnical) reasons to stick with it. I'm impressed that > > you'd consider reconsidering PG. > > I'd like to second Mi

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Aaron Werman
> Mark Cotner wrote: > > The time has come to reevaluate/rearchitect an > > application which I built about 3 years ago. There > > are no performance concerns with MySQL, but it would > > benefit greatly from stored procedures, views, etc. > From: "Mischa Sandberg" <[EMAIL PROTECTED]> > If your

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Pierre-Frédéric Caillaud
Performance hint : For static data, do not normalize too much. For instance if you have a row which can be linked to several other rows, you can do this : create table parents ( id serial primary key, values... ) create table children ( id serial primary k

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-14 Thread Mark Cotner
You all have been so very helpful so far and I really appreciate it. The data in these tables is thankfully static since they are logging tables and an analyze only takes about 4 minutes for the largest of them. I've finished porting the schema and am importing the data now. My estimates for jus

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-13 Thread Mischa Sandberg
Mark Cotner wrote: Hi all, I had a difficult time deciding which list to post this to, so please forgive me if this list doesn't perfectly match my questions. My decision will not solely be based on performance, but it is the primary concern. I would be very appreciative if you all could comment

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-13 Thread Simon Riggs
Mark, I thought some additional comments on top of Christopher's excellent notes might help you. > Christopher Browne > The world rejoiced as Mischa Sandberg > <[EMAIL PROTECTED]> wrote: > > Mark Cotner wrote: > >> Requirements: > >> Merge table definition equivalent. We use these > >> extensiv

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-13 Thread Christopher Browne
A long time ago, in a galaxy far, far away, [EMAIL PROTECTED] (Mark Cotner) wrote: > Agreed, I did some preliminary testing today and am very impressed. > I wasn't used to running analyze after a data load, but once I did > that everything was snappy. Something worth observing is that this is true

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-13 Thread Mark Cotner
See comments . . . thanks for the feedback. 'njoy, Mark --- Christopher Browne <[EMAIL PROTECTED]> wrote: > The world rejoiced as Mischa Sandberg > <[EMAIL PROTECTED]> wrote: > > Mark Cotner wrote: > >> Requirements: > >> Merge table definition equivalent. We use these > >> extensively. > > >

Re: [PERFORM] Data Warehouse Reevaluation - MySQL vs Postgres -- merge tables

2004-09-12 Thread Christopher Browne
The world rejoiced as Mischa Sandberg <[EMAIL PROTECTED]> wrote: > Mark Cotner wrote: >> Requirements: >> Merge table definition equivalent. We use these >> extensively. > Looked all over mysql.com etc, and afaics merge table is indeed > exactly a view of a union-all. Is that right? > PG support