Re: [GENERAL] Is there a meaningful benchmark?

2009-03-27 Thread Scott Marlowe
On Thu, Mar 26, 2009 at 5:10 PM, Scott Marlowe scott.marl...@gmail.com wrote: It's also important to point out that writers don't necessarily block other writers.  As long as they're operating on different ranges of the data set.  You can have dozens of writers streaming data in with

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-27 Thread Will Rutherdale (rutherw)
[mailto:scott.marl...@gmail.com] Sent: 27 March 2009 02:25 To: Scott Ribe Cc: Will Rutherdale (rutherw); pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? To be fare, some database apps have a few rows they update in a near continuous stream, and they row lock

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-27 Thread Scott Marlowe
On Fri, Mar 27, 2009 at 10:32 AM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: Incidentally, in case people are interested in hearing the follow-up to my original message, my home-cooked benchmark with lots of processes doing tons of updates seemed to initially show MyISAM winning over

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-27 Thread Will Rutherdale (rutherw)
(rutherw) Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? This is one of those areas where postgresql acts very differently from other dbs. In lots of other dbs big transactions are the performance killer. In PostgreSQL big transactions are the way to get

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-27 Thread Scott Marlowe
On Fri, Mar 27, 2009 at 2:27 PM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: I see.  Perhaps earlier I alienated some people by talking about transactions per second, which is not necessarily an appropriate unit. Hard to say, tps is still important. A lot of loads need to change one

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-26 Thread Scott Marlowe
On Fri, Mar 20, 2009 at 9:27 AM, Scott Ribe scott_r...@killerbytes.com wrote: That's why I was looking for a more balanced benchmark that exercises said capabilities. OK, here's the thing, I will give you *one* sample issue to think about, as an illustration of the kinds of differences there

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-26 Thread Raymond O'Donnell
On 26/03/2009 23:10, Scott Marlowe wrote: It's also important to point out that writers don't necessarily block other writers. As long as they're operating on different ranges of the data set. You can have dozens of writers streaming data in with differening primary keys all running

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-26 Thread Scott Marlowe
On Thu, Mar 26, 2009 at 5:23 PM, Raymond O'Donnell r...@iol.ie wrote: On 26/03/2009 23:10, Scott Marlowe wrote: It's also important to point out that writers don't necessarily block other writers.  As long as they're operating on different ranges of the data set.  You can have dozens of

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Scott Ribe
That's why I was looking for a more balanced benchmark that exercises said capabilities. OK, here's the thing, I will give you *one* sample issue to think about, as an illustration of the kinds of differences there are. - PostgresQL uses MVCC instead of row or page locking, which means only

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Will Rutherdale (rutherw)
Subject: Re: [GENERAL] Is there a meaningful benchmark? That's why I was looking for a more balanced benchmark that exercises said capabilities. OK, here's the thing, I will give you *one* sample issue to think about, as an illustration of the kinds of differences there are. - PostgresQL uses

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Scott Marlowe
On Fri, Mar 20, 2009 at 9:55 AM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: You have a point, as do a lot of the other folks. However, keeping the KISS principle in mind, you can create a benchmark that simply sets up a sample database and forks off a bunch of processes to do random

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Tom Lane
Will Rutherdale (rutherw) ruth...@cisco.com writes: However, keeping the KISS principle in mind, you can create a benchmark that simply sets up a sample database and forks off a bunch of processes to do random updates for an hour, say. Dead simple. Indeed, and more than likely dead useless.

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Greg Smith
On Thu, 19 Mar 2009, Dann Corbit wrote: Oracle won't let you publish any benchmark numbers. So if you find an Oracle comparison, it's unauthorized You can find some useful comparisons that include Oracle if you look at the audited benchmarks from the TPC. I've collected links to a bunch at

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Greg Smith
On Fri, 20 Mar 2009, Will Rutherdale (rutherw) wrote: However, keeping the KISS principle in mind, you can create a benchmark that simply sets up a sample database and forks off a bunch of processes to do random updates for an hour, say. Dead simple. There's a benchmark tool that does

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Paul Ramsey
http://blog.redfin.com/devblog/2007/11/elephant_versus_dolphin_which_is_faster_which_is_smarter.html Here's another PgSQL/MySQL testimonial, with a spatial twist :) P On Fri, Mar 20, 2009 at 10:15 AM, Greg Smith gsm...@gregsmith.com wrote: On Fri, 20 Mar 2009, Will Rutherdale (rutherw) wrote:

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Will Rutherdale (rutherw)
Point taken. Thank you for the help. -Will -Original Message- From: Tom Lane [mailto:t...@sss.pgh.pa.us] Sent: 20 March 2009 12:06 To: Will Rutherdale (rutherw) Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? Will Rutherdale (rutherw) ruth

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-20 Thread Will Rutherdale (rutherw)
Thanks for the references. -Will -Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Paul Ramsey Sent: 20 March 2009 13:29 To: pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? http

[GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Will Rutherdale (rutherw)
Hi. I'm writing up a database comparison paper in my department at work, with Postgres being a major candidate. I have been attempting to research various issues and provide a meaningful comparison. One issue I would like to give some kind of information on is comparative performance. When I

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Dann Corbit
-Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general- ow...@postgresql.org] On Behalf Of Will Rutherdale (rutherw) Sent: Thursday, March 19, 2009 1:32 PM To: pgsql-general@postgresql.org Subject: [GENERAL] Is there a meaningful benchmark? Hi. I'm

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread John Cheng
Comparison between MySQL using the MyISAM engine with PostgreSQL is really not sensible. For one, the MyISAM engine does not have transaction and foreign key support, while PostgreSQL supports transaction and foreign key. Would anyone really give up transaction and integrity for slightly more

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Scott Marlowe
On Thu, Mar 19, 2009 at 3:16 PM, Dann Corbit dcor...@connx.com wrote: Here are some benchmark figures: http://tweakers.net/reviews/657/6 SNIP My opinion: Most benchmarks are run by someone with an axe to grind.  I never believe them. Generally I agree with that sentiment. However, it's

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Will Rutherdale (rutherw)
] Sent: 19 March 2009 17:16 To: Will Rutherdale (rutherw); pgsql-general@postgresql.org Subject: RE: [GENERAL] Is there a meaningful benchmark? The only way to get an answer to a question like this is to actually benchmark the application you have in mind. And the answer won't be very good unless

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Scott Marlowe
On Thu, Mar 19, 2009 at 3:50 PM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: Even if such a question is answered, it isn't going to be the only factor.  For example I have collected reasonable numbers already on footprints of different RDBMSs, because embedded guys might find that

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Will Rutherdale (rutherw)
second against another RDBMS or two. -Will -Original Message- From: Scott Marlowe [mailto:scott.marl...@gmail.com] Sent: 19 March 2009 17:57 To: Will Rutherdale (rutherw) Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? On Thu, Mar 19, 2009

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Dann Corbit
-Original Message- From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general- ow...@postgresql.org] On Behalf Of Scott Marlowe Sent: Thursday, March 19, 2009 2:57 PM To: Will Rutherdale (rutherw) Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Will Rutherdale (rutherw)
[mailto:scott.marl...@gmail.com] Sent: 19 March 2009 17:36 To: Dann Corbit Cc: Will Rutherdale (rutherw); pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? On Thu, Mar 19, 2009 at 3:16 PM, Dann Corbit dcor...@connx.com wrote: Here are some benchmark figures: http

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Scott Marlowe
On Thu, Mar 19, 2009 at 4:02 PM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: I am *not* primarily interested in embedded, but I know people who are, and I have already compared with SQLite. My main point of concern right now is for more middle sized platforms (such as an average

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Will Rutherdale (rutherw)
. -Will From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of John Cheng Sent: 19 March 2009 17:27 Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? Comparison between MySQL using

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Scott Marlowe
On Thu, Mar 19, 2009 at 3:56 PM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: I'm having trouble with the tweakers reference below. I was hoping to see something where hardware platform is held constant while RDBMS is varied, but it seems to be just the opposite.  Or maybe I didn't

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Scott Marlowe
On Thu, Mar 19, 2009 at 4:11 PM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: I am already aware of this issue, and am preparing to explain it to people. Well, keep in mind that MOST people are gonna wave you off, and figure it doesn't matter that much. Lots of developers are pretty

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Scott Marlowe
On Thu, Mar 19, 2009 at 3:26 PM, John Cheng chonger.ch...@gmail.com wrote: Comparison between MySQL using the MyISAM engine with PostgreSQL is really not sensible. For one, the MyISAM engine does not have transaction and foreign key support, while PostgreSQL supports transaction and foreign

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Will Rutherdale (rutherw)
simple measured indicators aren't easy to come by. -Will -Original Message- From: Scott Marlowe [mailto:scott.marl...@gmail.com] Sent: 19 March 2009 18:14 To: Will Rutherdale (rutherw) Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Is there a meaningful benchmark? On Thu, Mar

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Dann Corbit
Here is another interesting benchmark with a particular user's application: http://blog.page2rss.com/2007/01/postgresql-vs-mysql-performance.html P.S. Oracle won't let you publish any benchmark numbers. So if you find an Oracle comparison, it's unauthorized -- Sent via pgsql-general mailing

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Scott Marlowe
On Thu, Mar 19, 2009 at 4:24 PM, Will Rutherdale (rutherw) ruth...@cisco.com wrote: Okay, you've given me some useful information. As the original subject line indicates, I'm open to the idea that no such benchmark exists. If anyone asks about this stuff, I can just say that performance

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Will Rutherdale (rutherw)
. -Will -Original Message- From: Dann Corbit [mailto:dcor...@connx.com] Sent: 19 March 2009 18:26 To: Scott Marlowe; Will Rutherdale (rutherw) Cc: pgsql-general@postgresql.org Subject: RE: [GENERAL] Is there a meaningful benchmark? Here is another interesting benchmark with a particular

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread ries van Twisk
Subject: RE: [GENERAL] Is there a meaningful benchmark? The only way to get an answer to a question like this is to actually benchmark the application you have in mind. And the answer won't be very good unless you have an expert on each given system install and tune the application. There is a regular

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread John Cheng
On Thu, Mar 19, 2009 at 3:23 PM, Scott Marlowe scott.marl...@gmail.comwrote: On Thu, Mar 19, 2009 at 3:26 PM, John Cheng chonger.ch...@gmail.com wrote: Comparison between MySQL using the MyISAM engine with PostgreSQL is really not sensible. For one, the MyISAM engine does not have

Re: [GENERAL] Is there a meaningful benchmark?

2009-03-19 Thread Greg Williamson
Dann Corbit wrote: Here is another interesting benchmark with a particular user's application: http://blog.page2rss.com/2007/01/postgresql-vs-mysql-performance.html P.S. Oracle won't let you publish any benchmark numbers. So if you find an Oracle comparison, it's unauthorized True