Re: [HACKERS] performance-test farm

2012-04-04 Thread Tomas Vondra
On 4.4.2012 05:35, Greg Smith wrote: On 03/05/2012 05:20 PM, Tomas Vondra wrote: What is the current state of this effort? Is there someone else working on that? If not, I propose this (for starters): * add a new page Performance results to the menu, with a list of members that

Re: [HACKERS] performance-test farm

2012-04-03 Thread Greg Smith
On 03/05/2012 05:20 PM, Tomas Vondra wrote: What is the current state of this effort? Is there someone else working on that? If not, I propose this (for starters): * add a new page Performance results to the menu, with a list of members that uploaded the perfomance-results * for

Re: [HACKERS] performance-test farm

2012-03-06 Thread Robert Haas
On Mon, Mar 5, 2012 at 5:20 PM, Tomas Vondra t...@fuzzy.cz wrote: The idea is that buildfarm systems that are known to have a) reasonable hardware and b) no other concurrent work going on could also do performance tests.  The main benefit of this approach is it avoids duplicating all of the

Re: [HACKERS] performance-test farm

2012-03-05 Thread Tomas Vondra
On 12.5.2011 08:54, Greg Smith wrote: Tomas Vondra wrote: The idea is that buildfarm systems that are known to have a) reasonable hardware and b) no other concurrent work going on could also do performance tests. The main benefit of this approach is it avoids duplicating all of the system

Re: [HACKERS] performance-test farm

2011-09-13 Thread Tomas Vondra
Dne 12.5.2011 08:54, Greg Smith napsal(a): Tomas Vondra wrote: Actually I was not aware of how the buildfarm works, all I knew was there's something like that because some of the hackers mention a failed build on the mailing list occasionally. So I guess this is a good opportunity to

Re: [HACKERS] performance-test farm

2011-05-15 Thread Josh Berkus
On 5/12/11 7:19 PM, Lou Picciano wrote: Josh My Man! How are you?!! Is this the one?: http://planetdrizzle.org/ Since that's their blog feed, here's some durable links: Testing tool: http://docs.drizzle.org/testing/dbqp.html Random query generator: https://launchpad.net/randgen

Re: [HACKERS] performance-test farm

2011-05-12 Thread Greg Smith
Tomas Vondra wrote: Actually I was not aware of how the buildfarm works, all I knew was there's something like that because some of the hackers mention a failed build on the mailing list occasionally. So I guess this is a good opportunity to investigate it a bit ;-) Anyway I'm not sure this

Re: [HACKERS] performance-test farm

2011-05-12 Thread Tom Lane
* Josh Berkus (j...@agliodbs.com) wrote: The first problem is plaform performance, which would be a matter of expanding the buildfarm to include a small set of performance tests ... probably ones based on previously known problems, plus some other simple common operations. The goal here

Re: [HACKERS] performance-test farm

2011-05-12 Thread Tomas Vondra
Dne 12.5.2011 16:36, Tom Lane napsal(a): * Josh Berkus (j...@agliodbs.com) wrote: The first problem is plaform performance, which would be a matter of expanding the buildfarm to include a small set of performance tests ... probably ones based on previously known problems, plus some other

Re: [HACKERS] performance-test farm

2011-05-12 Thread Tomas Vondra
Dne 12.5.2011 08:54, Greg Smith napsal(a): Tomas Vondra wrote: Actually I was not aware of how the buildfarm works, all I knew was there's something like that because some of the hackers mention a failed build on the mailing list occasionally. So I guess this is a good opportunity to

Re: [HACKERS] performance-test farm

2011-05-12 Thread Greg Smith
Tom Lane wrote: There's no such thing as a useful performance test that runs quickly enough to be sane to incorporate in our standard regression tests. To throw a hard number out: I can get a moderately useful performance test on a SELECT-only workload from pgbench in about one minute.

Re: [HACKERS] performance-test farm

2011-05-12 Thread Josh Berkus
All, BTW, if we want a kind of performance unit test, Drizzle has a very nice framework for this. And it's even already PostgreSQL-compatible. I'm hunting for the link for it now ... -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via pgsql-hackers mailing list

Re: [HACKERS] performance-test farm

2011-05-12 Thread Lou Picciano
Josh My Man! How are you?!! Is this the one?: http://planetdrizzle.org/ Lou Picciano - Original Message - From: Josh Berkus j...@agliodbs.com To: pgsql-hackers@postgresql.org Sent: Thursday, May 12, 2011 8:11:57 PM Subject: Re: [HACKERS] performance-test farm All, BTW

[HACKERS] performance-test farm

2011-05-11 Thread Tomas Vondra
Hi everyone, several members of this mailing list mentioned recently it'd be really useful to have a performance-test farm, that it might improve the development process and make some changes easier. I've briefly discussed this with another CSPUG member, who represents a local company using

Re: [HACKERS] performance-test farm

2011-05-11 Thread Kevin Grittner
Tomas Vondra t...@fuzzy.cz wrote: 1) Is there something that might serve as a model? I've been assuming that we would use the PostgreSQL Buildfarm as a model. http://buildfarm.postgresql.org/ 2) How would you use it? What procedure would you expect? People who had suitable test

Re: [HACKERS] performance-test farm

2011-05-11 Thread Tomas Vondra
Dne 11.5.2011 23:41, Kevin Grittner napsal(a): Tomas Vondra t...@fuzzy.cz wrote: 1) Is there something that might serve as a model? I've been assuming that we would use the PostgreSQL Buildfarm as a model. http://buildfarm.postgresql.org/ Yes, I was thinking about that too, but 1)

Re: [HACKERS] performance-test farm

2011-05-11 Thread Kevin Grittner
Tomas Vondra t...@fuzzy.cz wrote: Dne 11.5.2011 23:41, Kevin Grittner napsal(a): Tomas Vondra t...@fuzzy.cz wrote: 1) Is there something that might serve as a model? I've been assuming that we would use the PostgreSQL Buildfarm as a model. http://buildfarm.postgresql.org/ Yes, I

Re: [HACKERS] performance-test farm

2011-05-11 Thread Tomas Vondra
Dne 12.5.2011 00:21, Kevin Grittner napsal(a): Tomas Vondra t...@fuzzy.cz wrote: Dne 11.5.2011 23:41, Kevin Grittner napsal(a): Tomas Vondra t...@fuzzy.cz wrote: 1) Is there something that might serve as a model? I've been assuming that we would use the PostgreSQL Buildfarm as a model.

Re: [HACKERS] performance-test farm

2011-05-11 Thread Andrew Dunstan
On 05/11/2011 06:21 PM, Kevin Grittner wrote: Tomas Vondrat...@fuzzy.cz wrote: Dne 11.5.2011 23:41, Kevin Grittner napsal(a): Tomas Vondrat...@fuzzy.cz wrote: First up, you guys should be aware that Greg Smith at least is working on this. Let's not duplicate effort. 1) Is there

Re: [HACKERS] performance-test farm

2011-05-11 Thread Stephen Frost
* Andrew Dunstan (and...@dunslane.net) wrote: First up, you guys should be aware that Greg Smith at least is working on this. Let's not duplicate effort. Indeed. I'm also interested in making this happen and have worked with Greg in the past on it. There's even some code out there that we

Re: [HACKERS] performance-test farm

2011-05-11 Thread Josh Berkus
Guys, There are two mutually exclusive problems to solve with a performance-test farm. The first problem is plaform performance, which would be a matter of expanding the buildfarm to include a small set of performance tests ... probably ones based on previously known problems, plus some other

Re: [HACKERS] performance-test farm

2011-05-11 Thread Stephen Frost
* Josh Berkus (j...@agliodbs.com) wrote: The first problem is plaform performance, which would be a matter of expanding the buildfarm to include a small set of performance tests ... probably ones based on previously known problems, plus some other simple common operations. The goal here would