Hi Joe! Sorry for the delay in getting back to you! I've now updated
and expanded the wiki page explaining the benchmarking and automation
system:
http://drizzle.org/wiki/Automation_Documentation
Please have a gander at the wiki and walk through the steps on there,
and don't hesitate to ping me on IRC or email if you find errors or run
into issues. I'm here to help!
Cheers,
Jay
Joe Daly wrote:
Hi Jay,
Is there a wiki somewhere describing the setup for these tests? I ran into
some problems with the options specified in this message for starting the
server:
https://lists.launchpad.net/drizzle-discuss/msg03687.html
I can post the problems, but I figured it would be easier for me to follow
instructions then trying to guess at what was run.
thanks
--Joe
On Fri, May 15, 2009 at 8:47 PM, Jay Pipes <[email protected]> wrote:
Joe Daly wrote:
Hi Jay,
Im trying to get up to speed, on the development here so excuse my silly
question.
Hi! Sorry for th delayed reply...
What were these benchmarks against?
These benchmarks are against each BZR revision of Drizzle on one of our
benchmarking machines (16-core x86 box).
You can read more about our benchmarks on this thread:
https://lists.launchpad.net/drizzle-discuss/msg03687.html
Cheers!
Jay
thanks
--Joe Daly
On Wed, May 13, 2009 at 9:21 AM, Jay Pipes <[email protected]> wrote:
Hi all!
Sorry for the delay in getting the data for analysis of our benchmark
revision history! Attached is a tarball containing a single SQL script
to
populate a database with our data for revisions 980 through 1008.
To setup, do:
$> tar -xzf drizzle_stats.tar.gz
$> mysqladmin --user=root --password=$yourpass create drizzle_stats
$> mysql --user=root --password drizzle_stats < drizzle_stats.sql
<enter your password>
Here are the sysbench tables:
mysql> desc sysbench_runs;
+-----------+-------------+------+-----+---------+----------------+
| Field | Type | Null | Key | Default | Extra |
+-----------+-------------+------+-----+---------+----------------+
| run_id | int(11) | NO | PRI | NULL | auto_increment |
| config_id | int(11) | NO | | NULL | |
| server | varchar(20) | NO | | NULL | |
| version | varchar(50) | YES | | NULL | |
| run_date | datetime | NO | | NULL | |
+-----------+-------------+------+-----+---------+----------------+
5 rows in set (0.00 sec)
mysql> desc sysbench_config;
+-----------+--------------+------+-----+---------+----------------+
| Field | Type | Null | Key | Default | Extra |
+-----------+--------------+------+-----+---------+----------------+
| config_id | int(11) | NO | PRI | NULL | auto_increment |
| name | varchar(255) | NO | | NULL | |
+-----------+--------------+------+-----+---------+----------------+
2 rows in set (0.01 sec)
mysql> desc sysbench_run_iterations;
+---------------------------+---------------+------+-----+---------+
| Field | Type | Null | Key | Default |
+---------------------------+---------------+------+-----+---------+
| run_id | int(11) | NO | PRI | NULL |
| concurrency | int(11) | NO | PRI | NULL |
| iteration | int(11) | NO | PRI | NULL |
| tps | decimal(13,2) | NO | | NULL |
| read_write_req_per_second | decimal(13,2) | NO | | NULL |
| deadlocks_per_second | decimal(5,2) | NO | | NULL |
| min_req_latency_ms | decimal(10,2) | NO | | NULL |
| avg_req_latency_ms | decimal(10,2) | NO | | NULL |
| max_req_latency_ms | decimal(10,2) | NO | | NULL |
| 95p_req_latency_ms | decimal(10,2) | NO | | NULL |
+---------------------------+---------------+------+-----+---------+
10 rows in set (0.00 sec)
To see a view of the data which I've been showing on this list, I use
this:
mysql> SELECT r.version, c.name, i.concurrency, AVG(i.tps) as TPS
-> FROM sysbench_config c
-> NATURAL JOIN sysbench_runs r
-> NATURAL JOIN sysbench_run_iterations i
-> WHERE r.server = 'drizzled'
-> GROUP BY r.version, c.name, i.concurrency;
which shows you data in this format:
*************************** 1. row ***************************
version: fix-bitset-regression-1009
name: innodb_1000K_readonly
concurrency: 2
TPS: 1080.706667
Have fun. :)
Cheers,
Jay
_______________________________________________
Mailing list:
https://launchpad.net/~drizzle-discuss<https://launchpad.net/%7Edrizzle-discuss>
<https://launchpad.net/%7Edrizzle-discuss>
Post to : [email protected]
Unsubscribe :
https://launchpad.net/~drizzle-discuss<https://launchpad.net/%7Edrizzle-discuss>
<https://launchpad.net/%7Edrizzle-discuss>
More help : https://help.launchpad.net/ListHelp
_______________________________________________
Mailing list:
https://launchpad.net/~drizzle-discuss<https://launchpad.net/%7Edrizzle-discuss>
Post to : [email protected]
Unsubscribe :
https://launchpad.net/~drizzle-discuss<https://launchpad.net/%7Edrizzle-discuss>
More help : https://help.launchpad.net/ListHelp
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help : https://help.launchpad.net/ListHelp
