Hi! Clearly, something is up...the run on MySQL 5.1.31 shows the
transactions test comes up disabled:
transactions: Test skipped because the database doesn't support transactions
Are you running Drizzle with InnoDB and MySQL 5.1 with MyISAM?
Also, I think something is amiss with some wait I/O... Did you notice
that the *actual* seconds executing, say, the Wisconsin test is almost
identical:
Drizzle:
wisconsin: Total time: 175 wallclock secs ( 1.92 usr 0.77 sys + 0.00
cusr 0.00 csys = 2.69 CPU)
MySQL 5.1:
wisconsin: Total time: 6 wallclock secs ( 1.69 usr 0.72 sys + 0.00
cusr 0.00 csys = 2.41 CPU)
This shows me that the computer was essentially idle for 99% of the 175
wallclock seconds it was executing the Wisconsin test for Drizzle...
So, bottom line, I would be hesitant to publish the above numbers before
looking into the sql-bench Perl scripts and seeing if there's something
simple that you may have made a mistake in. :)
-jay
Patrick Galbraith wrote:
Hi all,
I'll be blogging about this in the AM. Any thoughts, contributions?
-------- Original Message --------
Subject: a tale of two tests
Date: Tue, 28 Jul 2009 21:54:09 -0400
From: <[email protected]>
To: Brian 'Krow' Aker <[email protected]>
r...@domu-12-31-36-00-49-d2:~/sql-bench# ./run-all-tests --server=drizzle
Benchmark DBD suite: 2.15
Date of test: 2009-07-28 17:26:08
Running tests on: Linux 2.6.21.7-2.fc8xen x86_64
Arguments: Comments: Limits from: Server
version: Drizzle 2009.07.1089
Optimization: None
Hardware:
alter-table: Total time: 30 wallclock secs ( 0.02 usr 0.04 sys + 0.00
cusr 0.00 csys = 0.06 CPU)
ATIS: Estimated total time: 4308.36 wallclock secs ( 4.59 usr 0.51 sys
+ 0.00 cusr 0.00 csys = 5.10 CPU)
big-tables: Total time: 22 wallclock secs ( 9.61 usr 0.49 sys + 0.00
cusr 0.00 csys = 10.10 CPU)
connect: Total time: 20 wallclock secs ( 5.59 usr 3.89 sys + 0.00
cusr 0.00 csys = 9.48 CPU)
create: Total time: 87 wallclock secs ( 0.33 usr 0.38 sys + 0.00 cusr
0.00 csys = 0.71 CPU)
insert: Warning: Can't execute insert. Check the file
'output/insert-drizzle-Linux_2.6.21.7_2.fc8xen_x86_64'
Failed (output/insert-drizzle-Linux_2.6.21.7_2.fc8xen_x86_64)
select: Total time: 1230 wallclock secs (16.74 usr 2.91 sys + 0.00
cusr 0.00 csys = 19.65 CPU)
transactions: Total time: 553 wallclock secs ( 2.84 usr 1.88 sys +
0.00 cusr 0.00 csys = 4.72 CPU)
wisconsin: Total time: 175 wallclock secs ( 1.92 usr 0.77 sys + 0.00
cusr 0.00 csys = 2.69 CPU)
Of 9 tests, 1 tests didn't work
Tests with estimated time have a + at end of line
Totals per operation:
Operation seconds usr sys cpu tests
alter_table_add 13.00 0.01 0.00 0.01 100
alter_table_drop 13.00 0.01 0.01 0.02 91
connect 2.00 0.75 0.52 1.27 2000
connect+select_1_row 3.00 0.90 0.65 1.55 2000
connect+select_simple 2.00 0.77 0.62 1.39 2000
count_distinct 8.00 0.00 0.00 0.00 1000
count_distinct_2 13.00 0.00 0.00 0.00 1000
count_distinct_big 6.00 3.37 0.02 3.39 100
count_distinct_group 12.00 0.02 0.00 0.02 1000
count_distinct_group_on_key 13.00 0.02 0.00 0.02 1000
count_distinct_group_on_key_parts 11.00 0.01 0.00 0.01 1000
count_distinct_key_prefix 9.00 0.00 0.01 0.01 1000
count_group_on_key_parts 13.00 0.02 0.00 0.02 1000
count_on_key 367.00 0.07 0.05 0.12 50000
create+drop 21.00 0.07 0.11 0.18 10000
create_MANY_tables 16.00 0.09 0.09 0.18 10000
create_index 2.00 0.00 0.00 0.00 8
create_key+drop 28.00 0.12 0.10 0.22 10000
create_table 0.00 0.00 0.00 0.00 31
delete_autocommit 57.00 0.30 0.20 0.50 10000
delete_big 0.00 0.00 0.00 0.00 1
delete_commit 67.00 0.28 0.20 0.48 10000
delete_rollback 107.00 0.32 0.25 0.57 100
drop_index 2.00 0.00 0.00 0.00 8
drop_table 0.00 0.00 0.00 0.00 28
drop_table_when_MANY_tables 16.00 0.00 0.02 0.02 10000
insert 10.00 0.84 1.08 1.92 50768
insert_autocommit 2.00 0.17 0.30 0.47 10000
insert_commit 1.00 0.26 0.19 0.45 10000
insert_many_fields 5.00 0.15 0.09 0.24 2000
insert_rollback 1.00 0.33 0.13 0.46 100
min_max_on_key 523.00 5.27 1.55 6.82 70000
select_1_row 2.00 0.52 0.31 0.83 20000
select_1_row_cache 2.00 0.48 0.31 0.79 20000
select_2_rows 3.00 0.49 0.39 0.88 20000
select_big 1.00 0.10 0.00 0.10 70
select_big_str 1.00 0.51 0.20 0.71 2000
select_cache 96.00 1.24 0.28 1.52 10000
select_cache2 98.00 1.56 0.23 1.79 10000
select_column+column 2.00 0.45 0.30 0.75 20000
select_distinct 1510.00 0.95 0.05 1.00
800 +
select_group 8.00 0.87 0.10 0.97 2800
select_group_when_MANY_tables 6.00 0.05 0.06 0.11 10000
select_join 812.16 0.39 0.00 0.39
100 +
select_key_prefix_join 1974.19 1.97 0.06 2.03
100 +
select_many_fields 17.00 9.46 0.40 9.86 2000
select_range 58.00 4.83 0.49 5.32 410
select_simple 2.00 0.40 0.28 0.68 20000
select_simple_cache 1.00 0.32 0.31 0.63 20000
select_simple_join 2.00 0.25 0.04 0.29 500
update_autocommit 108.00 0.41 0.17 0.58 10000
update_commit 100.00 0.43 0.21 0.64 10000
update_rollback 110.00 0.34 0.23 0.57 100
wisc_benchmark 169.00 1.46 0.23 1.69 114
TOTALS 6425.35 41.63 10.84 52.47
445329 +++
Benchmark DBD suite: 2.15
Date of test: 2009-07-29 1:24:55
Running tests on: Linux 2.6.21.7-2.fc8xen x86_64
Arguments:
Comments:
Limits from:
Server version: MySQL 5.1.38
Optimization: None
Hardware:
alter-table: Total time: 12 wallclock secs ( 0.06 usr 0.03 sys + 0.00
cusr 0.00 csys = 0.09 CPU)
ATIS: Total time: 13 wallclock secs ( 2.50 usr 0.11 sys + 0.00 cusr
0.00 csys = 2.61 CPU)
big-tables: Total time: 11 wallclock secs ( 2.42 usr 0.71 sys + 0.00
cusr 0.00 csys = 3.13 CPU)
connect: Total time: 17 wallclock secs ( 4.58 usr 2.70 sys + 0.00
cusr 0.00 csys = 7.28 CPU)
create: Total time: 106 wallclock secs ( 2.52 usr 1.34 sys + 0.00
cusr 0.00 csys = 3.86 CPU)
insert: Total time: 695 wallclock secs (209.95 usr 41.60 sys + 0.00
cusr 0.00 csys = 251.55 CPU)
select: Total time: 241 wallclock secs (21.35 usr 3.01 sys + 0.00
cusr 0.00 csys = 24.36 CPU)
transactions: Test skipped because the database doesn't support transactions
wisconsin: Total time: 6 wallclock secs ( 1.69 usr 0.72 sys + 0.00
cusr 0.00 csys = 2.41 CPU)
All 9 test executed successfully
Totals per operation:
Operation seconds usr sys cpu tests
alter_table_add 5.00 0.02 0.02 0.04 100
alter_table_drop 5.00 0.01 0.01 0.02 91
connect 1.00 0.62 0.09 0.71 2000
connect+select_1_row 2.00 0.60 0.19 0.79 2000
connect+select_simple 1.00 0.55 0.21 0.76 2000
count 5.00 0.01 0.00 0.01 100
count_distinct 5.00 0.11 0.02 0.13 1000
count_distinct_2 8.00 0.19 0.04 0.23 1000
count_distinct_big 13.00 3.61 0.10 3.71 120
count_distinct_group 5.00 0.53 0.03 0.56 1000
count_distinct_group_on_key 6.00 0.16 0.02 0.18 1000
count_distinct_group_on_key_parts 6.00 0.53 0.02 0.55 1000
count_distinct_key_prefix 4.00 0.11 0.02 0.13 1000
count_group_on_key_parts 7.00 0.54 0.03 0.57 1000
count_on_key 68.00 5.06 1.01 6.07 50100
create+drop 31.00 0.75 0.39 1.14 10000
create_MANY_tables 52.00 0.56 0.25 0.81 10000
create_index 1.00 0.01 0.00 0.01 8
create_key+drop 19.00 0.76 0.37 1.13 10000
create_table 0.00 0.00 0.00 0.00 31
delete_all_many_keys 19.00 0.02 0.01 0.03 1
delete_big 0.00 0.00 0.00 0.00 1
delete_big_many_keys 19.00 0.02 0.00 0.02 128
delete_key 1.00 0.14 0.25 0.39 10000
delete_range 4.00 0.00 0.00 0.00 12
drop_index 1.00 0.00 0.00 0.00 8
drop_table 0.00 0.00 0.00 0.00 28
drop_table_when_MANY_tables 1.00 0.21 0.16 0.37 10000
insert 39.00 3.13 3.14 6.27 350768
insert_duplicates 12.00 2.08 1.83 3.91 100000
insert_key 43.00 3.38 1.75 5.13 100000
insert_many_fields 3.00 0.19 0.00 0.19 2000
insert_select_1_key 2.00 0.00 0.00 0.00 1
insert_select_2_keys 2.00 0.00 0.00 0.00 1
min_max 4.00 0.01 0.00 0.01 60
min_max_on_key 15.00 7.17 1.65 8.82 85000
multiple_value_insert 2.00 0.19 0.00 0.19 100000
once_prepared_select 15.00 3.42 1.83 5.25 100000
order_by_big 14.00 10.43 0.19 10.62 10
order_by_big_key 13.00 10.74 0.38 11.12 10
order_by_big_key2 12.00 10.38 0.22 10.60 10
order_by_big_key_desc 13.00 10.69 0.30 10.99 10
order_by_big_key_diff 13.00 10.54 0.24 10.78 10
order_by_big_key_prefix 13.00 10.44 0.27 10.71 10
order_by_key2_diff 2.00 1.14 0.02 1.16 500
order_by_key_prefix 1.00 0.48 0.02 0.50 500
order_by_range 1.00 0.60 0.01 0.61 500
outer_join 18.00 0.01 0.00 0.01 10
outer_join_found 18.00 0.00 0.00 0.00 10
outer_join_not_found 11.00 0.00 0.00 0.00 500
outer_join_on_key 11.00 0.01 0.00 0.01 10
prepared_select 20.00 8.27 1.97 10.24 100000
select_1_row 2.00 0.43 0.28 0.71 20000
select_1_row_cache 2.00 0.47 0.32 0.79 20000
select_2_rows 2.00 0.46 0.33 0.79 20000
select_big 12.00 10.35 0.13 10.48 80
select_big_str 1.00 0.31 0.14 0.45 2000
select_cache 34.00 0.17 0.04 0.21 10000
select_cache2 34.00 0.58 0.11 0.69 10000
select_column+column 3.00 0.41 0.34 0.75 20000
select_diff_key 0.00 0.07 0.01 0.08 500
select_distinct 4.00 0.26 0.00 0.26 800
select_group 11.00 0.10 0.02 0.12 2911
select_group_when_MANY_tables 3.00 0.24 0.17 0.41 10000
select_join 1.00 0.07 0.00 0.07 100
select_key 38.00 17.40 3.23 20.63 200000
select_key2 39.00 17.29 3.42 20.71 200000
select_key2_return_key 38.00 17.50 3.21 20.71 200000
select_key2_return_prim 40.00 16.74 4.38 21.12 200000
select_key_prefix 42.00 10.59 2.60 13.19 200000
select_key_prefix_join 3.00 1.86 0.01 1.87 100
select_key_return_key 36.00 15.61 3.32 18.93 200000
select_many_fields 8.00 2.23 0.71 2.94 2000
select_range 50.00 3.81 0.22 4.03 410
select_range_key2 6.00 2.04 0.27 2.31 25010
select_range_prefix 6.00 1.92 0.34 2.26 25010
select_simple 2.00 0.38 0.43 0.81 20000
select_simple_cache 1.00 0.35 0.37 0.72 20000
select_simple_join 1.00 0.12 0.00 0.12 500
update_big 19.00 0.00 0.00 0.00 10
update_of_key 9.00 0.87 0.91 1.78 50000
update_of_key_big 7.00 0.01 0.00 0.01 501
update_of_primary_key_many_keys 8.00 0.01 0.02 0.03 256
update_with_key 39.00 5.13 5.65 10.78 300000
update_with_key_prefix 13.00 3.32 1.89 5.21 100000
wisc_benchmark 1.00 1.18 0.16 1.34 114
TOTALS 1101.00 240.70 50.09 290.79 2913950
------------------------------------------------------------------------
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help : https://help.launchpad.net/ListHelp
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help : https://help.launchpad.net/ListHelp
