Hi!

You are testing MyISAM vs Innodb, you need to rerun with the same engine.

Cheers,
        -Brian

On Jul 28, 2009, at 7:57 PM, Patrick Galbraith wrote:

Hi all,

I'll be blogging about this in the AM. Any thoughts, contributions?

-------- Original Message --------
Subject:
a tale of two tests
Date:
Tue, 28 Jul 2009 21:54:09 -0400
From:
 <[email protected]>
To:
Brian 'Krow' Aker <[email protected]>


r...@domu-12-31-36-00-49-d2:~/sql-bench# ./run-all-tests -- server=drizzle
Benchmark DBD suite: 2.15
Date of test:        2009-07-28 17:26:08
Running tests on:    Linux 2.6.21.7-2.fc8xen x86_64
Arguments:           Comments:            Limits from:         Server
version:      Drizzle 2009.07.1089
Optimization:        None
Hardware:
alter-table: Total time: 30 wallclock secs ( 0.02 usr 0.04 sys + 0.00
cusr  0.00 csys =  0.06 CPU)
ATIS: Estimated total time: 4308.36 wallclock secs ( 4.59 usr 0.51 sys
+  0.00 cusr  0.00 csys =  5.10 CPU)
big-tables: Total time: 22 wallclock secs ( 9.61 usr  0.49 sys +  0.00
cusr  0.00 csys = 10.10 CPU)
connect: Total time: 20 wallclock secs ( 5.59 usr  3.89 sys +  0.00
cusr  0.00 csys =  9.48 CPU)
create: Total time: 87 wallclock secs ( 0.33 usr 0.38 sys + 0.00 cusr
0.00 csys =  0.71 CPU)
insert: Warning: Can't execute insert.  Check the file
'output/insert-drizzle-Linux_2.6.21.7_2.fc8xen_x86_64'
Failed (output/insert-drizzle-Linux_2.6.21.7_2.fc8xen_x86_64)
select: Total time: 1230 wallclock secs (16.74 usr  2.91 sys +  0.00
cusr  0.00 csys = 19.65 CPU)
transactions: Total time: 553 wallclock secs ( 2.84 usr  1.88 sys +
0.00 cusr  0.00 csys =  4.72 CPU)
wisconsin: Total time: 175 wallclock secs ( 1.92 usr  0.77 sys +  0.00
cusr  0.00 csys =  2.69 CPU)

Of 9 tests, 1 tests didn't work
Tests with estimated time have a + at end of line

Totals per operation:
Operation             seconds     usr     sys     cpu   tests
alter_table_add 13.00 0.01 0.00 0.01 100 alter_table_drop 13.00 0.01 0.01 0.02 91 connect 2.00 0.75 0.52 1.27 2000 connect+select_1_row 3.00 0.90 0.65 1.55 2000 connect+select_simple 2.00 0.77 0.62 1.39 2000 count_distinct 8.00 0.00 0.00 0.00 1000 count_distinct_2 13.00 0.00 0.00 0.00 1000 count_distinct_big 6.00 3.37 0.02 3.39 100 count_distinct_group 12.00 0.02 0.00 0.02 1000 count_distinct_group_on_key 13.00 0.02 0.00 0.02 1000 count_distinct_group_on_key_parts 11.00 0.01 0.00 0.01 1000 count_distinct_key_prefix 9.00 0.00 0.01 0.01 1000 count_group_on_key_parts 13.00 0.02 0.00 0.02 1000 count_on_key 367.00 0.07 0.05 0.12 50000 create+drop 21.00 0.07 0.11 0.18 10000 create_MANY_tables 16.00 0.09 0.09 0.18 10000 create_index 2.00 0.00 0.00 0.00 8 create_key+drop 28.00 0.12 0.10 0.22 10000 create_table 0.00 0.00 0.00 0.00 31 delete_autocommit 57.00 0.30 0.20 0.50 10000 delete_big 0.00 0.00 0.00 0.00 1 delete_commit 67.00 0.28 0.20 0.48 10000 delete_rollback 107.00 0.32 0.25 0.57 100 drop_index 2.00 0.00 0.00 0.00 8 drop_table 0.00 0.00 0.00 0.00 28 drop_table_when_MANY_tables 16.00 0.00 0.02 0.02 10000 insert 10.00 0.84 1.08 1.92 50768 insert_autocommit 2.00 0.17 0.30 0.47 10000 insert_commit 1.00 0.26 0.19 0.45 10000 insert_many_fields 5.00 0.15 0.09 0.24 2000 insert_rollback 1.00 0.33 0.13 0.46 100 min_max_on_key 523.00 5.27 1.55 6.82 70000 select_1_row 2.00 0.52 0.31 0.83 20000 select_1_row_cache 2.00 0.48 0.31 0.79 20000 select_2_rows 3.00 0.49 0.39 0.88 20000 select_big 1.00 0.10 0.00 0.10 70 select_big_str 1.00 0.51 0.20 0.71 2000 select_cache 96.00 1.24 0.28 1.52 10000 select_cache2 98.00 1.56 0.23 1.79 10000 select_column+column 2.00 0.45 0.30 0.75 20000
select_distinct                     1510.00    0.95    0.05    1.00
800 +
select_group 8.00 0.87 0.10 0.97 2800 select_group_when_MANY_tables 6.00 0.05 0.06 0.11 10000
select_join                          812.16    0.39    0.00    0.39
100 +
select_key_prefix_join              1974.19    1.97    0.06    2.03
100 +
select_many_fields 17.00 9.46 0.40 9.86 2000 select_range 58.00 4.83 0.49 5.32 410 select_simple 2.00 0.40 0.28 0.68 20000 select_simple_cache 1.00 0.32 0.31 0.63 20000 select_simple_join 2.00 0.25 0.04 0.29 500 update_autocommit 108.00 0.41 0.17 0.58 10000 update_commit 100.00 0.43 0.21 0.64 10000 update_rollback 110.00 0.34 0.23 0.57 100 wisc_benchmark 169.00 1.46 0.23 1.69 114
TOTALS                              6425.35   41.63   10.84   52.47
445329 +++



Benchmark DBD suite: 2.15
Date of test:        2009-07-29  1:24:55
Running tests on:    Linux 2.6.21.7-2.fc8xen x86_64
Arguments:
Comments:
Limits from:
Server version:      MySQL 5.1.38
Optimization:        None
Hardware:

alter-table: Total time: 12 wallclock secs ( 0.06 usr 0.03 sys + 0.00
cusr  0.00 csys =  0.09 CPU)
ATIS: Total time: 13 wallclock secs ( 2.50 usr  0.11 sys +  0.00 cusr
0.00 csys =  2.61 CPU)
big-tables: Total time: 11 wallclock secs ( 2.42 usr  0.71 sys +  0.00
cusr  0.00 csys =  3.13 CPU)
connect: Total time: 17 wallclock secs ( 4.58 usr  2.70 sys +  0.00
cusr  0.00 csys =  7.28 CPU)
create: Total time: 106 wallclock secs ( 2.52 usr  1.34 sys +  0.00
cusr  0.00 csys =  3.86 CPU)
insert: Total time: 695 wallclock secs (209.95 usr 41.60 sys +  0.00
cusr  0.00 csys = 251.55 CPU)
select: Total time: 241 wallclock secs (21.35 usr  3.01 sys +  0.00
cusr  0.00 csys = 24.36 CPU)
transactions: Test skipped because the database doesn't support transactions
wisconsin: Total time:  6 wallclock secs ( 1.69 usr  0.72 sys +  0.00
cusr  0.00 csys =  2.41 CPU)

All 9 test executed successfully

Totals per operation:
Operation             seconds     usr     sys     cpu   tests
alter_table_add 5.00 0.02 0.02 0.04 100 alter_table_drop 5.00 0.01 0.01 0.02 91 connect 1.00 0.62 0.09 0.71 2000 connect+select_1_row 2.00 0.60 0.19 0.79 2000 connect+select_simple 1.00 0.55 0.21 0.76 2000 count 5.00 0.01 0.00 0.01 100 count_distinct 5.00 0.11 0.02 0.13 1000 count_distinct_2 8.00 0.19 0.04 0.23 1000 count_distinct_big 13.00 3.61 0.10 3.71 120 count_distinct_group 5.00 0.53 0.03 0.56 1000 count_distinct_group_on_key 6.00 0.16 0.02 0.18 1000 count_distinct_group_on_key_parts 6.00 0.53 0.02 0.55 1000 count_distinct_key_prefix 4.00 0.11 0.02 0.13 1000 count_group_on_key_parts 7.00 0.54 0.03 0.57 1000 count_on_key 68.00 5.06 1.01 6.07 50100 create+drop 31.00 0.75 0.39 1.14 10000 create_MANY_tables 52.00 0.56 0.25 0.81 10000 create_index 1.00 0.01 0.00 0.01 8 create_key+drop 19.00 0.76 0.37 1.13 10000 create_table 0.00 0.00 0.00 0.00 31 delete_all_many_keys 19.00 0.02 0.01 0.03 1 delete_big 0.00 0.00 0.00 0.00 1 delete_big_many_keys 19.00 0.02 0.00 0.02 128 delete_key 1.00 0.14 0.25 0.39 10000 delete_range 4.00 0.00 0.00 0.00 12 drop_index 1.00 0.00 0.00 0.00 8 drop_table 0.00 0.00 0.00 0.00 28 drop_table_when_MANY_tables 1.00 0.21 0.16 0.37 10000 insert 39.00 3.13 3.14 6.27 350768 insert_duplicates 12.00 2.08 1.83 3.91 100000 insert_key 43.00 3.38 1.75 5.13 100000 insert_many_fields 3.00 0.19 0.00 0.19 2000 insert_select_1_key 2.00 0.00 0.00 0.00 1 insert_select_2_keys 2.00 0.00 0.00 0.00 1 min_max 4.00 0.01 0.00 0.01 60 min_max_on_key 15.00 7.17 1.65 8.82 85000 multiple_value_insert 2.00 0.19 0.00 0.19 100000 once_prepared_select 15.00 3.42 1.83 5.25 100000 order_by_big 14.00 10.43 0.19 10.62 10 order_by_big_key 13.00 10.74 0.38 11.12 10 order_by_big_key2 12.00 10.38 0.22 10.60 10 order_by_big_key_desc 13.00 10.69 0.30 10.99 10 order_by_big_key_diff 13.00 10.54 0.24 10.78 10 order_by_big_key_prefix 13.00 10.44 0.27 10.71 10 order_by_key2_diff 2.00 1.14 0.02 1.16 500 order_by_key_prefix 1.00 0.48 0.02 0.50 500 order_by_range 1.00 0.60 0.01 0.61 500 outer_join 18.00 0.01 0.00 0.01 10 outer_join_found 18.00 0.00 0.00 0.00 10 outer_join_not_found 11.00 0.00 0.00 0.00 500 outer_join_on_key 11.00 0.01 0.00 0.01 10 prepared_select 20.00 8.27 1.97 10.24 100000 select_1_row 2.00 0.43 0.28 0.71 20000 select_1_row_cache 2.00 0.47 0.32 0.79 20000 select_2_rows 2.00 0.46 0.33 0.79 20000 select_big 12.00 10.35 0.13 10.48 80 select_big_str 1.00 0.31 0.14 0.45 2000 select_cache 34.00 0.17 0.04 0.21 10000 select_cache2 34.00 0.58 0.11 0.69 10000 select_column+column 3.00 0.41 0.34 0.75 20000 select_diff_key 0.00 0.07 0.01 0.08 500 select_distinct 4.00 0.26 0.00 0.26 800 select_group 11.00 0.10 0.02 0.12 2911 select_group_when_MANY_tables 3.00 0.24 0.17 0.41 10000 select_join 1.00 0.07 0.00 0.07 100 select_key 38.00 17.40 3.23 20.63 200000 select_key2 39.00 17.29 3.42 20.71 200000 select_key2_return_key 38.00 17.50 3.21 20.71 200000 select_key2_return_prim 40.00 16.74 4.38 21.12 200000 select_key_prefix 42.00 10.59 2.60 13.19 200000 select_key_prefix_join 3.00 1.86 0.01 1.87 100 select_key_return_key 36.00 15.61 3.32 18.93 200000 select_many_fields 8.00 2.23 0.71 2.94 2000 select_range 50.00 3.81 0.22 4.03 410 select_range_key2 6.00 2.04 0.27 2.31 25010 select_range_prefix 6.00 1.92 0.34 2.26 25010 select_simple 2.00 0.38 0.43 0.81 20000 select_simple_cache 1.00 0.35 0.37 0.72 20000 select_simple_join 1.00 0.12 0.00 0.12 500 update_big 19.00 0.00 0.00 0.00 10 update_of_key 9.00 0.87 0.91 1.78 50000 update_of_key_big 7.00 0.01 0.00 0.01 501 update_of_primary_key_many_keys 8.00 0.01 0.02 0.03 256 update_with_key 39.00 5.13 5.65 10.78 300000 update_with_key_prefix 13.00 3.32 1.89 5.21 100000 wisc_benchmark 1.00 1.18 0.16 1.34 114 TOTALS 1101.00 240.70 50.09 290.79 2913950


_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to     : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help   : https://help.launchpad.net/ListHelp


_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to     : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help   : https://help.launchpad.net/ListHelp

Reply via email to