Hi All (especially testers),

I've found that the present sub-set of MySQL tests for drizzle are
unreliable for consistent results.
The following summary shows the same revision (339) both successful and
failing on a single server multiple times.
See:   http://build.drizzleproject.org/builders/centos5.64.1/
Recent Builds:

   - (Aug 18 16:11) rev=[339] success
#487<http://build.drizzleproject.org/builders/centos5.64.1/builds/487>:
   build successful
   - (Aug 18 15:48) rev=[339] failure
#486<http://build.drizzleproject.org/builders/centos5.64.1/builds/486>:
   failed test
   - (Aug 18 15:42) rev=[339] success
#485<http://build.drizzleproject.org/builders/centos5.64.1/builds/485>:
   build successful
   - (Aug 18 15:13) rev=[339] success
#484<http://build.drizzleproject.org/builders/centos5.64.1/builds/484>:
   build successful
   - (Aug 18 14:48) rev=[339] failure
#483<http://build.drizzleproject.org/builders/centos5.64.1/builds/483>:
   failed test


Everything is in full flux, so this only serves as an FYI.

But soon I suggest we should institute a code freeze, stability and finding
bugs period.  Nothing too formal, but after Features A,B,C perhaps we could
turn to "not crashing server" rather then "slash and burn". Not being one of
the code contributors, I'm not trying to start any flame war, just working
for the best result. :)


Regards

Ronald

=======================================================

TEST                           RESULT         TIME (ms)
-------------------------------------------------------

main.lock_tables_lost_commit   [ pass ]             12
main.information_schema        [ pass ]           1701
mysql-test-run: WARNING: Process 24183 died
main.alter_table               [ fail ]

ERROR: Failed to start master mysqld 0

Stopping All Servers
mysql-test-run: WARNING: caught exit of unknown child -1
mysql-test-run: WARNING: Forcing kill of process 24183
Restoring snapshot of databases
Resuming Tests

main.delete                    [ pass ]            131
main.distinct                  [ pass ]            176
main.heap_auto_increment       [ pass ]             12
main.heap_btree                [ pass ]             79
main.heap_var                  [ pass ]            543
main.heap_var                  [ pass ]            554
main.insert                    [ pass ]            905
main.join                      [ pass ]            952
main.join_crash                [ pass ]             23
main.join_nested               [ pass ]            228
main.join_outer                [ pass ]            384
main.join_outer_innodb         [ pass ]             11
main.lock                      [ pass ]             84
main.mysqlslap                 [ fail ]

/home/buildbot/slave/build00/build/client/.libs/lt-mysqlslap: Cannot
run query SELECT intcol1,intcol2,charcol1,charcol2,charcol3 FROM t1
ERROR : MySQL server has gone away
drizzletest: At line 5: command "$DRIZZLE_SLAP --silent
--concurrency=5 --iterations=20 --number-int-cols=2
--number-char-cols=3 --auto-generate-sql" failed

The result from queries just before the failure was:
exec of '/home/buildbot/slave/build00/build/client/mysqlslap -uroot
--port=9306  --silent --concurrency=5 --iterations=20
--number-int-cols=2 --number-char-cols=3 --auto-generate-sql' failed,
error: 256, status: 1, errno: 0

More results from queries before failure can be found in
/home/buildbot/slave/build00/build/tests/var/log/mysqlslap.log

Stopping All Servers
Restoring snapshot of databases
Resuming Tests

mysql-test-run: WARNING: Process 25270 died
main.select                    [ fail ]

ERROR: Failed to start master mysqld 0

Stopping All Servers
mysql-test-run: WARNING: caught exit of unknown child -1
mysql-test-run: WARNING: Forcing kill of process 25270
Restoring snapshot of databases
Resuming Tests

main.subselect                 [ fail ]

drizzletest: At line 2306: query 'INSERT INTO t2(y,z)
VALUES(@id,RAND()*1000)' failed: 2006: MySQL server has gone away

The result from queries just before the failure was:
< snip >
SELECT COUNT(DISTINCT t1.b)
)
)
FROM t1 GROUP BY t1.a LIMIT 1)
FROM t1 t2
GROUP BY t2.a;
(
SELECT (
SELECT (
SELECT COUNT(DISTINCT t1.b)
)
)
FROM t1 GROUP BY t1.a LIMIT 1)
2
2
2
DROP TABLE t1,t2;
CREATE TABLE t1 (a int, b int auto_increment, PRIMARY KEY (b));
CREATE TABLE t2 (x int auto_increment, y int, z int,
PRIMARY KEY (x), FOREIGN KEY (y) REFERENCES t1 (b));

More results from queries before failure can be found in
/home/buildbot/slave/build00/build/tests/var/log/subselect.log

Stopping All Servers
Restoring snapshot of databases
Resuming Tests

mysql-test-run: WARNING: Process 26064 died
main.subselect3                [ fail ]

ERROR: Failed to start master mysqld 0

Stopping All Servers
mysql-test-run: WARNING: caught exit of unknown child -1
mysql-test-run: WARNING: Forcing kill of process 26064
Restoring snapshot of databases
Resuming Tests

main.subselect_innodb          [ pass ]             94
main.type_newdecimal           [ pass ]            221
main.update                    [ pass ]            414
-------------------------------------------------------
Stopping All Servers
Failed 5/23 tests, 78.26% were successful.
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to     : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help   : https://help.launchpad.net/ListHelp

Reply via email to