From: James Cox [mailto:[EMAIL PROTECTED]] > My plan is to revamp the way that tests work, so it's more efficient. But, > you are more than welcome to work on the current testing system, -- all the > tests will be converted anyhow :)
First iteration - regularize the output to allow easy post-processing (to HTML or for generating summaries), and made to run on Win32. Added information on context of test run to log (when, where, version). Made fatal any errors within the test scripts (rather than PHP). Require an exactly specified version of PHP (no guessing!). I'd really like to commit this stuff. The patches are getting large... Output from run-tests.php ===================================================================== TIME 2002-05-05 12:52:51 - start of test run CWD : C:\net.php\php4-current PHP : Debug_TS\\php-cgi.exe PHP SAPI : cgi PHP version : 4.3.0-dev --------------------------------------------------------------------- .... testing extension: ctype .... directory C:\net.php\php4-current/ext/ctype/tests PASS ctype on integers FAIL ctype on strings (002.phpt) --------------------------------------------------------------------- .... testing extension: mbstring .... directory C:\net.php\php4-current/ext/mbstring/tests PASS Simple multi-byte print test (EUC-JP) PASS mb_internal_encoding() test FAIL mb_http_input() (003.phpt) PASS mb_http_output() FAIL mb_detect_order() (005.phpt) PASS mb_substitute_character() PASS mb_output_handler() (EUC-JP) PASS mb_preferred_mime_name() PASS mb_strlen() PASS mb_strpos() PASS mb_strrpos() PASS mb_substr() PASS mb_strcut() PASS mb_strimwidth() FAIL mb_convert_variables() (015.phpt) PASS mb_convert_encoding() PASS mb_detect_encoding() PASS mb_strwidth() PASS mb_strlen() --------------------------------------------------------------------- .... testing extension: session .... directory C:\net.php\php4-current/ext/session/tests PASS Session Object Serialization PASS session_unset() without any session PASS Session Object Deserialization PASS session_set_save_handler test PASS Custom save handler, multiple session_start()s, complex data structure test. PASS References between variables in sessions --------------------------------------------------------------------- .... testing extension: standard .... directory C:\net.php\php4-current/ext/standard/tests/aggregation FAIL aggregating everything (aggregate.phpt) FAIL aggregating all methods (aggregate_methods.phpt) FAIL aggregating methods specified in the list (aggregate_methods_by_list.phpt) FAIL aggregating methods matching regular expression (aggregate_methods_by_regexp.phpt) FAIL aggregating all default properties (aggregate_properties.phpt) FAIL aggregating default properties specified in the list (aggregate_properties_by_list.phpt) FAIL aggregating default properties matching regular expression (aggregate_properties_by_regexp.phpt) FAIL retrieving aggregation info (aggregation_info.phpt) FAIL deaggreating (deaggregate.phpt) .... directory C:\net.php\php4-current/ext/standard/tests/array FAIL Test array_merge and array_walk (001.phpt) FAIL Test arsort, asort, krsort, ksort, rsort, and sort (002.phpt) FAIL Test usort, uksort and uasort (003.phpt) PASS Test natsort and natcasesort FAIL search_array and in_array (including bug 13567) (array_search.phpt) PASS count .... directory C:\net.php\php4-current/ext/standard/tests/assert PASS assert() .... directory C:\net.php\php4-current/ext/standard/tests/file FAIL File type functions (001.phpt) FAIL File/Stream functions (002.phpt) FAIL is_file/file_exist (003.phpt) .... directory C:\net.php\php4-current/ext/standard/tests/general_functions PASS sprintf() function PASS quoted_printable_decode() function test PASS levenshtein() function test PASS fgetcsv() with tab delimited fields (BUG #8258) PASS is_scalar() function test FAIL quoted_printable_decode() function test with CR/LF (006.phpt) .... directory C:\net.php\php4-current/ext/standard/tests/math FAIL Simple math tests (abs.phpt) FAIL Tests for floor en ceil (floorceil.phpt) FAIL Various pow() tests (pow.phpt) FAIL Simple math tests (round.phpt) .... directory C:\net.php\php4-current/ext/standard/tests/reg PASS RegReplace test 1 PASS RegReplace test 2 PASS ereg_replace single-quote test PASS simple ereg test PASS Test Regular expression register support in ereg PASS Test ereg_replace of start-of-line PASS Test empty result buffer in reg_replace PASS Test back-references in regular expressions FAIL Test split() (009.phpt) PASS Long back references PASS \0 back reference PASS nonexisting back reference PASS escapes in replace string PASS backreferences not replaced recursively PASS replace empty matches PASS test backslash handling in regular expressions .... directory C:\net.php\php4-current/ext/standard/tests/serialize PASS serialize()/unserialize()/var_dump() PASS serialize() (Bug #14293) .... directory C:\net.php\php4-current/ext/standard/tests/strings PASS strtr() function FAIL trim() function (trim.phpt) FAIL wordwrap() function (wordwrap.phpt) .... directory C:\net.php\php4-current/ext/standard/tests/time FAIL microtime() function (001.phpt) FAIL strtotime() function (002.phpt) .... directory C:\net.php\php4-current/ext/standard/tests/versioning PASS version_compare test --------------------------------------------------------------------- .... testing extension: xml .... directory C:\net.php\php4-current/ext/xml/tests PASS XML parser test, function callbacks PASS XML parser test, object tuple callbacks PASS XML parser test, xml_set_object callbacks PASS XML parser case folding test PASS UTF-8<->ISO Latin 1 encoding/decoding test PASS xml_parse_into_struct/umlauts in tags --------------------------------------------------------------------- .... testing generic PHP .... directory C:\net.php\php4-current/pear/DB/tests FAIL DB configurable error handler test (db_error2.phpt) .... directory C:\net.php\php4-current/pear/DB/tests/driver FAIL DB_driver::connect test (01connect.phpt) FAIL DB_driver::fetch test (02fetch.phpt) FAIL DB_driver::simpleQuery test (03simplequery.phpt) FAIL DB_driver::numCols test (04numcols.phpt) FAIL DB_driver::sequences (05sequences.phpt) FAIL DB_driver::prepare/execute test (06prepexec.phpt) FAIL DB_driver::affectedRows test (08affectedrows.phpt) FAIL DB_driver::numRows test (09numrows.phpt) FAIL DB_driver::error mapping (10errormap.phpt) FAIL DB_driver::row limit (13limit.phpt) FAIL DB_driver::fetchmode object (14fetchmode_object.phpt) FAIL DB_driver::escape data test (15quote.phpt) .... directory C:\net.php\php4-current/pear/DB/tests/ibase .... directory C:\net.php\php4-current/pear/DB/tests/mysql FAIL DB_mysql::connect test (01connect.phpt) FAIL DB_mysql fetch test (02fetch.phpt) FAIL DB_mysql::simpleQuery test (03simplequery.phpt) FAIL DB_mysql::numCols test (04numcols.phpt) FAIL DB_mysql sequences (05sequences.phpt) FAIL DB_mysql::prepare/execute test (06prepexec.phpt) FAIL DB_mysql::errorNative test (07errornative.phpt) FAIL DB_mysql::affectedRows test (08affectedrows.phpt) FAIL DB_mysql::numRows test (09numrows.phpt) FAIL DB_mysql error mapping (10errormap.phpt) FAIL DB_mysql tableInfo test (12tableinfo.phpt) FAIL DB_mysql row limit (13limit.phpt) FAIL DB_mysql::fetchmode object (14fetchmode_object.phpt) .... directory C:\net.php\php4-current/pear/DB/tests/oci8 .... directory C:\net.php\php4-current/pear/DB/tests/odbc .... directory C:\net.php\php4-current/pear/DB/tests/pgsql .... directory C:\net.php\php4-current/pear/XML/tests FAIL XML Parser: parse simple string (001.phpt) FAIL XML Parser: parse from file (002.phpt) FAIL XML Parser: parse from file resource (003.phpt) FAIL XML Parser: error class (004.phpt) FAIL XML Parser: mixing character encodings (005.phpt) .... directory C:\net.php\php4-current/pear/tests FAIL PEAR constructor/destructor test (pear1.phpt) FAIL PEAR_Autoloader (pear_autoloader.phpt) FAIL PEAR_Config (pear_config.phpt) PASS PEAR_Error: basic test PASS PEAR_Error: die mode PASS PEAR_Error: default error handling PASS PEAR_Error: expected errors FAIL PEAR_Registry (pear_registry.phpt) FAIL System commands tests (pear_system.phpt) .... directory C:\net.php\php4-current/tests/basic PASS Trivial "Hello World" test PASS Add 3 variables together and print result PASS Multiply 3 variables and print result PASS Divide 3 variables and print result PASS Subtract 3 variables and print result PASS Testing | and & operators FAIL Testing $argc and $argv handling (011.phpt) .... directory C:\net.php\php4-current/tests/classes PASS Classes general test PASS Classes inheritance test .... directory C:\net.php\php4-current/tests FAIL dirname test (dirname.phpt) .... directory C:\net.php\php4-current/tests/func PASS Strlen() function test PASS Static variables in functions PASS General function test PASS General function test PASS Testing register_shutdown_function() FAIL Output buffering tests (006.phpt) PASS INI functions test .... directory C:\net.php\php4-current/tests/lang PASS Simple If condition test PASS Simple While Loop Test PASS Simple Switch Test PASS Simple If/Else Test PASS Simple If/ElseIf/Else Test PASS Nested If/ElseIf/Else Test PASS Function call with global and static variables PASS Testing recursive function PASS Testing function parameter passing PASS Testing function parameter passing with a return value PASS Testing nested functions PASS Testing stack after early function return PASS Testing eval function PASS Testing eval function inside user-defined function PASS Testing include PASS Testing user-defined function in included file PASS Testing user-defined function falling out of an If into another PASS eval() test PASS eval() test PASS Switch test 1 PASS Switch test 2 PASS Switch test 3 PASS Regression test PASS Looped regression test (may take a while) PASS Mean recursion test PASS Testing string scanner confirmance PASS Testing do-while loop PASS Testing calling user-level functions from C FAIL OO Bug Test (Bug #7515) (029.phpt) PASS $this in constructor test FAIL Internal hash position bug on assignment (Bug #16227) (031.phpt) PASS Class method registration PASS Alternative syntaxes test .... directory C:\net.php\php4-current/tests/strings PASS String functions PASS Formatted print functions PASS HTML entities ------------------------------------------------------------------- TIME 2002-05-05 12:53:26 - end of test run TEST RESULT SUMMARY ============================= Number of tests : 227 Tests skipped : 48 (21.1%) Tests failed : 71 (31.3%) Tests passed : 108 (47.6%) ============================= Skipped 24 extensions ===================================================================== End of output from run-tests.php -- PHP Development Mailing List <http://www.php.net/> To unsubscribe, visit: http://www.php.net/unsub.php
