From: tyrael Operating system: PHP version: trunk-SVN-2011-11-13 (SVN) Package: Testing related Bug Type: Bug Bug description:setting REPORT_EXIT_STATUS for make test won't work
Description: ------------ when setting up the ci environment, I noticed, that passing the REPORT_EXIT_STATUS environment variable to run-tests.php works, but passing the same thing to make test won't. after some debugging with Hannes, we figured out, that the test target in the Makefile overuses the error suppression operator(http://sunsite.ualberta.ca/Documentation/Gnu/make- 3.79/html_chapter/make_5.html#SEC48). if you check the test target (http://svn.php.net/viewvc/php/php- src/trunk/Makefile.global?view=markup#l88) you can see that the whole target is a one-liner prefixed with - which means that anything can fail in the target, it will still report success. :/ the same pattern is used for many of the targets. Could somebody look into this? Test script: --------------- REPORT_EXIT_STATUS=1 make test; echo $?; Expected result: ---------------- should print non-zero if there are failed tests. Actual result: -------------- always prints 0 -- Edit bug report at https://bugs.php.net/bug.php?id=60285&edit=1 -- Try a snapshot (PHP 5.4): https://bugs.php.net/fix.php?id=60285&r=trysnapshot54 Try a snapshot (PHP 5.3): https://bugs.php.net/fix.php?id=60285&r=trysnapshot53 Try a snapshot (trunk): https://bugs.php.net/fix.php?id=60285&r=trysnapshottrunk Fixed in SVN: https://bugs.php.net/fix.php?id=60285&r=fixed Fixed in SVN and need be documented: https://bugs.php.net/fix.php?id=60285&r=needdocs Fixed in release: https://bugs.php.net/fix.php?id=60285&r=alreadyfixed Need backtrace: https://bugs.php.net/fix.php?id=60285&r=needtrace Need Reproduce Script: https://bugs.php.net/fix.php?id=60285&r=needscript Try newer version: https://bugs.php.net/fix.php?id=60285&r=oldversion Not developer issue: https://bugs.php.net/fix.php?id=60285&r=support Expected behavior: https://bugs.php.net/fix.php?id=60285&r=notwrong Not enough info: https://bugs.php.net/fix.php?id=60285&r=notenoughinfo Submitted twice: https://bugs.php.net/fix.php?id=60285&r=submittedtwice register_globals: https://bugs.php.net/fix.php?id=60285&r=globals PHP 4 support discontinued: https://bugs.php.net/fix.php?id=60285&r=php4 Daylight Savings: https://bugs.php.net/fix.php?id=60285&r=dst IIS Stability: https://bugs.php.net/fix.php?id=60285&r=isapi Install GNU Sed: https://bugs.php.net/fix.php?id=60285&r=gnused Floating point limitations: https://bugs.php.net/fix.php?id=60285&r=float No Zend Extensions: https://bugs.php.net/fix.php?id=60285&r=nozend MySQL Configuration Error: https://bugs.php.net/fix.php?id=60285&r=mysqlcfg
