Dan Steinicke wrote: > regress.py has been added to the Chandler tools directory. This is a [...] > Test output is collected in a file named regress_result.txt > Output file contains svn rev, test name, test status (pass, fail), and > elapsed time for test in a comma delimited format > This script needs to be run in a svn directory with read only access, > script does not deal with ssh passwords > Requires CHANDLERHOME environment variable to be set > Paths to test files should be relative paths starting from CHANDLERHOME
Thanks Dan. Besides the above improvements, here are a few more - would be great to have someone working on this during the sprint today for example: - stop when test fails - stop when perf threshold crossed - do binary search between start and end revs to find the regression with a minimum number of cycles - skip revision numbers where nothing changed (can happen because our svn rev houses several projects and therefore the rev numbers can jump in any single project) The main idea with this script is that when a human finds a regression, we can start this tool to do the tedious process of trying several old revisions to pinpoint where exactly the regression happened. -- Heikki Toivonen
signature.asc
Description: OpenPGP digital signature
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ Open Source Applications Foundation "Dev" mailing list http://lists.osafoundation.org/mailman/listinfo/dev
