Re: [testing] Tests scores on http://harmonytest.org Was: [DRLVM] General stability

2006-11-12 Thread Anton Luht
Alexei, I like your approach to result comparison. 10% can be default value for some form field - anyone can change it if needed. OK, let's try it and see if it satisfies the community/ Probably more conventional would be to parse system-out![CDATA[]]/system-out for some metric. Does the

Re: [testing] Tests scores on http://harmonytest.org Was: [DRLVM] General stability

2006-11-10 Thread Alexei Fedotov
Anton, I like your approach to result comparison. 10% can be default value for some form field - anyone can change it if needed. As for test execution time reported by JUnit, it is applicable for stress tests as well if we gradually increase a load over time. Though using ttime field for stress

Tests scores on http://harmonytest.org Was: [DRLVM] General stability

2006-11-09 Thread Fedotov, Alexei A
Geir, I like the overall letter. Anton, I have related question. How can we improve http://harmonytest.org to make it possible to publish not just pass, fail, or error but numeric test scores? How this is related to the letter? I believe that stress tests which were mentioned in the letter

Re: [testing] Tests scores on http://harmonytest.org Was: [DRLVM] General stability

2006-11-09 Thread Anton Luht
Hello, Alexei, I have related question. How can we improve http://harmonytest.org to make it possible to publish not just pass, fail, or error but numeric test scores? Easily - test results in JUnit reports have 'time' property - execution time in seconds. We can import and show them in the