https://bz.apache.org/bugzilla/show_bug.cgi?id=59152

--- Comment #6 from Milamber <[email protected]> ---
Hello,

I think that the revert will be a good thing. I made some load tests with this
new default option. My experience is this new default mask a bad load test.
I explain:
If you are a plan test like this:
1/ Login Form
2/ Login (id/pass)
3/ Home
4/ Search
5/ Results
etc.

With this default option, if the 2/Login failed (target server failed to login
randomly), you see only some Errors (during the load test) on 2/Login, the
other pages have 0 error (because return to 1/ after error)

After, when you show the graph results : all is good
If you show results in the summary listener, you see results like this:
1/ Login form : 2000 samples
2/ Login (id/pass) : 2000 samples with 25% errors
3/ Home : 1500 samples with 0 errors
4/ Search : 1500 samples with 0 errors
etc.

It's very easy to conclude that this load test is successful (only 25% errors
on 1 page), but in reality, this is a bad load test, because my target load is
reduce to 25%, and the target server have been tested with only at 75% of the
load.
I prefer the old option, which force me to stop a load test if the errors
increase on all pages after a error on the login page.

-- 
You are receiving this mail because:
You are the assignee for the bug.

Reply via email to