https://bz.apache.org/bugzilla/show_bug.cgi?id=66112
Bug ID: 66112
Summary: HTTP Request shown as passed even if all assertions
failed but the last assertion passed
Product: JMeter
Version: 5.4.3
Hardware: PC
Status: NEW
Severity: major
Priority: P2
Component: Main
Assignee: issues@jmeter.apache.org
Reporter: shantanu.shi...@ni.com
Target Milestone: JMETER_5.5
Created attachment 38312
--> https://bz.apache.org/bugzilla/attachment.cgi?id=38312&action=edit
Request with the passing response placed last in the list
If there are multiple Response Assertions under a HTTP request, the status of
the request passing or failing is getting set on each assertion, instead of
getting set as a combined result of all the assertions.
Because of this, even if the last assertion is passing and all the preceding
assertions failed, the request shows up as passed, with the green tick mark
icon.
I verified that the status is getting set to that of the last assertion by
moving the passing assertion to various positions under the request. If there
is a succeeding assertion after the passing assertion that fails, than the
request is shown as failed. The Request only passes if the passing assertion is
last in the list.
This seems to be misleading behaviour, I would expect the request to show as
successful only if all of the assertions are passing. So, this seems to be a
bug.
I haven't taken a look at the source code of the assertions, but a possible
issue could be each of the assertions are tried out in the order they are
present, and on testing out each assertion, the status of the request is set to
that of the assertion, passed or failed. If this is the case, maybe ANDing the
results of all the assertion and setting the status of the request to that will
be a better way.
--
You are receiving this mail because:
You are the assignee for the bug.
