https://bugzilla.wikimedia.org/show_bug.cgi?id=61304
Web browser: ---
Bug ID: 61304
Summary: browser tests should assert there are no pink error
boxes on the page
Product: Wikimedia
Version: unspecified
Hardware: All
OS: All
Status: NEW
Severity: normal
Priority: Unprioritized
Component: Quality Assurance
Assignee: wikibugs-l@lists.wikimedia.org
Reporter: sp...@wikimedia.org
CC: cmcma...@wikimedia.org, jh...@wikimedia.org,
zfili...@wikimedia.org
Mobile Platform: ---
When I kick back with some popcorn and watch Sauce Labs browser test movies, I
sometimes notice error boxes appearing on the screen. Yet the test continues,
only to fail later.
The classic example is
MEDIAWIKI_PASSWORD=wrong
MEDIAWIKI_URL=http://en.wikipedia.beta.wmflabs.org/wiki/
MEDIAWIKI_USER=Selenium_user bundle exec cucumber
features/flow_logged_in.feature
the login fails with "Login error Incorrect password..." yet the tests
continue.
There are other examples where the page reports an API error and the tests keep
rolling.
99% of the time, if anything appears on the page with class=errorbox or
class=error, it's serious. Is there a way tests can implicitly assert these
aren't on the page on every step, and if not the case report the contents of
the .error/.errorbox ?
--
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
