[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

gerritbot added a comment. Change 247901 merged by jenkins-bot: Additionally run Wikidata browsertests without saucelabs https://gerrit.wikimedia.org/r/247901 TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefe

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

JanZerebecki added a comment. raita.wmflabs.org shows the correct link. TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JanZerebecki Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin,

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

JanZerebecki added a comment. If you can figure that out, then what does go wrong with the last few failures on sauce labs? TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JanZerebecki Cc: gerri

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

Tobi_WMDE_SW added a comment. That's the nice thing about saucelabs: you can have a look at the test-run in a video to figure out what went wrong. TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

JanZerebecki added a comment. For now lets run the jobs both with and without saucelabs until we figure out how to make one of them not flaky. TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Jan

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

JanZerebecki added a comment. A timeout will be also be reported when a link can not be found when the instruction was wait for that link to appear. So it is not that simple. Most of them seem not to be "A script on this page may be busy, or it may have stopped responding.". TASK DETAIL htt

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

Jonas added a comment. Is this the right link to see the results? So it's mostly timeouts? This sadly made me laugh: Scenario: Edit sitelink Unexpected modal dialog (text: A script

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

JanZerebecki added a comment. Yes that seems to work. TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: JanZerebecki Cc: gerritbot, Jonas, Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, JanZerebecki, Ak

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

zeljkofilipin added a comment. I think the only thing left is to tell the machine you want to run the browser headless. export HEADLESS=true https://github.com/wikimedia/mediawiki-selenium#headless-mode TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://pha

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

JanZerebecki added a comment. Yes that seems to disable saucelabs. But now I get "unable to obtain stable firefox connection in 60 seconds" as a failure for the second scenario: http://raita.wmflabs.org/#projects/https%3A%2F%2Fgithub.com%2Fwmde%2FWikidataBrowserTests.git/builds/FLBroL2mRIOCJAGEQ3

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

Tobi_WMDE_SW added a comment. @JanZerebecki AFAIK it uses Saucelabs whenever SAUCE_ONDEMAND_USERNAME and SAUCE_ONDEMAND_ACCESS_KEY are set. Unsetting these should make it use the local browser. TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://phabricator.wik

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

JanZerebecki added a comment. It seems not setting --format Cucumber::Formatter::Sauce as in the patch does not cause it to not use saucelabs. How do I instruct the framework to use a local browser instead? TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https://ph

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

gerritbot added a subscriber: gerritbot. gerritbot added a comment. Change 247901 had a related patch set uploaded (by JanZerebecki): [WIP] Run Wikidata browsertests without saucelabs https://gerrit.wikimedia.org/r/247901 TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCE

[Wikidata-bugs] [Maniphest] [Commented On] T116166: move wikidata browsertests to not use saucelabs

zeljkofilipin added a comment. This should be really easy to do. Our framework supports running tests on a local browser or Sauce Labs. Let me know if you need help with this, or if you would like to pair on it. TASK DETAIL https://phabricator.wikimedia.org/T116166 EMAIL PREFERENCES https