[Wikidata-bugs] [Maniphest] T266861: Wikibase browser tests are flaky

2020-11-09 Thread Tarrow 
Tarrow closed this task as "Invalid".
Tarrow added a comment.


  We struggled to determine the cause of this. As speculated it could be due to 
some network or serverside failure. Digging through the server side debug logs 
didn't show any very obvious things though.
  
  We considered that it is unfortunate that we can't see the normal brower 
console logs since this might show us failures such as load.php requests 
failing succeed.
  
  Sadly it looks like the ability to do this isn't there in the newer webdriver 
spec. See: 
https://github.com/SeleniumHQ/selenium/wiki/JsonWireProtocol#sessionsessionidlog
 (the old version) VS https://w3c.github.io/webdriver/
  
  Since it seems to have magically fixed itself; it couldn't be reproduced 
locally; and we don't have a great strategy for making ourselves better able to 
cope with the flaky tests in the future I'll close as invalid.

TASK DETAIL
  https://phabricator.wikimedia.org/T266861

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow
Cc: Michael, toan, Aklapper, Tarrow, Akuckartz, Iflorez, alaa_wmde, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T266861: Wikibase browser tests are flaky

2020-10-30 Thread toan 
toan added a comment.


  might be worth mentioning this here as well -> 
https://phabricator.wikimedia.org/T265596

TASK DETAIL
  https://phabricator.wikimedia.org/T266861

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow, toan
Cc: toan, Aklapper, Tarrow, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T266861: Wikibase browser tests are flaky

2020-10-30 Thread Tarrow 
Tarrow created this task.
Tarrow added a project: Wikidata-Campsite (Wikidata-Campsite-Iteration-∞).
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  We've recently seen substantially flaky browsers tests:
  c.f.
  
https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php72-selenium-docker/11727/console
  
  Mostly seems to be due to slow saving.
  
00:10:35.328 [Chrome 73.0.3683.75 linux #0-1] 1) item can add a statement 
using the keyboard
00:10:35.328 [Chrome 73.0.3683.75 linux #0-1] element (".valueview-input") 
still existing after 1ms
00:10:35.328 [Chrome 73.0.3683.75 linux #0-1] Error: element 
(".valueview-input") still existing after 1ms
00:10:35.328 [Chrome 73.0.3683.75 linux #0-1] at Context. 
(/workspace/src/extensions/Wikibase/repo/tests/selenium/specs/item.js:65:28)
  
  We should try to make these less fragile (maybe increase possible timeouts)

TASK DETAIL
  https://phabricator.wikimedia.org/T266861

WORKBOARD
  https://phabricator.wikimedia.org/project/board/3539/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tarrow
Cc: Aklapper, Tarrow, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs