We get a lot of failures on the Chrome build. The Firefox one seems a lot more stable in comparison although occasionally gets hit by similar problems.
Problem 1: There seems to be more connection problems here - sometimes page simply don't load. Usually hits Chrome builds. This can effect important steps such as opting into beta. [0] Problem 2: Selector issues - the language test Language selection.Closing language overlay (overlay button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_> persistently fails. It seems to fail to match an element even though I can see it in the screencast. Do selectors work differently in the Firefox driver to Chrome driver?As these work fine in Firefox [1] Problem 3: Browser back button doesn't seem to work in the Chrome driver. Is that setup correctly? [2] Problem 4: Opting into beta or alpha sometimes fails due to a cookie not setting correctly. I raised a bug [4] help on fixing that bug would be most appreciated. [0] https://saucelabs.com/jobs/4e5d15a40a7f4c2eb06b59f78e87e859 [1] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_/ [2] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_/ [3] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Encourage%20new%20users%20to%20Keep%20Going/I_see_a_KeepGoing_message_after_completing_my_edit/ [4] https://bugzilla.wikimedia.org/show_bug.cgi?id=62583 On Thu, Mar 13, 2014 at 1:01 AM, <[email protected]> wrote: > * FAILURE: MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome > Build #318 > <https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/> > (Thu, 13 Mar 2014 07:32:46 +0000)* > *Test > Result*<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/> > 6 failed, 2 skipped > Failed Tests *Test Name**Duration**Age* Encourage new users to Keep > Going.I see a KeepGoing message after completing my > edit<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Encourage%20new%20users%20to%20Keep%20Going/I_see_a_KeepGoing_message_after_completing_my_edit>1 > min 11 > sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/> > Language > selection.Closing language overlay (browser > button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_>10 > sec4<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/314/> > Language > selection.Closing language overlay (overlay > button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_>8.9 > sec24<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/294/> > Nearby > pages.Nearby button > visible<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Nearby%20pages/Nearby_button_visible>18 > sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/> > Search.Search > from > Watchlist<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Search/Search_from_Watchlist>12 > sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/> > VisualEditor.I > can edit a page using > VisualEditor<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/VisualEditor/I_can_edit_a_page_using_VisualEditor>19 > sec2<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/316/> > All > Tests *Package**Duration**Fail**Skip**Total* > (root)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)>22 > min6262 >
_______________________________________________ Mobile-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mobile-l
