Whoops didn't mean to send it to you guys! Sorry! Please ignore :)
On Thu, Mar 13, 2014 at 11:04 AM, Jon Robson <[email protected]> wrote: > ---------- Forwarded message ---------- > From: Jon Robson <[email protected]> > Date: Thu, Mar 13, 2014 at 11:03 AM > Subject: Problems with QA MobileFrontend Chrome builds > To: [email protected] > Cc: Chris McMahon <[email protected]>, mobile-l < > [email protected]>, "QA (software quality assurance) for > Wikimedia projects." <[email protected]> > > > We get a lot of failures on the Chrome build. The Firefox one seems a lot > more stable in comparison although occasionally gets hit by similar > problems. > > Problem 1: There seems to be more connection problems here - sometimes > page simply don't load. Usually hits Chrome builds. This can effect > important steps such as opting into beta. [0] > Problem 2: Selector issues - the language test Language selection.Closing > language overlay (overlay > button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_> > persistently > fails. It seems to fail to match an element even though I can see it in the > screencast. Do selectors work differently in the Firefox driver to Chrome > driver?As these work fine in Firefox [1] > Problem 3: Browser back button doesn't seem to work in the Chrome driver. > Is that setup correctly? [2] > Problem 4: Opting into beta or alpha sometimes fails due to a cookie not > setting correctly. I raised a bug [4] help on fixing that bug would be most > appreciated. > > [0] https://saucelabs.com/jobs/4e5d15a40a7f4c2eb06b59f78e87e859 > [1] > https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_/ > [2] > https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_/ > [3] > https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Encourage%20new%20users%20to%20Keep%20Going/I_see_a_KeepGoing_message_after_completing_my_edit/ > [4] https://bugzilla.wikimedia.org/show_bug.cgi?id=62583 > > > On Thu, Mar 13, 2014 at 1:01 AM, <[email protected]> wrote: > >> * FAILURE: MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome >> Build #318 >> <https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/> >> (Thu, 13 Mar 2014 07:32:46 +0000)* >> *Test >> Result*<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/> >> 6 failed, 2 skipped >> Failed Tests *Test Name**Duration**Age* Encourage new users to Keep >> Going.I see a KeepGoing message after completing my >> edit<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Encourage%20new%20users%20to%20Keep%20Going/I_see_a_KeepGoing_message_after_completing_my_edit> >> 1 >> min 11 >> sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/> >> Language >> selection.Closing language overlay (browser >> button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_> >> 10 >> sec4<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/314/> >> Language >> selection.Closing language overlay (overlay >> button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_> >> 8.9 >> sec24<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/294/> >> Nearby >> pages.Nearby button >> visible<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Nearby%20pages/Nearby_button_visible> >> 18 >> sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/> >> Search.Search >> from >> Watchlist<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Search/Search_from_Watchlist> >> 12 >> sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/> >> VisualEditor.I >> can edit a page using >> VisualEditor<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/VisualEditor/I_can_edit_a_page_using_VisualEditor> >> 19 >> sec2<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/316/> >> All >> Tests *Package**Duration**Fail**Skip**Total* >> (root)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)>22 >> min6262 >> > > > > > -- > Jon Robson > * http://jonrobson.me.uk > * https://www.facebook.com/jonrobson > * @rakugojon > -- Jon Robson * http://jonrobson.me.uk * https://www.facebook.com/jonrobson * @rakugojon
_______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
