Over the last couple of weeks I focused my work a bit on getting cleaner jobs for Marionette on Android. Here 9 out of 10 chunks were basically failing all the time. So lots of work was expected. [1] actually tracked everything.
To get more passing tests I did not only skip/disable those affected tests, but also make them work with Fennec as run on the Android emulator. That's not always easy given the missing Gecko log output. So in some cases it was more a try and error scenario. Beside that also other work had to happen, like implementing correct tab handling for Fennec in Marionette [2], coping with the overall slowness of the test execution [3], and others. Given my priorities I was not able to get everything fixed and implemented. But at least we now have mostly greenish test jobs with a low intermittent failure rate. As such a bump to Tier-2 on Treeherder was not a problem anymore, and was done on [4]. And that even for mozilla-aurora and mozilla-beta. The outcome for us who are working on Marionette and the Webdriver implementation is, that we are able to test our bug fixes and patches for new features more easily, and also finally get visual feedback for broken jobs of try builds on mozreview. As such it helps a lot in keeping up with support for both applications. If we stay with the low number of intermittents I will go ahead and request Tier-1 level in the next couple of days. [1] https://bugzilla.mozilla.org/show_bug.cgi?id=3D1297394 [2] https://bugzilla.mozilla.org/show_bug.cgi?id=3D1323185 [3] https://bugzilla.mozilla.org/show_bug.cgi?id=3D1322277 [4] https://bugzilla.mozilla.org/show_bug.cgi?id=3D1332205 Cheers, -- Henrik Skupin Senior Software Engineer Mozilla Corporation _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
