Hi! Hsin-Yi - can I work with you to get this work better understood? Either a Vidyo/Hello meeting or IRC to talk through some details?
I haven't worked directly with B2G teams in the past -- I am the new manager for the TaskCluster team, and work for Lawrence Mandel as a Technical Lead in Release Engineering. I mentioned this at Whistler: we need dedicated people inside B2G org to "own" these in-tree configurations. The TaskCluster team is available to train people on how to create task definitions for build and test automation. We do not have enough staff to manage greening up individual tests. This team is focused this quarter on making the TaskCluster platform production ready for Firefox Desktop and migrating off of BuildBot. I've responded in detail below: On Sunday, August 9, 2015 at 8:12:58 PM UTC-7, Hsin-Yi Tsai wrote: > == Follow-up Tasks == > Stabilize TaskCluster. By monitoring Treeherder [1], it > looks that emu-ics tests on TC are not stable enough, > while results of the same tests are much greener on old > mechanism. Wondering if the failures result from > instability of TaskCluster. If so, we should fix the > instability first. Fixing the tests requires a bunch of in-tree work. TaskCluster is designed so that development teams can manage their own builds. All build configuration will be moved in-tree for this purpose. In looking at the builds that are failed, there appear to be configuration errors in the task definitions: https://tools.taskcluster.net/task-inspector/#d5ktZVx1Tc-0JguzfzdM5Q/ This is trying to execute a task with the command-line option '--test-packages-url', but the necessary URL is not specified. As I mentioned above, I can work with you on identifying the failures on each build and helping identify fixes. If there are TaskCluster-specific failures, we can address those. So far in my looking at the tasks, I've only seen in-tree task definition errors. > BugĀ 1159091 - gecko: > Show emulator-x86-kk as it's own platform This seems to be well underway. > BugĀ 1192118 - To > be able to enable tests per module on TackCluster This request is for in-tree decision task changes, not a TaskCluster feature. The in-tree stuff is just configuration, and chunking tests not something that TaskCluster itself could do automatically. Someone has to rewrite that config and/or the build itself. > [1] > https://treeherder.allizom.org/#/jobs?repo=try&revision=f63190a6166f&exclusion_profile=false > > [2] https://wiki.mozilla.org/B2G/Emulator#Fix_Failed_test_cases Thank you for assembling this! I had a look through and, as I mentioned above, noticed that there's quite a bit of bustage in-tree, that I think can be addressed if we work together. -selena _______________________________________________ dev-b2g mailing list [email protected] https://lists.mozilla.org/listinfo/dev-b2g
