On Tue, Aug 8, 2017 at 5:18 PM, Ben Kelly <bke...@mozilla.com> wrote:
> On Tue, Aug 8, 2017 at 5:12 PM, <jma...@mozilla.com> wrote:
>> In bug 1386689, we have turned them off. There was some surprise in
>> doing this and some valid concerns expressed in comments in the bug. Given
>> that, I thought we should bring this information to a wider audience on
>> dev.platform so more developers are aware of the change.
>> While we get some advantages to not running duplicated tests (faster try
>> results, less backlogs, fewer intermittent failures) there might be
>> compelling reasons to run some tests in e10s based on specific coverage.
>> With that said, I would like to say that any tests we turn on as non-e10s
>> must have a clearly marked end date- as in this is only a temporary measure
>> while we schedule work in to gain this coverage fully with e10s tests.
> If we have an android test disabled (a lot I think), then we should
> consider continuing to run the test in non-e10s on desktop linux. Having
> more real devices to run android tests on would probably reduce the number
> of tests that are disabled. The emulator is extremely slow and not
> representative of real hardware.
BTW, we have a large corpus of tests that don't run on android at all:
WPT. Increasingly over time features are only covered by WPT tests.
I think we should keep at least non-e10s running on linux or linux64 for
now until we can improve our android test coverage or move android to e10s.
dev-platform mailing list