>I ran crashtest/reftest/marionette/xpcshell/mochitest on emulator-x86-kk, >have filed related bugs and make them block bug 753928. Basically: > >1) need to carry "--emulator x86" automatically (bug 996443) >2) to add x86 emulator for xpcshell tests (bug 996473) >3) PROCESS-CRASH at the end of reftest/crashtest (bug 996449) > >With some temporary solutions to above, all the test variants run on >emulator-x86-kk and are about six times faster than ARM emulators.
6x is good, if everything works and the tools are all in place - though it means you're not running the "real" code used on devices, which could be a problem. >於 4/9/14, 2:55 AM, Jonathan Griffin 提到: >> >> On 4/8/2014 1:05 AM, Thomas Zimmermann wrote: >>> There are tests that instruct the emulator to trigger certain HW events. >>> We can't run them on actual phones. >>> >>> To me, the idea of switching to a x86-based emulator seems to be the >>> most promising solution. What would be necessary? I don't think the *fundamental* problem is that the emulator is slow; I think it's that the emulator doesn't simulate the environment very well, and because of that, being slow (and running slow debug code) makes things break. Before worrying about x86 emulator (or going *too* far down the "run it on faster hardware" road), we should verify that faster hardware will produce less spurious oranges. Manually standing up a few testers and letting them run the mochitest load (even by hand) until we have enough data to see what moving the tests will do. I do think with the current emulator running it on faster hardware *will* help wallpaper the fundamental problems. I base this on my experience with the M10 media tests that began this thread - they ran fine on a 2.5 year old xeon (~10s, no timeouts) and took hundreds of seconds (and timed out) on the AWS testers. So moving the media tests will likely be a large win. But this (or x86) doesn't address the fundamental problem, which is that the emulator clearly isn't emulating the underlying envirment well, in particular timers (see some of the discussion in this thread). If we can address the fundamental problem (even crudely), the need for high-perf testers may decline or even go away. -- Randell Jesup, Mozilla Corp remove "news" for personal email _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
