Currently we run a very outdated version of V8 (version 7) in Talos. This has since been replaced with Octane in the world of benchmarks.
AWFY (arewefastyet.com), has been running Octane and catching regressions faster than Talos. There is missing coverage in AWFY, specifically e10s, pgo, aurora/beta. There are plans to add coverage for this in Q1. A main reason for pushing to turn off V8, is that the benchmark is outdated and regressions could not be the most useful use of developers time if there is a regression only seen on V8 instead of Octane. While this does point out that we are leaning towards building performance for a specific benchmark and ignoring other tests, we could argue that is what we should be doing. The reason I am posting here is to find out if there are reasons we should keep v8 running in Talos. We still plan to turn it off once AWFY coverage matches the coverage of Talos V8. You can reference bug 1174671 for some history. _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
