On Tue, Oct 6, 2015 at 9:58 AM, Etienne Segonzac <[email protected]> wrote:
> So we're fine with the system that didn't work for 2.5 and we're making no
> promise for the future.
> Nice commitment to performance.

While the wording here is a bit harsh, I agree with the sentiment.

We've talked a lot about focusing in quality, which to me includes not
regressing performance. However on an organizational level we still
haven't done much investment into our testing infrastructure. Some
engineers and QA people certainly has done a lot of great work, but
overall our investments are much too low here.

If we are really serious about actually improving quality, I think the
first thing we should do is to invest into our continuous-integration
testing infrastructure.

That means getting tools like raptor not just "up and running", but
actually enabled on the mozilla-central main reporting pages.

This is a lot of work. It's not just a matter getting tests runners
working. But also on getting numbers to be stable enough, tests to not
intermittently fail too often, etc.

But if we don't make this investment at an organizational level, I
don't think that we can argue that we are focusing on quality, nor do
I see a reason to believe that quality will increase.

/ Jonas
_______________________________________________
dev-fxos mailing list
[email protected]
https://lists.mozilla.org/listinfo/dev-fxos

Reply via email to