On Wed, Mar 6, 2013 at 8:54 AM, Gavin Sharp <ga...@gavinsharp.com> wrote:

> This line of reasoning can be dangerous, given the presence of
> browser-specific code (e.g. if (firefox) { /* use Ci! */ }). But we're
> in "estimates of likelihood of bustage based on intuition" territory,
> which can make it difficult to have a productive debate. I imagine
> we'll get better data about the potential for bustage impact once this
> gets onto Aurora and/or Beta, but prior experience with this kind of
> thing has shown that those channels often aren't sufficient for
> detecting high-impact web compat changes, so we need to be careful...
>

Bustage detection rate isn't just a function of the user populations on
each channel; it's also a function of time. Six months of testing on beta
is better than six weeks. I don't know how much better but I'd like to!
Letting changes like this progress to beta and then stay there for several
releases might be a good idea, and if we get some experience with it we
might be able to estimate the value of different lengths of time.

Rob
-- 
Wrfhf pnyyrq gurz gbtrgure naq fnvq, “Lbh xabj gung gur ehyref bs gur
Tragvyrf ybeq vg bire gurz, naq gurve uvtu bssvpvnyf rkrepvfr nhgubevgl
bire gurz. Abg fb jvgu lbh. Vafgrnq, jubrire jnagf gb orpbzr terng nzbat
lbh zhfg or lbhe freinag, naq jubrire jnagf gb or svefg zhfg or lbhe fynir
— whfg nf gur Fba bs Zna qvq abg pbzr gb or freirq, ohg gb freir, naq gb
tvir uvf yvsr nf n enafbz sbe znal.” [Znggurj 20:25-28]
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform

Reply via email to