We can filter uploaded histograms based on the version of Google Chrome in use, and so we should be able to distinguish TOT from dev channel histograms. This might tend to allow us to see through dev machine biases, and get some data to guide us further.... After we get *some* info, we can change the internal probability in the experiment (one parameter in the landed code selects the probability of MEDIUM vs HIGH memory model). The current parameter in the field trial is 50-50 split among startups that are "part of the experiment." Adjusting that parameter we could effectively change the default by going to 100-0 split, or a 0-100 split. With that thought in mind, a split closer to 99 vs 1 would probably be more than enough to get statistically significant data from our entire (opted-in) user population, even though most all of the users would be "effectively" getting the "good default" most of the time.
That long winded explanation may translate to a "you're probably right," that we'll need to run this experiment across the largest available user base. The good news is that we can craft the parameter to have minimal impact, but statistically significant data gathering. Jim On Sun, Oct 19, 2008 at 9:42 PM, Peter Kasting <[EMAIL PROTECTED]>wrote: > On Sun, Oct 19, 2008 at 9:16 PM, Jim Roskind <[EMAIL PROTECTED]> wrote: > >> Note this code is not yet pushed to either Google Chrome's dev channel, >> nor beta channel. I've only landed this on the Chromium tip-of-tree thus >> far. It is possible that we'll get enough good data that we won't even >> need to run the trial on the beta channel. >> > Users of trunk builds, and even dev builds, are probably a nonrandom sample > that will bias the experiment results. > > PK > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Chromium-dev" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/chromium-dev?hl=en -~----------~----~----~----~------~----~------~--~---
