On 28-Mar-2000, S. Alexander Jacobson <[EMAIL PROTECTED]> wrote:
> The issue is not just generating the data for a particular running
> instance, but rather:
> 1. generating the data from all/many running instances on user machines
> 2. sending that data back to the developer for analysis
> 3. generating useful reports on aggregate data 
> 
> Jacob Nielsen says that data from 5 users is enough to address most user 
> porblems so the above may be overkill, but I think it depends on the
> problem you want to solve (performance optimization being somewhat more
> complex).
> 
> In any case, the point is to collect data on behavior of the code under
> real life operating conditions rather than the test conditions of the lab.

The difficulty with this is that there is a significant cost associated
with collecting such data, and under real life operating conditions
the real life users generally don't want to pay that cost.

-- 
Fergus Henderson <[EMAIL PROTECTED]>  |  "I have always known that the pursuit
WWW: <http://www.cs.mu.oz.au/~fjh>  |  of excellence is a lethal habit"
PGP: finger [EMAIL PROTECTED]        |     -- the last words of T. S. Garp.

Reply via email to