Re: [IxDA Discuss] statistical significance

2008-07-15 Thread Elizabeth
Many thanks to everyone, that's all really useful advice. - I suspected it was a bit of a how long is a piece of string? question(!), but at least now I know I'm heading in the right direction. :) I'll let you know how it goes! Regards . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Re: [IxDA Discuss] statistical significance

2008-07-15 Thread Jakob
Steve said: If you know that you have a user segment that is relatively scarce, but important for you to capture - like your executive team, for example - you should be certain to include a representative of this group in your studies. Essentially you're adopting a stratified sampling technique

Re: [IxDA Discuss] statistical significance

2008-07-15 Thread Sachin Ghodke
Hello Elizabeth, I probably may not be a complete expert on things but this is how i would approach your problem. I would map every minute detail of the process involved. Once having done that, i would then want to understand the internal social fabric that would affect daily work and find places

Re: [IxDA Discuss] statistical significance

2008-07-15 Thread Marielle Winarto
A statistical approach: you are comparing two conditions (old system vs. new system) and have an idea about the direction of the effect (the new system is more efficient, resulting in faster times). Can you make an estimate of the expected difference between the two conditions? What is the

[IxDA Discuss] statistical significance

2008-07-14 Thread Elizabeth Parham
- apologies for posting this in the wrong place the other day, was trying to do things in a hurry :-( Hello, I have to do a proposal including timings for a solution in which there will be 300 end users of a new system aimed at improving efficiency in the work place by using technology where

Re: [IxDA Discuss] statistical significance

2008-07-14 Thread Jared Spool
On Jul 14, 2008, at 2:58 AM, Elizabeth Parham wrote: I have to do a proposal including timings for a solution in which there will be 300 end users of a new system aimed at improving efficiency in the work place by using technology where before things were done on paper or over the phone.

Re: [IxDA Discuss] statistical significance

2008-07-14 Thread Anders Ljung
Jakob Nielsen has some guidelines regarding number of users for usability test, and I guess they apply to field studies as well. http://www.useit.com/alertbox/2319.html http://www.useit.com/alertbox/quantitative_testing.html Personally, I think the statistical significance is rather

Re: [IxDA Discuss] statistical significance

2008-07-14 Thread Steve Baty
Jared is correct in saying that you don't have all of the information necessary to calculate how many people you should interview, but I would put forward one caution about the approach proposed by Jared: If you know that you have a user segment that is relatively scarce, but important for you to