Just randomise the order of each scenarios. It also can be quite interesting to ask people there expectation of how hard they think the task will be before each task, and then ask them how hard it was. See: the book Measuring the user experience.. Also see http://measuringux.com/Tips&Tricks-Boston-UPA-2008.pdf <http://measuringux.com/Tips&Tricks-Boston-UPA-2008.pdf> page 26.
All the best James http://blog.feralabs.com 2009/5/14 Nathaniel Flick <[email protected]> > I'll just quote Bill Buxton here from "Sketching User Experiences": > > "Those who saw multiple designs gave us more critical comments. A > few even rejected one of the designs (something extremely rare in > studies that only evaluate one design, and therefore very > significant). But constructive suggestions? There was no difference > between users who saw one design and those who saw three." > > Further, Bill makes the point that testing one design tends to shut > down criticism; the users tested don't want to appear to be too > negative. > > Hopefully you can see that you'll get neither "Best Results" or > "Accurate Findings". What you will get are non-designer's opinions > about the interactions you've designed. It's up to you to take that > data and fashion an interface that best connects the user to your > registration process through to completion. > > > > > . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . > Posted from the new ixda.org > http://www.ixda.org/discuss?post=41992 > > > ________________________________________________________________ > Welcome to the Interaction Design Association (IxDA)! > To post to this list ....... [email protected] > Unsubscribe ................ http://www.ixda.org/unsubscribe > List Guidelines ............ http://www.ixda.org/guidelines > List Help .................. http://www.ixda.org/help > ________________________________________________________________ Welcome to the Interaction Design Association (IxDA)! To post to this list ....... [email protected] Unsubscribe ................ http://www.ixda.org/unsubscribe List Guidelines ............ http://www.ixda.org/guidelines List Help .................. http://www.ixda.org/help
