I think the prototypes were from fireworks. Off hand I don't remember exactly what I was citing, I was new and I didn't go into battle mode when it didn't make sense. It was totally apparent though. people were smiling, verbally saying why they liked such and such as opposed to looking befuddled and grunting.
I do remember the facilitators remark right after 'They like the first one, they always like the first one'. I think he said it right after the second victim. Which made me think. How accurate is this. They are kind of warmed up on what they are doing by time they use the second one and of course it is going to be easier. We were swapping which prototype was presented first and that might have helped; but, it was for a different age each time. My notes were accurate and referenced the footage that was timecode marked. The info was the most valuable data I've ever heard. It really does or should veto the opinions just like the persona should. In theory I love the idea of not making your personal preference the standard; but, in practice I find the facts get lost in translation. Was J saying he would of fired me! Ha! Probably the right choice. What is the proper way to study multiple alternatives? On Tue, Jan 13, 2009 at 1:54 PM, Katie Albers <[email protected]>wrote: > No kidding...I'm with Jared on this one. > > What evidence are they citing? For that matter, what evidence are *you* > citing? What on earth format were you using to evaluate these prototypes? > > This has all the earmarks of something that was a total cockup from the > planning stages. > > kt > > Katie Albers > Founder & Principal Consultant > FirstThought > User Experience Strategy & Project Management > 310 356 7550 > [email protected] > > > > > > > On Jan 13, 2009, at 1:18 PM, Jared Spool wrote: > > >> On Jan 13, 2009, at 3:40 PM, Angel Marquez wrote: >> >> What would you do in this situation: >>> >>> You work for a company and you are doing usability testing. You are >>> providing your research subjects with prototypes from 2 outside vendors. The >>> research subjects clearly prefer using prototype B. After you make your >>> observations from behind the curtain and you reconvene with the facilitator >>> you find your findings are different. For some reason they observed them >>> preferring prototype B. Than what? Robot observers? >>> >>> >> I'd fire your user research team and replace them with folks who know how >> to conduct a study to evaluate multiple alternatives properly. >> >> Seriously. >> >> Jared >> ________________________________________________________________ >> Welcome to the Interaction Design Association (IxDA)! >> To post to this list ....... [email protected] >> Unsubscribe ................ http://www.ixda.org/unsubscribe >> List Guidelines ............ http://www.ixda.org/guidelines >> List Help .................. http://www.ixda.org/help >> > ________________________________________________________________ Welcome to the Interaction Design Association (IxDA)! To post to this list ....... [email protected] Unsubscribe ................ http://www.ixda.org/unsubscribe List Guidelines ............ http://www.ixda.org/guidelines List Help .................. http://www.ixda.org/help
