@todd How do you work around that w/Webnographer? >
Try it and find out :) Webnographer? With the absence of a moderator, you lose the richness of the > conversation and ability to probe. Yes, you lose some ability to probe, but you gain by having a higher number of participants. We advice our clients to always have open ended questions after each task. You would be surprised by the richness of feedback. If an error has occurred you will normally get multiple feedback for the same error, and therefore you end up with rich feedback, coming from multiple participants. We also use other techniques for spotting user errors, as we have found both in the lab and remotely people don't always verbalise an issue. When we tested in the Lab vs Webnographer, with 8 participants in the lab and 60 in the wild both studies came back with the same number of issues. And the formative answers from Webnographer where as rich, as from the lab. > I'm just wondering about the limitations. Biggest challenge is people doing the test just for the reward, but these participants can normally be found as they only visit one page, and they use saticficing behaviour on answering questions, which is easily discoverable. The advantage of a tool like Webnographer is that you can easily prioritise issues, and get the results back faster than lab methods. any good researcher knows how limiting surveys are. It depends on the design. You can have badly done qualitative studies, as well as poorly designed quantitative studies. At the moment the tool anonymizers the data, so that may be a hindrance, but there is nothing stopping you from interviewing participants after they have taken the test. James http://blog.feralabs.com 2009/3/12 Todd Zaki Warfel <[email protected]> > > On Mar 12, 2009, at 10:21 AM, James Page wrote: > > Mac users are different, why - I don't know. > > > We've found the same over the years and contributed it to the different > environment of the MacOS to Windows OS. > > And we get allot of behavioural differences by culture - (place of birth > vs residence). > > > Absolutely. Culture has a significant impact on behavior. > > Out of curiosity, how does your Asynchronous model work w/Webnographer? > With the absence of a moderator, you lose the richness of the conversation > and ability to probe. Instead, you're left with a participant filling out a > survey. And any good researcher knows how limiting surveys are. > > How do you work around that w/Webnographer? Great concept, I'm just > wondering about the limitations. > > > Cheers! > > Todd Zaki Warfel > Principal Design Researcher > Messagefirst | Designing Information. Beautifully. > ---------------------------------- > *Contact Info* > Voice: (215) 825-7423Email: [email protected] > AIM: [email protected] > Blog: http://toddwarfel.com <http://toddwarfel/> > Twitter: zakiwarfel > ---------------------------------- > In theory, theory and practice are the same. > In practice, they are not. > > > > > ________________________________________________________________ Welcome to the Interaction Design Association (IxDA)! To post to this list ....... [email protected] Unsubscribe ................ http://www.ixda.org/unsubscribe List Guidelines ............ http://www.ixda.org/guidelines List Help .................. http://www.ixda.org/help
