> He wanted to know if the evaluations could be more polished or detailed. So > my question is what heuristics do you usually test against? Do you lay those > out in your document and then answer them by group? It would be great if a > couple example docs could be posted if possible, even if the specific client > info was stripped out. > > I have seen Neilson's heuristic article and list of 10 heuristics, which I > have used in the past. Wondering if that is enough or if it is too general.
Hello Tom, Here are some notes on Heuristic evaluation that might be useful. Jeff White described the research-based heuristics that were endorsed by Bailey. Muller, Matheson, Page, and Gallup (1995, p. 14) extend the basic heuristic evaluation Method by adding a new category of heuristics called "Task and Work Support". Muller and his colleagues note how the earlier sets of heuristics were generally product-oriented and concerned with problems in isolation. The new task and work support heuristics focus on user goals (produce quality work, keep sensitive material private, enhance my skills) and a positive experience in the workplace. Here are the enhanced heuristics which are part of a participatory heuristic inspection that DOES involve users. "Skills -- The system supports, extends, supplements, or enhances the user's skills, background knowledge, and expertise. The system does not replace them. Wizards support, extend, or execute decisions made by users. Pleasurable and respectful interaction with the user -- The user's interactions with the system enhance the quality of her or his experience. The user is treated with respect. The design reflects the user's professional role, personal identity, or intention. The design is aesthetically pleasing — with an appropriate balance of artistic as well as functional value. Quality work -- The system supports the user in delivering quality work to her or his clients (if appropriate). Attributes of quality work include timeliness, accuracy, aesthetic appeal, and appropriate levels of completeness. Privacy -- The system helps the user to protect personal or private information—belonging to the user or to his or clients.." The basic heuristic evaluation can be enhanced in a number of ways including: • Use an object/task approach where you have evaluators do a task-based evaluation and then an object-based evaluation. • Considering basic human factors principles that are not included in the original sets of heuristics. • Adapting existing heuristics to your domain or create context-specific heuristics. • Using multiple evaluators who are trained on heuristics and the heuristic evaluation process. • Evaluating explicit features and apply specific usability criteria to each feature (Yahuda & McGinn, 2007) to determine problem severity. • Meeting as a group to discuss their individual lists and combine the problems into a single list with agreed on severity levels. • Developing one or more solutions for each problem or problem category. • Determine the effectiveness of heuristic evaluation by tracking what problems were fixed, what solutions were implemented (compared to those suggested in the report), how much effort was expended on the change, and if there are meta-problems that should be addressed. Sears (1997) developed a technique called a "heuristic walkthrough" that had some of the attributes of three UCD methods: a heuristic evaluation, a perspective-based inspection and a cognitive walkthrough. In Sears' method, the evaluators were given a prioritized list of user tasks, a set of heuristics, and "thought-provoking" questions derived from the cognitive walkthrough method (Cockton, Lavery, & Woolrych, 2002). Chauncey ________________________________________________________________ *Come to IxDA Interaction08 | Savannah* February 8-10, 2008 in Savannah, GA, USA Register today: http://interaction08.ixda.org/ ________________________________________________________________ Welcome to the Interaction Design Association (IxDA)! To post to this list ....... [EMAIL PROTECTED] Unsubscribe ................ http://www.ixda.org/unsubscribe List Guidelines ............ http://www.ixda.org/guidelines List Help .................. http://www.ixda.org/help
