Cognitive Walkthrough: Usability Evaluation Materials
Sign up for access to the world's latest research
Abstract
A Cognitive Walkthrough is a method for predicting usability problems with an interactive system. Usability problems are aspects of the system which could reduce the usability of the system for the user, for example to confuse them, to slow them down to stop them completing their task. In particular, Cognitive Walkthough focuses on problems related to the learnability of a system. The following materials are provided: • A description of Cognitive Walkthrough; • A self assessed test to allow analysts to assess their understanding of Cognitive Walkthrough; • A checklist of Cognitive Walkthrough for use in the analysis; • Problem record sheets to record usability problems during analysis. Currently, these only record the usability problem predicted. In future, these could be modified to include recommended solutions to these problems (Jeffries, 1994); • A questionnaire to fill in after the analysis
Related papers
2007
The paper proposes an approach to comparative usability evaluation that incorporates important relevant criteria identified in previous work. It applies the proposed approach to a case study of a comparative evaluation of an academic website employing four widely-used usability evaluation methods (UEMs): heuristic evaluation, cognitive walkthroughs, think-aloud protocol and co-discovery learning.
2007
The paper proposes an approach to comparative usability evaluation that incorporates important relevant criteria identified in previous work. It applies the proposed approach to a case study of a comparative evaluation of an academic website employing four widely-used usability evaluation methods (UEMs): heuristic evaluation, cognitive walkthroughs, think-aloud protocol and co-discovery learning.
Human computer interaction research …, 2007
International journal of man-machine studies, 1992
This paper presents a new methodology for performing theory-based evaluations of user interface designs early in the design cycle. The methodology is an adaptation of the design walkthrough techniques that have been used for many years in the software engineering community. Traditional walkthroughs involve hand simulation of sections of code to ensure that they implement specified functionality. The method we present involves hand simulation of the cognitive activities of a user, to ensure that the user can easily learn to perform tasks that the system is intended to support. The cognitive walkthrough methodology, described in detail, is based on a theory of learning by exploration presented in this paper. There is a summary of preliminary results of effectiveness and comparisons with other design methods. 2.2. OUTLINE OF THE MODEL We have developed our model within the framework of Kintsch's constructionintegration model (Kintsch, 1988; Mannes & Kintsch, 1991; Doane, Kintsch 8r Polson, 1990). The construction-integration model (Kintsch, 1988) describes the processes by which users integrate a representation of text or other perceptual input with background knowledge to construct a representation that will enable them to perform a task. In outline, the model works as follows. An initial goal structure is constructed from a description of the user's task. Goal structures in the model are similar to the goal hierarchies postulated by the GOMS model (Card, Moran & Newell, 1983; Bovair, Kieras & Polson, 1990), with a top goal representing the overall task, intermediate level goals defining a task decomposition and lowest level goals describing individual actions (if these become known).
2001
is an environment where researchers are able to study and assess the usability of products while being used by their intended users. It allows for flexible configuration, and in particular can accommodate studies involving groups of collaborating users. This paper describes the Usability Laboratory with a particular emphasis on its background-why the Laboratory was established-and the facilities and services that it provides.
Proceedings of 17th …, 1999
USINACTS is an ACTS (Advanced Communications Technologies and Services, an EC-supported research program) project, within the horizontal domain (ie a support project), and whose main objective is to improve the usability approach of ACTS usage trials, and to promote the best practice in usability. Within this general objective, there is a more particular objective which is to identify, characterise, document and disseminate examples of successful application of usability principles from ACTS usage trials.
World Journal of Innovative Research
Most system interfaces do not meet user intuition in terms of both context and the underlying actions thereof, hence reducing user's task execution efficiency. This translate into the amount of time taken to learn, recall and complete the procedure for certain task with respect to a given system or device. It was in the light of this that this work took a look at the existing human computer interaction (HCI) usability testing techniques with the intention of empirically establishing which among cognitive walkthrough, heuristic evaluation and user group is the most efficient in identifying and correcting system's usability problems. To create the research pathway a detail review of related work was undertaken to identify the lacuna therein for the research direction. A case study of the Nigerian Defence Academy (NDA) website was used as a specimen for administering the usability test methods and the outcome of each was documented. The research methodology adopted a purposive and stratified sampling technique to reduced biased and increased reliability of the representative sample chosen for this research. The sample chosen was an extract of final year undergraduate students of Federal College of Education (FCE) Pankshin, an affiliate of University of Jos, Plateau State, Nigeria. The students have taken a course in Human Factor in System Design, which provided them with adequate training in usability test techniques, 20 out of the total 30 students with the requisite skill were chosen to undertake the test process. The data collated passed through paired sample T-test procedure of the compare-mean analysis with confidence interval percentage of 95%, using the IBM Statistical Package for the Social Sciences (SPSS) version 26. The outcome of the T-test showed that the respective means of cognitive-walkthrough, heuristic-evaluation and user-group are 5.750, 4.900 and 6.350, with respective correlation coefficients of 0.192, 0.54 and 0.624. This shows a strong relationship between each pair of the test techniques. However, user-group usability test technique with the highest mean accuracy interval of 1.450 is the best in terms of performance relative to the other two techniques. Finally, the result of the analysis as well as charts created and the participant's findings were summarized thus proffering way forward and recommendations for the improvement of system and user interaction.
A well given design's attention to Learnability, Contextuality and Operationability as Usability characteristics issues of software, and information systems generally is an evolving and challenging area in the field of Information systems, and Human Computer Interaction as an area of expertise. The procedure of testing and evaluating usability as quality characteristics in information systems has equally attracted researchers and professionals more in the recent times due to the developers' attempt to meet the diverse users' needs in the development of usable information systems. Hence, the paper aims to bring to the limelight; these current issues of usability and usability testing, the trend of the challenges inherent in the usability testing and evaluation process, then suggest the necessary attention that must be provided by subsequent researches in the bid to solve these lingering design research problems.
2017
This paper presents a usage analysis and taxonomy of methods which are used to evaluate the usability of computer systems. To accommodate the analysis and taxonomy, a matrix of strategies which can be used for effective usability evaluation is presented. Such an analysis, taxonomy and strategies support human-computer interaction (HCI) professionals who have the responsibility for ensuring computer system usability. The strategies outlined are named Virtual Engineering, Soft Modelling, Hard Review and Real World. This paper also uses a composite set of existing popular generic evaluation methods which can be used as part of these strategies. The methods used are observation, questionnaire, interview, empirical methods, user groups, cognitive walkthroughs, heuristic methods, review methods and model methods. The paper continues by presenting a Usage Analysis Table of these methods and concludes by grouping them into a Taxonomy of Usability Evaluation Methods. A key emphasis of this p...

Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.