Iterative design and evaluation of an e-learning tutorial: a research-based approach

Abstract

This paper introduces the computer-aided instruction (CAI) tutorial Karnaugh, outlining its design, development and evaluation. Karnaugh is used for supplementary learning in the module Computer Systems: Fundamental Concepts. E-learning applications require rigorous evaluation of their functionality, learning content and usability. In the case of Karnaugh, this was done in a participative action research approach over two years. Evaluation and reflection occurred in iterative cycles, followed by active responses in the form of revised designs, with the researcher-designer playing a participative role as Karnaugh evolved through five variants. Complementary usability evaluation methods were used, namely heuristic evaluation, end-user questionnaires and interviews. The evaluation criteria were based on an adaptation of Squires & Preeces’ ‘learning with software’ heuristics. The unexpected discovery of some flawed data provided lessons in questionnaire administration.