eModeration: Towards a User Experience Evaluation Framework

Abstract

eModeration (or online moderation) can improve the user experience of the examination process while lowering the risk of losing scripts or delaying the moderation process. Despite these benefits to optimising examination procedures, the application of online moderation is limited. There could be various reasons for the lack of adopting eModeration including the technical, organisational and human factors. The focus of this study is on the human factors involved in eModeration and the research is guided by the following question: What are the most important user experience constructs for valuating an electronic moderation (eModeration) system within the context of Higher Education Institutions in South Africa? This research uses a design science methodology, which comprises the development and testing of a user experience framework. In this paper, we will only report on the identification of the constructs for the user experience framework. The data generation methods will include interviews with deans from the different faculties and a survey with moderators and deans. The research was conducted at Midrand Graduate Institute, a Private Higher Education institution in South Africa. The contribution of the paper is to identify the most important user experience constructs for evaluating an eModeration system and also to provide some insights on the user experience of the two different user groups. The enriched understanding of eModerators’ and deans’ user experience of eModeration contributes to the understanding of the human factors that influence the adoption of innovative assessment practices.