Exploring the practice of quality control in the onscreen marking of ordinary level Biology in Zimbabwe

Abstract

The purpose of this study was to explore the practice of quality control in the onscreen marking (OSM) environment of Biology (5008) examinations between 2013 and 2017. Examination marking is gradually being migrating from paper-based marking (PBM) to OSM in a bid to improve the efficiency and quality of marking. The Zimbabwe School Examinations Council (ZIMSEC) introduced OSM for some O Level subjects in June 2012, in a context characterised by a persistent economic crisis, patchy internet coverage, erratic power supplies and low digital literacy, among other challenges. The Council encountered some difficulties related to quality control, which triggered this qualitative instrumental single case study that was informed by the ontology, epistemology, methods and axiology of the constructivist philosophy. Data were collected through face-to-face and focus group interviews on the WhatsApp platform with 4 subject managers, 11 senior markers and 18 normal markers, and through document review. The findings of the study suggest that the quality of marking was influenced by the context in which the examinations were marked. The socio-political climate that prevailed in Zimbabwe impacted on the technological infrastructure for the OSM and the digital literacy of the examination personnel. The capacity of the examiners to work in the OSM environment was influenced by knowledge and skills transfer from training and standardisation to the live marking. The quality of marking was monitored by the seeds approach to script moderation, automatically generated reports and audit trails, and escalation of problem scripts. It was also influenced by the structure of the question papers, cognitive demands of the questions and mark schemes on the examiners, spaces provided for candidates’ responses and mark scheme features such as language and marks to marking points ratio. The assessment framework provided by the syllabus guided the design and marking of Biology examinations. From these findings, a framework that could guide the practice of quality control in the OSM environment was formulated. OSM technology could enhance the quality of marking Biology examinations, thereby eliminating challenges associated with PBM. Some of the opportunities were, however, reduced by the challenges encountered during the OSM of the examinations. It is recommended that ZIMSEC put in place policies and procedures that could guide specific quality control activities in the OSM environment and establish computer centres in the provincial capital towns. The Council could also consider benchmarking examiner recruitment, training and standardisation procedures with international examination authorities.

Tsvakurudzo ino yanga yakananga kuvandudza nharaunda yemakwenyero ebvunzo kubudikidza nemichina pachidzidzo cheBhayaroji, 5008 pakati pemakore a2013-2017. Vandudzo iyi iri kuuya zvishoma nezvishoma kubva pakukwenya pamapepa zvichienda mukukwenya nemichina (on screen marking :OSM ) nechinangwa chekuda kukwenenzvera mhando yebasa rezvekukwenya . Bazi rebvunzo reZimbabwe School Examinations Council (ZIMSEC) rakavarura kukwenya kubudikidza nemichina (OSM) kubvunzo dzedanho reOdhinari revhuru muna Chikumi 2012 , mumamiriro anozivikanwa ematambudziko ezveupfumi, masaisai eindaneti asingavimbiki anouya zvigamba zvigamba , magetsi asingawanikwe nguva dzose, nezivo yezvemichina muvakwenyi isina kupararira pakati pezvimwe zvimhingamupini. Kanzuru yezvebvunzo yakasangana nemamwe matambudziko ane chokuita nounaku hwezvemakwenyerwe ebvunzo hwakakonzera kuti paitwe tsvakurudzo ino yezveudzamu (qualitative) muchinzvimbo chiduku chakasarudzwa (case study) yaitungamirirwa nemaziviro evacho vanoona nezvekukwenya bvunzo (interpretivist epistemology) nemaziviro okuti chokwadi chinosiyana nekusiyana kwenharaunda nokuti chigadzirwa chevarimukati mekukwenya (constructivist ontology), nekuumba mufungo kubudikidza neumboo huchabuda mutsvakurudzo (inductive theory) nenzira nezvinokosheswa nenharaunda mukuumba ruzivo (constructivist philosophy). Umboo hwetsvakurudzo hwakawanikwa kubudikidza nebvunzurudzo ine udzamu padungamunhu nemumapoka nekupindurana padare reWatsiApu nevanotungamira zvidzidzo (Subject managers ) vana , zvidza mune zvokukwenywa bvunzo gumi neumwe, nevamwewo vakwenyi gumi nevasere uye kuongorora magwaro. Mamiriro ezvemagariro nematongerwo enyika mu

Ihloso yaleli rhubhululo bekukuphenya indlela ikhwalithi elawulwa ngayo ngehlelo lokutshwaya ngekhomphyutha kwe enhlahlubo zeBhayiloji (5008) phakathi komnyaka ka-2013 no-2017. Ukutshwaywa kwe enhlahlubo kancanikancani kuyasuka ehlelweni lokutshwaya iphepha ngesandla (PBM) kuya ehlelweni lokutshwaya ngekhomphyutha (OSM) ngomzamo wokuthuthukisa umsebenzi omuhle kanye nokuletha iqophelo eliphezulu lokutshwaya. Hlangana nezinye iintjhijilo, UMkhandlu wezokuTshwaywa kwe eNhlahlubo eZimbabwe (Zimbabwe School Examinations Council) (ZIMSEC) sewungenise ihlelo le-OSM kwezinye iimfundo zesigaba sika-O Level ngenyangaka Mgwengweni 2012, ngaphasi kobujamo obumbibe zomnotho, kobujamo obumaratha be-inthanedi, obuqokeme kobokuphakelwa ngegezi kanye na ngaphasi kwezinga eliphasi lefundo ye dijithali. UMkhandlu uhlangabezene nobunye ubudisi obumalunga nanokulawulwa kwekhwalithi, okubujamo obukhwezelele isizathu sokobana kube nerhubhululo linye elisebenzako elisebenzisa indlela yerhubhululo yekulumo, kanti lokhu kwabangelwayi-ontholoji, i-ephistemoloji, iindlela zerthubhululo kanye ne-akziyoloji yefilosofi i-constructivist philosophy. Idatha ibuthelelwe ngendlela yehlolombono yokubuza umuntu ngamunye ubuso nobuso kanye nokubuza iinqhema zabantu ezinqotjhiwe kokukundla yezokucocisana, i-WhatsApp platform kanye nabaphathi beemfundo aba-4 subject managers, abatshwayi abakhulu abali-11, kanye nabatshwayi abajayelekileko abali-18, kanti lokhu kwenziwa ngokubuyekeza umtlolo. Ilwazi elifumane keerhubhululweni liphakamisa kobana izinga lekhwalithi lokutshwaya laba nomthintela wobujamo/wendawo lapho iinhlahlubo zatshwaywa khona. Ubujamo bezehlalakuhle yabantu kezepolotik iebebusezweni leZimbabwe laba nomthelela phezu komthanga lasisekelo wethekinoloji, kanti kwathinta abasebenzi behlelo le-OSM kanye nezinga lefundo yedijithali. Amandla wekghono labatshwayi lokusebenza ebhodulukweni le-OSM lalilawulwa kudluliselwa kwelwazi kanye namakghonofundwa ukusukela ekubandulweni kanye nokwenza izinto ngendlela efanako ehlelweni elibonakala ngamehlo lokutshwaya. Izinga lokutshwaya lalitjhejwe yindlela yokulinganiswa kwamaphepha atshwayiwako, ihlelo le-seeds approach to script moderation, kanti ihlelwe lingokwalo lihlanganisa imibiko begodu lilandelela ukuhlolwa, kanti goduli yakwazi nokuveza amaphepha ane miraro. Leli hlelo begodula lilawulwa sisakhiwo sephepha lemibuzo, lilwazi elifunekako ephepheni lemibuzo kanye namaskimu wamaksi phezu kwabatshwayi bamaphepha, iinkhala ezenzelwako bana abafundi baphendulele kizo kanye namaskimu wokutshwaya okunje ngelimi kanye namamaksi asesilinganiswe nisamamaksi, phecelezi-marking points ratio. Isakhiwo sokuhlola sinikelwa yisilabhasi, okungiyo eyikombandlela yedizayini kanye nokutshwaywa kwe enhlahlubo zeBhayiloji. Ngalelilwazi elitholakeleko, kukghonakele ukuthi kutlanywe isakhiwo ebesingabayi kombandlela yendlela engalandelwa ukulawula ikhwalithi ebhodulukweni ye-OSM. Ithekinoloji ye-OSM beyinga siza izinga lokumakha iinhlahlubo zeBhayiloji, ngalokho lokhu bekungaphungula iintjhijilo ezihlobene nehlelo le-PBM. Nanyana kunjalo, amanye amathuba, aphungulwazi intjhijilo ekuhlangabezenwe nazo nakutshwaywa iinhlahlubo zehlelo le-OSM. Kuye kwa tjhukunyiswa ukobana i-ZIMSEC izene mithethomgomo kanye ne enkambiso ezingabayikombandlela elayela imisebenzi ethile koyokulawulwa kwekhwalithi ebhodulukweni le-OSM kanye nokuhloma iinkhungo zekhomphyutha kumadorobhahloko we emfunda. UMkhandlu begodu ungatjheja yokubeka izinga lokuqatjhwa kwabatshwayi, lokubandulwa kanye nehlelolokwenza izinto ngendlela efanako neyamaziko we entjhabatjhaba alawula iinhlahlubo.