Questionmark Perception QMP®: A complete paperless e-learning assessment tool

Patel, Ayyub and Afaq, Sarah and Amanullah, Mohammed and Bin-Jaliah, Ismaeel and Mosleh, Abdullah (2015) Questionmark Perception QMP®: A complete paperless e-learning assessment tool. In: The Eleventh Annual Medical Research Day at King Khalid University, August 2015, King Khalid University, Abha, Kingdom of Saudi Arabia.


Download (372kB) | Preview

Abstract|ملخص البحث

Introduction : Many universities in the Kingdom of Saudi Arabia are supporting course delivery and course assessment by learning management systems (LMS) such as Blackboard. Questionmark Perception (QMP) is a powerful collaborative add-on that provides an offline/online independent assessment tool for tests, surveys and exams. This powerful tool allows authoring, management, scheduled delivery, reporting, and analysis of tests and examinations. Aim: To test and tryout the QMP tool with level three medical biochemistry students in the College of Medicine, King Khalid University during semesters 1 and 2 (2013/2014). In particular the tool will be tested to provide analysis on the final theory exam and the items used in assessment according to medical education guidelines. Methods: QMP was used to prepare the question papers for two exams conducted for level three medical biochemistry students in the medical college during semesters 1 and 2I (2013/2014) wherein 291 students (193 boys and 98 girls) took the exam. Questionmark® Perception® provides a collaborative authoring environment for learning professionals, educators, test publishers and subject matter experts (SMEs) to create surveys, quizzes, tests and exams. QMP authoring manager was used to collect the required questions for the exam. The offline version of software was used in order to make sure questions remain on a private personal computer until such a time when they are needed for the exam online. It also allows the staff exam committee of the department to discuss each question in detail and amend an edit questions as deemed appropriate. The type of questions for the final exams was multiple choices with one best answer. Selected questions were then used to create the assessment and randomized both in terms of the stem and the choices at the time of delivery. The exams were conducted in two different campuses, simultaneously and were totally online. QMP reporter was used to provide statistical analysis of the questions and student performance. Results: The exam went smoothly without any problem. All the students completed the online exam well in time. No offline, on-paper examinations were required. The online electronic exams represented 35% of the total grade. The overall results (continuous assessments and final practical and theory exams) for semester I and II were as follows: Grade A, 24 (8.2%), Grade B (21.0%), Grade C, 100 (34.4%), Grade D, 84 (28.9%), Grade F, 22 (7.6%). QMP questions statistics and item analysis for the two online exams were very similar with most of the questions being moderately difficult and Cronbach’s Alpha reliability index of 0.88. Conclusion: Questionmark perception (QMP) is a very helpful tool in conducting exam at university level, either online or offline. It also provides excellent analysis of the questions, students’ performance and reliability of the assessments. Although our data does not fall within the preview of the recommended discrimination index still we feel that these exams being an assessment of the level of understanding by undergraduate students and not a competitive exam, QMP is a valid and advantageous tool for assessment in medical schools.

Item Type|تصنيف النتاج العلمي: Conference or Workshop Item | مؤتمرات وورش عمل (Lecture)
Subjects | مجال موضوع النشر: Curriculum and Methodologies
Medicine and Surgery
Divisions | الكلية: College of Medicine > Physiology
Depositing User: Prof. Ismaeel Bin-Jaliah
Date Deposited: 19 Nov 2018 08:24
Last Modified: 19 Nov 2018 08:24

Actions (login required)

View Item | استعراض View Item | استعراض