A retrospective comparative study of multiple choice questions versus short answer questions as assessment tool in evaluating the performance of the students in medical pharmacology

Yogeeta Sushant C. Walke, Amey S. Kamat, Sushama A. Bhounsule

Abstract


Background: The aim was to assess the effectiveness of multiple choice versus short answer questions (SAQs) as assessment tools for evaluating performance of 2nd MBBS students.

Methods: The study was observational, retrospective study of written pen and paper type assessment that utilized a sample of 100 2nd year medical students. Study consisted of two parts; part I was multiple-choice questions (MCQs) based on endocrine system where four options were given for a question and the single best answer was to be ticked. MCQ was timed at 20 mins for 30 questions with 1 mark each. There was no negative marking. Part II was SAQ on same system where 16 SAQ were given. SAQ was timed at 60 mins for 30 marks questions. After the test students had to reply on a feedback form.

Result: There was a strong correlation between the marks scored in two formats of test and there was no statistical difference between the two set of marks.

Conclusion: SAQs are as effective as MCQs in assessing the performance of the students in medical pharmacology.


Keywords


Short answer, Multiple choice, Assessment, Tool, Effective

Full Text:

PDF

References


Pepple DJ, Young LE, Carroll RG. A comparison of student performance in multiple-choice and long essay questions in the MBBS stage I physiology examination at the University of the West Indies (Mona Campus). Adv Physiol Educ. 2010;34(2):86-9.

Debasis B. A study on the evaluation of perception and attitutd of 2nd M.B.B.S. medical students regarding multiple choice questions - MCQS as a performance assessment tool in pharmacology at Burdwan Medical College, West Bengal, India. Rev Prog. 2013;1(13):1-5.

Davis CW, Donald O. Allen assessment in medical pharmacology: designing MCQs to assess a student’s type-1 problem-solving skills. Pharmacologist. 1999;41(3):107-11.

Des Marchais JE, Vu NV. Developing and evaluating the student assessment system in the preclinical problem-based curriculum at Sherbrooke. Acad Med. 1996;71(3):274-83.

Walubo A, Burch V, Parmar P, Raidoo D, Cassimjee M, Onia R, et al. A model for selecting assessment methods for evaluating medical students in African medical schools. Acad Med. 2003;78(9):899-906.

Bennett RE, Rock DA, Wang M. Equivalence of free response and multiple choice items. J Educ Meas. 1991;28(1):77-92.

Freestone N. Drafting and acting on feedback supports student learning when writing essay assignments. Adv Physiol Educ. 2009;33(2):98-102.

Nnodim JO. Multiple choice testing in anatomy. J Med Educ. 1992;26:301-9.

Day SC, Norcini JJ, Diserens D, Cebul RD, Schwartz JS, Beck LH, et al. The validity of an essay test of clinical judgment. Acad Med. 1990;65 9 Suppl: S39-40.

Jain S, Alkhawajah A, Larbi E, Al-Ghamdi M, Al-Mustafa Z. Evaluation of student performance in written examination in medical pharmacology. Sci J King Faisal Univ (Basic Appl Sci). 2005;6(1):1426-35.

Mujeeb AM, Pardeshi ML, Ghongane BB. Comparative assessment of multiple choice questions versus short essay questions in pharmacology examinations. Indian J Med Sci. 2010;64(3):118-24.

Anderson J. Multiple choice questions revisited. Med Teach. 2004;26(2):110-3.

Oyebola DD, Adewoye OE, Iyaniwura JO, Alada AR, Fasanmade AA, Raji Y. A comparative study of students’ performance in preclinical physiology assessed by multiple choice and short essay questions. Afr J Med Med Sci. 2000;29(3-4):201-5.

Moqattash S, Harris PF, Gumaa KA, Abu-Hijleh MF. Assessment of basic medical sciences in an integrated systems-based curriculum. Clin Anat. 1995;8(2):139-47.

Anbar M. Comparing assessments of students’ knowledge by computerized open-ended and multiple-choice tests. Acad Med. 1991;66(7):420-2.