Learning to mark: a qualitative study of the experiences and concerns of medical markers

BMC Med Educ. 2006 Apr 25:6:25. doi: 10.1186/1472-6920-6-25.

Abstract

Background: Although there is published research on the methods markers use in marking various types of assessment, there is relatively little information on the processes markers use in approaching a marking exercise. This qualitative paper describes the preparation and experiences of general practice (GP) teachers who undertake marking a written assessment in an undergraduate medical course.

Methods: Semi-structured interviews were conducted with seven of the 16 GP tutors on an undergraduate course. The purposive sample comprised two new markers, two who had marked for a couple of years and three experienced markers. Each respondent was interviewed twice, once following a formative assessment of a written case study, and again after a summative assessment. All interviews were audio-taped and analysed for emerging themes. A respondent validation exercise was conducted with all 16 GP tutors.

Results: Markers had internal concerns about their ability to mark fairly and made considerable efforts to calibrate their marking. They needed guidance and coaching when marking for the first time and adopted a variety of marking styles, reaching a decision through a number of routes. Dealing with pass/fail borderline scripts and the consequences of the mark on the student were particular concerns. Even experienced markers felt the need to calibrate their marks both internally and externally

Conclusion: Previous experience of marking appears to improve markers' confidence and is a factor in determining the role which markers adopt. Confidence can be improved by giving clear instructions, along with examples of marking. The authors propose that one method of providing this support and coaching could be by a process of peer review of a selection of papers prior to the main marking. New markers in particular would benefit from further guidance, however they are influenced by others early on in their marking career and course organisers should be mindful of this when arranging double marking.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Decision Making / ethics
  • Education, Medical, Undergraduate / standards*
  • Educational Measurement / methods*
  • Faculty, Medical / standards*
  • Family Practice / education*
  • Feedback*
  • Humans
  • Interviews as Topic
  • Judgment / ethics
  • Qualitative Research
  • Wales
  • Writing / standards*