Use of a simulation-based mastery learning curriculum for neurology residents to improve the identification and management of status epilepticus

Yara Mikhaeil-Demo; Jeffrey H Barsuk; George W Culler; Danny Bega; David H Salzman; Elaine R Cohen; Jessica W Templer; Elizabeth E Gerard

doi:10.1016/j.yebeh.2020.107247

Use of a simulation-based mastery learning curriculum for neurology residents to improve the identification and management of status epilepticus

Epilepsy Behav. 2020 Oct:111:107247. doi: 10.1016/j.yebeh.2020.107247. Epub 2020 Jun 27.

Authors

Yara Mikhaeil-Demo¹, Jeffrey H Barsuk², George W Culler³, Danny Bega³, David H Salzman⁴, Elaine R Cohen⁵, Jessica W Templer³, Elizabeth E Gerard³

Affiliations

¹ Department of Neurology, University of Illinois, Chicago, IL; Department of Medical Education, Northwestern University, Feinberg School of Medicine, Chicago, IL.. Electronic address: y-mikhaeil@fsm.northwestern.edu.
² Department of Medical Education, Northwestern University, Feinberg School of Medicine, Chicago, IL.; Department of Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL.
³ Department of Neurology, Northwestern University, Feinberg School of Medicine, Chicago, IL.
⁴ Department of Medical Education, Northwestern University, Feinberg School of Medicine, Chicago, IL.; Department of Emergency Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL.
⁵ Department of Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL.

PMID: 32603805
DOI: 10.1016/j.yebeh.2020.107247

Abstract

Background: Appropriate and timely treatment of status epilepticus (SE) decreases morbidity and mortality. Therefore, skill-based training in the identification and management of SE is crucial for clinicians.

Objective: The objective of the study was to develop and evaluate the impact of a simulation-based mastery learning (SBML) curriculum to train neurology residents on the identification and management of SE.

Methods: We used pretest-posttest design with a retention test on SE skills for this study. Neurology residents in the second postgraduate year (PGY-2) were eligible to participate in the SE SBML curriculum. Learners completed a baseline-simulated SE skills assessment (pretest) using a 26-item dichotomous skills checklist. Next, they participated in a didactic session about the identification and management of SE, followed by deliberate skills practice. Subsequently, participants completed another skills assessment (posttest) using the same 26-item checklist. All participants were required to meet or exceed a minimum passing standard (MPS) determined by a panel of 14 SE experts using the Mastery Angoff standard setting method. After meeting the MPS at posttest, participants were reassessed during an unannounced in situ simulation session on the medical wards. We compared pretest with posttest simulated SE skills performance and posttest with reassessment in situ performance.

Results: The MPS was set at 88% (23/26) checklist items correct. Sixteen neurology residents participated in the intervention. Participant performance improved from a median of 44.23% (Interquartile range (IQR): 34.62-55.77) at pretest to 94.23% (IQR: 92.13-100) at the posttest after SBML (p < .001). There was no significant difference in scores between the posttest and in situ test up to 8 months later (94.23%; IQR: 92.31-100 vs. 92.31%; IQR: 88.46-96.15; p = .13).

Conclusions: Our SBML curriculum significantly improved residents' SE identification and management skills that were largely retained during an unannounced simulated encounter in the hospital setting.

Keywords: Education; Mastery learning; Seizures; Simulation; Status epilepticus.

MeSH terms

Adult
Checklist / methods
Checklist / standards
Clinical Competence / standards*
Computer Simulation / standards*
Curriculum / standards*
Educational Measurement / methods
Educational Measurement / standards
Female
Humans
Internship and Residency / methods
Internship and Residency / standards*
Male
Manikins
Neurology / education
Neurology / standards*
Status Epilepticus / diagnosis*
Status Epilepticus / therapy