Development and incorporation of hybrid simulation OSCE into in-training examinations to assess multiple CanMEDS competencies in urologic trainees

Authors

  • Laura Nguyen The University of Ottawa
  • Kim Tardioli University of Ottawa Skills and Simulation Centre, University of Ottawa
  • Matthew Roberts The University of Ottawa
  • James Watterson The University of Ottawa

DOI:

https://doi.org/10.5489/cuaj.2366

Keywords:

Education, Residency, Simulation

Abstract

Introduction: As residency training requirements increasingly emphasize a competency-based approach, novel tools to directly evaluate Canadian Medical Education Directives for Specialists (CanMEDS) competencies must be developed. Incorporating simulation allows residents to demonstrate knowledge and skills in a safe, standardized environment. We describe a novel hybrid simulation station for use in a urology resident in-training Objective Structured Clinical Exam (OSCE) to assess multiple CanMEDS competencies.

Methods: An OSCE station was developed to assess Communicator, Health Advocate, Manager, and Medical Expert (including technical skills) CanMEDS roles. Residents interviewed a standardized patient, interacted with a nurse, performed flexible cystoscopy and attempted stent removal using a novel bladder/stent model. Communication was assessed using the Calgary-Cambridge Observational Guide, knowledge was assessed using a checklist, and technical skills were assessed using a previously validated global rating scale. Video debriefing allowed residents to review their performance. Face and discriminative validity were assessed, and feasibility was determined through qualitative post-examination interviews and cost analysis.

Results: All 9 residents (postgraduate years [PGY] 3, 4, 5) completed the OSCE in 15 minutes. Communicator and knowledge scores were similar among all PGYs. Scores in technical skills were higher in PGY-5 compared with PGY-3/4 reside nts (mean score 79% vs. 73%). Residents and exam personnel felt the OSCE station allowed for realistic demonstration of competencies. Equipment cost was $218 for the exam station.

Conclusions: We developed and implemented a hybrid simulation- based OSCE station to assess multiple CanMEDS roles. This approach was feasible and cost-effective; it also provided a framework for future development of similar OSCE stations to assess resident competencies across multiple domains.

Downloads

Download data is not yet available.

Author Biographies

Laura Nguyen, The University of Ottawa

Urology Resident, The University of Ottawa

Matthew Roberts, The University of Ottawa

Division of Urology, Department of Surgery

Assistant Professor, The University of Ottawa

James Watterson, The University of Ottawa

Division of Urology, Department of Surgery

Associate Professor, The University of Ottawa

Downloads

Published

2015-02-05

How to Cite

Nguyen, L., Tardioli, K., Roberts, M., & Watterson, J. (2015). Development and incorporation of hybrid simulation OSCE into in-training examinations to assess multiple CanMEDS competencies in urologic trainees. Canadian Urological Association Journal, 9(1-2), 32–6. https://doi.org/10.5489/cuaj.2366

Issue

Section

Original Research