Design, validation and dissemination of an undergraduate assessment tool using SimMan® in simulated medical emergencies
Paskins, Zoe, Kirkcaldy, Jo, Allen, Maggie, Dr., Macdougall, Colin, Dr., Fraser, Ian, Dr. and Peile, Ed. (2010) Design, validation and dissemination of an undergraduate assessment tool using SimMan® in simulated medical emergencies. Medical Teacher, Volume 32 (Number 1). E12-E17. ISSN 0142-159X
WRAP_Macdougall_Design validation etc final.pdf - Accepted Version
Download (492Kb) | Preview
Official URL: http://dx.doi.org/10.3109/01421590903199643
Background: Increasingly, medical students are being taught acute medicine using whole-body simulator manikins.
Aim: We aimed to design, validate and make widely available two simple assessment tools to be used with Laerdal SimMan (R) for final year students.
Methods: We designed two scenarios with criterion-based checklists focused on assessment and management of two medical emergencies. Members of faculty critiqued the assessments for face validity and checklists revised. We assessed three groups of different experience levels: Foundation Year 2 doctors, third and final year medical students. Differences between groups were analysed, and internal consistency and interrater reliability calculated. A generalisability analysis was conducted using scenario and rater as facets in design.
Results: A maximum of two items were removed from either checklist following the initial survey. Significantly different scores for three groups of experience for both scenarios were reported (p<0.001). Interrater reliability was excellent (r>0.90). Internal consistency was poor (alpha<50.5). Generalizability study results suggest that four cases would provide reliable discrimination between final year students.
Conclusions: These assessments proved easy to administer and we have gone some way to demonstrating construct validity and reliability. We have made the material available on a simulator website to enable others to reproduce these assessments.
|Item Type:||Journal Article|
|Alternative Title:||SimMan assessment tool : design and validation|
|Subjects:||L Education > LB Theory and practice of education
R Medicine > R Medicine (General)
|Divisions:||Faculty of Social Sciences > Institute for Employment Research
Faculty of Medicine > Warwick Medical School
|Library of Congress Subject Headings (LCSH):||Medicine -- Study and teaching (Higher) -- Simulation methods, Emergency medical services -- Study and teaching (Higher) -- Simulation methods, Simulated patients -- Design, Medical education, Physicians -- Training of -- Great Britain|
|Journal or Publication Title:||Medical Teacher|
|Official Date:||January 2010|
|Number of Pages:||6|
|Access rights to Published version:||Restricted or Subscription Access|
Beilock SL, Bertenthal BI, McLay AM, Carr TH. 2004. Haste does not
Actions (login required)