Napier, Fiona, Davies, Robin P., Baldock, Catherine, Stevens, Harry, Lockey, Andrew S., Bullock, Ian and Perkins, Gavin D.. (2009) Validation for a scoring system of the ALS cardiac arrest simulation test (CASTest). Resuscitation, Vol.80 (No.9). pp. 1034-1038. ISSN 1873-1570

Preview

PDF WRAP_Perkins_1070268-lb-190511-perkins_castest-test-performance-v-resubmission-v1-16-3-09.pdf - Accepted Version - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader Download (190Kb)

Abstract

Aim: The Cardiac Arrest Simulation Test (CASTest) assesses resuscitation knowledge and skills during a simulated cardiac arrest. The aim of this study is to validate an alternative scoring system for measuring individual candidate performance during research involving the CASTest.

Methods: The performance of 537 participants was measured using the new scoring system. In addition, assessors assigned a global pass-fail decision. Differences in scores were compared between to global pass/ fail decisions, professional groups and those nominated to become instructors. Correlations between CASTest domain scores and overall score, multiple choice scores and other practical tests (airway test and initial assessment and resuscitation test) scores were measured. This provided opportunity to cross reference achievement in other areas of course assessment with this alternative scoring system.

Results: 413 (76.9%) passed the CASTest and 124 (23.1%) failed. The total performance score was significantly higher in those that passed than in those that failed (median 77 vs 62.5, P<0.0001). There were no differences between professions. Senior staff performed slightly better than junior staff (median 74 and 72 respectively, P=0.01). Excellent participants (identified as having instructor potential) scored significantly higher than the other participants (median 94 and 72 respectively, P <0.0001). A strong correlation was demonstrated between domains in the CASTest (rho 0.72-0.82, P<0.01). Other assessment outcomes for the ALS course correlated poorly with CASTest scores (rho = 0.27-0.37, P<0.01).

Conclusion: This new simple scoring system can be used to better characterise performance on the ALS course CASTest than the current binary pass-fail outcome.

Item Type:	Journal Article
Subjects:	R Medicine > RC Internal medicine
Divisions:	Faculty of Medicine > Warwick Medical School
Library of Congress Subject Headings (LCSH):	CPR (First aid) -- Study and teaching, CPR (First aid) -- Methodology, Hospitals -- Medical staff -- Rating of
Journal or Publication Title:	Resuscitation
Publisher:	Elsevier Ireland Ltd
ISSN:	1873-1570
Official Date:	September 2009
Volume:	Vol.80
Number:	No.9
Page Range:	pp. 1034-1038
Identification Number:	10.1016/j.resuscitation.2009.04.043
Status:	Peer Reviewed
Access rights to Published version:	Restricted or Subscription Access
Funder:	National Institute for Health Research (Great Britain) (NIHR), Resuscitation Council (UK), Laerdal Medical Corporation
References:	1. Perkins G, Lockey A. The advanced life support provider course. BMJ 2002;325:S81. 2. Baskett PJ, Nolan JP, Handley A, Soar J, Biarent D, Richmond S. European Resuscitation Council guidelines for resuscitation 2005. Section 9. Principles of training in resuscitation. Resuscitation 2005;67 Suppl 1:S181-9. 3. Norcini JJ. Setting standards on educational tests. Medical Education 2003;37:464-9. 4. Downing SM. Validity: on the meaningful interpretation of assessment data. Medical Education 2003;37:830-7. 5. Perkins GD. Simulation in resuscitation training. Resuscitation 2007; In Press 6. Perkins GD. Mann Whitney U test. In: Gao SF, Smith JE, eds. Key Topics In Medical Research. London: Bios; 2002:128-32. 7. Resuscitation C, Bullock I, Colquhoun M, Coleman A. The assessment of resuscitation teaching. In: The Generic Instructor Course. London: Resuscitation Council (UK); 2004:34-41. 8. Smith KK, Gilcreast D, Pierce K. Evaluation of staff's retention of ACLS and BLS skills. Resuscitation 2008;78:59-65. 9. Lockyer J, Singhal N, Fidler H, Weiner G, Aziz K, Curran V. The development and testing of a performance checklist to assess neonatal resuscitation megacode skill. Pediatrics 2006;118:e1739-44. 10. Nadel FM, Lavelle JM, Fein JA, Giardino AP, Decker JM, Durbin DR. Assessing pediatric senior residents' training in resuscitation: fund of knowledge, technical skills, and perception of confidence. Pediatric Emergency Care 2000;16:73-6. 11. Ringsted C, Lippert F, Hesselfeldt R, et al. Assessment of Advanced Life Support competence when combining different test methods--reliability and validity. Resuscitation 2007;75:153-60. 12. Perkins GD, Davies RP, Stallard N, Bullock I, Stevens H, Lockey A. Advanced life support cardiac arrest scenario test evaluation. Resuscitation 2007;75:484-90. 13. Perkins GD, Hulme J, Tweed MJ. Variability in the assessment of advanced life support skills. Resuscitation 2001;50:281-6. 14. Perkins GD, Tweed MJ. Evaluation assessment of advanced life support skills: examiner consistency. Med Educ 2001;35:S60.
URI:	http://wrap.warwick.ac.uk/id/eprint/34826

Request changes or add full text files to a record

Actions (login required)

View Item