Marwaha, Steven. (2011) Objective structured clinical examinations (OSCEs), psychiatry and the clinical assessment of skills and competencies (CASC) : same evidence, different judgement. BMC Psychiatry, Vol.11 (No.85). ISSN 1471-244X

Preview

PDF WRAP_Marwaha_1471-244X-11-85.pdf - Published Version - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader Download (252Kb)

Abstract

Background: The Objective Structured Clinical Examination (OSCE), originally developed in the 1970’s, has been hailed as the "gold standard" of clinical assessments for medical students and is used within medical schools throughout the world. The Clinical assessment of Skills and Competencies (CASC) is an OSCE used as a clinical examination gateway, granting access to becoming a senior Psychiatrist in the UK. Discussion: Van der Vleuten’s utility model is used to examine the CASC from the viewpoint of a senior psychiatrist. Reliability may be equivalent to more traditional examinations. Whilst the CASC is likely to have content validity, other forms of validity are untested and authenticity is poor. Educational impact has the potential to change facets of psychiatric professionalism and influence future patient care. There are doubts about acceptability from candidates and more senior psychiatrists. Summary: Whilst OSCEs may be the best choice for medical student examinations, their use in post graduate psychiatric examination in the UK is subject to challenge on the grounds of validity, authenticity and educational impact.

Item Type:	Journal Article
Subjects:	R Medicine > RC Internal medicine
Divisions:	Faculty of Medicine > Warwick Medical School > Mental Health and Wellbeing Faculty of Medicine > Warwick Medical School
Library of Congress Subject Headings (LCSH):	Psychiatry -- Study and teaching, Medical students -- Rating of, Psychiatrists -- Rating of
Journal or Publication Title:	BMC Psychiatry
Publisher:	BioMed Central Ltd.
ISSN:	1471-244X
Date:	16 May 2011
Volume:	Vol.11
Number:	No.85
Identification Number:	10.1186/1471-244X-11-85
Status:	Peer Reviewed
Publication Status:	Published
Access rights to Published version:	Open Access
References:	1. Hodges B: Validity and the OSCE. Medical Teacher 2003, 25:250-254. 2. Rothman AI, Cohen R: Proceedings of the 6th Ottawa Conference on medical Education Toronto: University of Toronto Bookstore Publishing;292-321. 3. Miller GE: The assessment of clinical skills/competence/performance. Academic Medicine 1990, 65:63-67. 4. Wilson GM, Lever R, Harden RMcG, Roberston JIL, MacRitchie J: Examination of Clinical Examiners. The Lancet 1969, 1:37-40. 5. Maxim BR, Dielman TE: Dimensionality, Internal consistency and inter rater reliability of clinical performance ratings. Medical Education 1987, 21:130-137. 6. Harden RMcG, Stevenson M, Downie WW, Wilson GM: Assessment of Clinical Competence using Objective Structured Examination. British Medical Journal 1975, 1:447-451. 7. Van der Vleuten CPM: The assessment of professional competence: Developments, research and practical implications. Advances in Health Sciences Education 1996, 1:41-67. 8. Van der Vleuten CPM, Schuwirth LWT: Assessing professional competence: from methods to programmes. Medical Education 2005, 39:309-317. 9. Vu NV, Barrows HS: Use of standardized Patients in Clinical Assessments: Recent Developments and Measurements Findings. Educational Researcher 1994, 23:23-30. 10. Turner JL, Dankoski ME: Objective Structured Clinical exam: A Critical Review. Family Medicine 2008, 40:574-8. 11. Boulet JR, McKinley DW, Whelan GP, Hambleton RK: Quality assurance methods for performance-based assessments. Advances Health Science Education Theory Practice 2003, 8:27-47. 12. Swanson DB, Norman Linn RL: Performance-based assessment: lessons from health professions. Educational research 1995, 24:5-11. 13. Sloan DA, Donnelly MB, Schwartz Strodel WE: The Objective Structured Clinical Examination. Annals of Surgery 1995, 222:735-742. 14. Swanson DB: A measurement framework for performance based tests. In Further developments in assessing clinical competence. Edited by: Hart IR, Harden RM. Montreal: Can-Heal; 1987:13-45. 15. Van der Vleuten CPM, Swanson DB: Assessment of clinical skills with standardized patients: state of the art. Teaching and Learning in Medicine 1990, 2:58-76. 16. Swanson DB, Norcini JJ: Factors influencing reliability of tests using standardized patients. Teach Learn Med 1989, 1:158-66. 17. Wass V, Jones R, van der Vleuten : Standardised or real patients to test clinical competence? The long case revisited. Medical Education 2001, 35:321-5. 18. Van der Vleuten CPM, Normal GR, DeGraff E: Pitfalls in the persuit of objectivity: issues of reliability. Medical Education 1991, 25:110-118. 19. Regehr G, MacRae H, Reznick R, Szalay D: Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Academic Medicine 1998, 73:993-7. 20. Carraccio C, Englander R: The objective structured clinical examination: a step in the direction of competency-based evaluation. Arch Pediatr Adolesc Med 2000, 154:736-41. 21. Pierre R, Wierenga A, Barton M, Branday JM, Christie CDC: Student evaluation of an OSCE in Paediatric at the Univsertisty of the West Indies, Jamaica. BMC Medical Education 2004, 4:22. 22. Auewarakul C, Downing SM, Jaturatamrong U, Praditsuwan R: Sources of validity evidence for an internal medicine student evaluation system: an evaluative study of assessment methods. Medical Education 2005, 39:276-83. 23. Barman A: Critiques on the Objective Structured Clinical examination. Annals of the Academy of Medicine of Singapore; 2005:34:478-82. 24. Hodges B, Regehr G, Hanson M, McNaughton N: Validation of an objective structured clinical examination in psychiatry. Academic medicine 1998, 73:910-2. 25. Park RS, Chibnall JT, Blaskiewicz , Furman G, Powell J, Mohr CJ: Construct Validity of an Objective Structured Clinical examination (OSCE) in Psychiatry: Associations with the Clinical Skillls examination and other indicators. Academic Psychiatry 2004, 28:122-128. 26. Hodges B, Lofchy J: Evaluating psychiatry clinical clerks with a miniobjective structured clinical examination. Academic psychiatry 1997, 21:219-225. 27. Hodges B, Hanson M, McNaughton N, Regehr : What do Psychiatry residents think of an Objective Structured Clinical Examination. Academic Psychiatry 1999, 23:198-204. 28. Norman GR, Tugwell P, Feighter JW: A comparison of residents performance on real and simulated patients. Journal of Medical Education 1982, 57:708-715. 29. Rethans JJ, Drop R, Sturmans F, van der Vleuten C: A method for introducing standardized patients into general practice consultations. British Journal of General Practice 1991, 41:94-96. 30. Badger LW, DeGruy F, Hartman J, et al: Stability of standardised patients performance in a study of clinical decision making. Family Medicine 1995, 27:126-133. 31. Benning T, Broadhurt M: The long case is dead. Long live the long case. Loss of the MRCPsych long case and holism in Psychiatry. Psychiatric Bulletin 2007, 31:441-42. 32. Hodges B: Variations on a theme by Harden. Medical Education 2003, 37:1134-1140. 33. Van Thiel J, van der Vleuten CPM, Kraan H: Assessment of medical interviewing skills: generalisibility of scores using successive MAASversions. In Approaches to assessment of Clinical Competence-Part II. Edited by: Harden RM, Hart IR, Mulholland H. Norwich: Page Brothers; 1992:536-540. 34. Norman GR, Tugwell P, Feightner W, Muzzin LJ, Jacoby LL: Knowledge and clinical problem solving. Medical Education 1985, 19:344-56. 35. Blaskiewicz RJ, Park RS, Chibnall JT, Powell JK: The influence of testing context and clinical rotation order on student OSCE performance. Academic Medicine 2004, 79:597-601. 36. Cangelosi JS: Designing tests for evaluating student achievement. White plains New York, Longman; 1990. 37. RoyalCollege of Psychiatrists: 2008 [http://www.rcpsych.ac.uk/pdf/MRCPsych %20CASC%20Blueprint%202.pdf]. 38. Cohen R, Rothman AI, Poldre P, Ross J: Validity and generalisibility of global ratings in an objective structured clinical examination. Academic Medicine 1991, 66:545-8. 39. Hodges B, Regehr G, McNaughton N, Tiberius R, Hanson M: OSCE Checklists do not capture increasing levels of expertise. Academic Medicine 1999, 74:1129-1134. 40. Gleeson F: Assessment of Clinical Competence using the Objective Structured Long Examination Record (OSLER). Medical Teacher 1997, 19:7-14. 41. Duerson MC, Romrell LJ, Steven CB: Impacting faculty teaching and student performance: nine years experience with the objective structured clinical examination. Teaching and Learning in Medicine 2000, 12:176-82. 42. Newble DI, Jaeger K: The effect of assessments and examinations on the learning of medical students. Medical education 1983, 17:165-171. 43. Van Luijk SJ, Van der Vleuten CPM, Schelven RM: The relation between content and psychometric characteristics in performance-based testing. In Teaching and assessing clinical competence. Edited by: bender W, Hiemstra RJ, Scherpbier AIJA, Zwierstra RP. Groningen: Boekwerk Publications; 1990:202-7. 44. Departmentof Health: Mental health: New ways of working for everyone. 2007 [http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/ PublicationsPolicyAndGuidance/DH_074490], accessed 20th January 2011. 45. Epstein RM: Assessment in Medical Education. MThe New England Journal of Medicine; 2007:356:387-96. 46. Hodges B, Regehr G, Hanson M, McNaughton N: An objective Structured Clinical examination for Evaluating Psychiatric Clinical Clerks. Academic Medicine 1997, 72:715-721. 47. Cusimano MD, Cohen R, Tucker W, Murnaghan J, Kodama R, Reznick R: A comparative analysis of the costs of administration of an OSCE (objective structured clinical examination). Academic Medicine 1994, 69:571-6. 48. Varkey P, natt N, Lesnick T, Downing S, Yudkowsky : Validity evidence for an OSCE to assess competency in systems-based practice and practicebased learning and improvement: a preliminary investigation. Academic Medicine 2008, 83:775-80. 49. Whelan P, Larence-Smith G, Church L, Woolcock C, Meerten M, Rao R: Good bye OSCE, Hello CASC: a mock CASC course and examination. Psychiatric Bulletin 2009, 33:149-153.
URI:	http://wrap.warwick.ac.uk/id/eprint/35501

Data sourced from Thomson Reuters' Web of Knowledge

Request changes to a record

Actions (login required)

View Item