Factors predicting students' performance in the final pediatrics OSCE

Affiliations

02 September 2020

-

doi: 10.1371/journal.pone.0236484


Abstract

Background: Objective Structured Clinical Examinations (OSCEs) have been used to assess the clinical competence of medical students for decades. Limited data are available on the factors that predict students' performance on the OSCEs. The aim of our study was to evaluate the factors predicting performance on the pediatrics final OSCE, including the timing of students' clerkship and their performance on the in-training OSCE and written examinations.

Methods: Grades in pediatrics for 3 consecutive academic years (2013-2016) were included. The average scores of the in-training OSCEs, written and final OSCEs and written exams were compared among the three years using the analysis of variance (ANOVA) test. The correlations between performance on the final OSCEs and the in-training OSCEs, in-training written exams and final written exams were studied using Spearman's Rho correlation test. The effect of the timing of the clerkship on the final OSCE performance was evaluated.

Results: A total of 286 students' records were included. There were 115 male students and 171 female students (M:F 1:1.5). There were strong positive correlations between students' performance on the in-training examinations (OSCE and written) and the final OSCE (correlation coefficients of 0.508 and 0.473, respectively). The final written exam scores were positively correlated with the final OSCEs (r = 0.448). There was no significant effect of the timing of the clerkship.

Conclusions: Students' performance on in-training examinations might predict their final OSCE scores. Thus, it is important to provide students with the necessary intervention at an early stage to reduce failure rates. The final OSCE performance does not seem to be affected by the timing of the clerkship.

Conflict of interest statement

the authors have declared that no competing interests exist.


Figures


Similar articles

Does student performance on preclinical OSCEs relate to clerkship grades?

Chima M, Dallaghan GB.Med Educ Online. 2016 Jun 22;21:31724. doi: 10.3402/meo.v21.31724. eCollection 2016.PMID: 27340087 Free PMC article.

The Associations Between Clerkship Objective Structured Clinical Examination (OSCE) Grades and Subsequent Performance.

Dong T, Zahn C, Saguil A, Swygert KA, Yoon M, Servey J, Durning S.Teach Learn Med. 2017 Jul-Sep;29(3):280-285. doi: 10.1080/10401334.2017.1279057. Epub 2017 Mar 2.PMID: 28632015

Use of an objective structured clinical examination in evaluating student performance.

Prislin MD, Fitzpatrick CF, Lie D, Giglio M, Radecki S, Lewis E.Fam Med. 1998 May;30(5):338-44.PMID: 9597531

Changing an existing OSCE to a teaching tool: the making of a teaching OSCE.

Brazeau C, Boyd L, Crosson J.Acad Med. 2002 Sep;77(9):932. doi: 10.1097/00001888-200209000-00036.PMID: 12228103 Review.

The Objective Structured Clinical Examination (OSCE) in the clinical clerkship: an overview.

Tervo RC, Dimitrievich E, Trujillo AL, Whittle K, Redinius P, Wellman L.S D J Med. 1997 May;50(5):153-6.PMID: 9155233 Review.


Cited by

Students’ performance of and perspective on an objective structured practical examination for the assessment of preclinical and practical skills in biomedical laboratory science students in Sweden: a 5-year longitudinal study.

Hultgren C, Lindkvist A, Curbo S, Heverin M.J Educ Eval Health Prof. 2023;20:13. doi: 10.3352/jeehp.2023.20.13. Epub 2023 Apr 6.PMID: 37020414 Free PMC article.

Clinical experience can compensate for inferior academic achievements in an undergraduate objective structured clinical examination.

Tsikas SA, Afshar K.BMC Med Educ. 2023 Mar 16;23(1):167. doi: 10.1186/s12909-023-04082-x.PMID: 36927361 Free PMC article.

"We Need More Practice": Evaluating the Role of Virtual Mock OSCES in the Undergraduate Programme During the COVID Pandemic.

Lim GHT, Gera RD, Hany Kamel F, Thirupathirajan VAR, Albani S, Chakrabarti R.Adv Med Educ Pract. 2023 Feb 28;14:157-166. doi: 10.2147/AMEP.S381139. eCollection 2023.PMID: 36880093 Free PMC article.

An Assessment of the Correlation between Tests of Clinical Competence and Tests of Cognitive Knowledge amongst Nigerian Resident Doctors in Surgery.

Lawal AO, Abiola AO, Habeebu MYM, Ojewola RW, Tijani KH.J West Afr Coll Surg. 2020 Apr-Jun;10(2):12-16. doi: 10.4103/jwas.jwas_45_21. Epub 2022 Mar 26.PMID: 35558570 Free PMC article.

Changing Student Perception of an Online Integrated Structured Clinical Examination During the COVID-19 Pandemic.

Ganesananthan S, Li C, Donnir A, Anthony A, Woo T, Zielinska AP, Khajuria A.Adv Med Educ Pract. 2021 Aug 12;12:887-894. doi: 10.2147/AMEP.S325364. eCollection 2021.PMID: 34408530 Free PMC article.


KMEL References


References

  1.  
    1. Chima M, Dallangam GB. Does student perfomance on preclinical OSCEs relate to clerkship grades? Med Educ Online.2016, 21:31724 10.3402/meo.v21.31724 eCollection 2016. - DOI - PMC - PubMed
  2.  
    1. Bartfay WJ, Rombough R, Howse E, Leblanc R. Evaluation: The OSCE approach in nursing education. Can Nurse.2004;100:18–23 - PubMed
  3.  
    1. Lukas RV, Adesoye T, Smith S, Blood A, Brorson J. Student assessment by objective structured examination in a neurology clerkship. Neurology 2012; 79:681–85 10.1212/WNL.0b013e3182648ba1 - DOI - PMC - PubMed
  4.  
    1. Patricio MF, Juliano M, Fareleira F, Carneiro AV. Is the OSCE a feasible tool to assess competencies in undergraduate medical education? Med Teach. 2013; 35(6):503–14 10.3109/0142159X.2013.774330 - DOI - PubMed
  5.  
    1. Joshi MK, Srivastava AK, Ranjan M, Dhar M, Chumer S, et al. OSCE as a summative Assessment Tool for Undergraduate Students of Surgery-Our Experience. Indian J Surg.2017;79(6):534–538 10.1007/s12262-016-1521-y - DOI - PMC - PubMed
  6.  
    1. Bodger O, Byrne A, Evans PA, Rees S, Jones G, Cowell C, et al. Graduate Entry Medicine: Selection Criteria and Student Performance. PLoS one.2011;6: e27161 10.1371/journal.pone.0027161 - DOI - PMC - PubMed
  7.  
    1. Dong T, Swygert KA, Durning SJ, Saguil A, Gilliliand WR, Cruess D, et al. Validity Evidence for Medical Schools OSCEs: Association with USMLE (R) Step assessments. Teach Learn Med.2014;26:379–386 10.1080/10401334.2014.960294 - DOI - PubMed
  8.  
    1. Simon SR, Bui A, Berti D, Volkan K. The Relationship between Second -Year Medical Students’ OSCE Scores and USMLE Step 2 Scores. J Eval Clin Pract.2007;13:901–905 10.1111/j.1365-2753.2006.00768.x - DOI - PubMed
  9.  
    1. Dong T, Saguil A, Artino AR Jr., Gilliland WR, Waechter DM, Lopreaito J, et al. Relationship Between OSCE Scores and Other Typical Medical School Performance Indicators: a 5-year Cohort Study. Mil Med.2012;177:44–46 10.7205/milmed-d-12-00237 - DOI - PubMed
  10.  
    1. Kreptul D, Thomas RE. Family Medicine Resident OSCEs: A Systematic Review. Educ Prim Care.2016;13:1–7 - PubMed
  11.  
    1. Sobh AH, Austin Z, Izham M I M, Diab MI, Wilby KJ. Application of a Systematic Approach to Evaluating Psychometric Properties of a Cumulative Exit-From-Degree Objective Structured Clinical Examination (OSCE). Curr Pharm Teach Learn.2017;9(6):1091–1098 10.1016/j.cptl.2017.07.011 - DOI - PubMed
  12.  
    1. Nackman GB1, Sutyak J, Lowry SF, Rettie C. Predictors of Educational Outcome: Factors Impacting Performance on a Standardized Clinical Evaluation. J Surg Res.2002;106(2): 314–318 10.1006/jsre.2002.6477 - DOI - PubMed
  13.  
    1. Chisnall B, Vince T, Hall S, Tribe R. Evaluation of Outcomes of a Formative Objective Structured Clinical Examination for Second-Year UK Medical Students. Int J Med Educ.2015;6:76–83 10.5116/ijme.5572.a534 - DOI - PMC - PubMed
  14.  
    1. Alkhateeb N. E., Al-Dabbagh A., Ibrahim M., & Al-Tawil N. G. (2019). Effect of a Formative Objective Structured Clinical Examination on the Clinical Performance of Undergraduate Medical Students in a Summative Examination: A Randomized Controlled Trial. Indian pediatrics, 56(9), 745–748. - PubMed
  15.  
    1. Zahid MA, Vaegese R, Mohammed AM, Ayed AK. Comparison of Problem-Based Learning-Driven with Traditional Didactic–Lecture-Based Curricula. Int J Med educ.2016;7:181–187 10.5116/ijme.5749.80f5 - DOI - PMC - PubMed
  16.  
    1. Newble D. Revisiting “the effect of assessments and Examinations on the Learning of Medcal students” Med Educ.2016; 50:498–501 10.1111/medu.12796 - DOI - PubMed
  17.  
    1. Stormann S, Stankiewicz M, Raes P, Berchtold C, Kosanke YIlles G, et al. How well Do Final Year Undergraduate Medical Students Master Clinical Skills? GMC J Med Educ. 2016;33(4):Doc58. - PMC - PubMed
  18.  
    1. Gillette C, Stanton RB, Anderson HG Jr. Student Performance on a Knowledge-Based Exam May Predict Student Ability to communicate Effectively with a Standardized Patient During an Objective Structured Clinical Examination Curr Pharm Teach Learn.2017;9(2):201–207 10.1016/j.cptl.2016.11.004 - DOI - PubMed
  19.  
    1. Lucélio B. Couto, Marina T. Durand, Amora C. D. Wolff, Carolina B. A. Restini, Milton Faria Jr, et al. (2019) Formative assessment scores in tutorial sessions correlates with OSCE and progress testing scores in a PBL medical curriculum, Medical Education Online, 24:1, 1560862, 10.1080/10872981.2018.1560862 - DOI - PMC - PubMed
  20.  
    1. Sampat A., Rouleau G, O’Brien C, Zadikoff C (2019) Neurology Clerkship Predictors of Objective Structured Clinical Exam and Shelf Performance, J Med Educ & curric develop, 6:1–7 - PMC - PubMed