Comparison of the problem based learning-driven with the traditional didactic-lecture-based curricula

Muhammad A Zahid 1, Ramani Varghese 1, Ahmed M Mohammed 2, Adel K Ayed 3

Affiliations

12 June 2016

-

doi: 10.5116/ijme.5749.80f5

Abstract

Objective: To compare the Problem-based learning (PBL) with the traditional lecture-based curricula.

Methods: The single best answer Multiple Choice Questions (MCQ) and the Objective Structured Clinical Examination (OSCE) were used to compare performance of the lecture-based curriculum with the PBL medical student groups. The reliability for the MCQs and OSCE was calculated with Kuder-Richardson formula and Cronbach's alpha, respectively. The content validity of the MCQs and OSCE were tested by the Independent Subject Experts (ISE). The Student's t-test for independent samples was used to compare the item difficulty of the MCQs and OSCE's, and the Chi-square test was used to compare the grades between the two student groups.

Results: The PBL students outperformed the old curriculum students in overall grades, theoretical knowledge base (tested with K2 type MCQs) and OSCE. The number of the PBL students with scores between 80-90% (grade B) was significantly (p=0.035) higher while their number with scores between 60 to 69% (grade C) was significantly p=0.001) lower than the old curriculum students. Similarly, the mean MCQ and the OSCE scores of the new curriculum students were significantly higher (p = 0.001 and p = 0.025, respectively) than the old curriculum students. Lastly, the old curriculum students found the K2-MCQs to be more (p = 0.001) difficult than the single correct answer (K1 type) MCQs while no such difference was found by the new curriculum students.

Conclusions: Suitably designed MCQs can be used to tap the higher cognitive knowledge base acquired in the PBL setting.

Keywords: K2 type MCQs; Problem-based learning; curriculum development; curriculum reforms; evaluation; medical students; psychiatry.

Similar articles

Developing and evaluating the student assessment system in the preclinical problem-based curriculum at Sherbrooke.

Des Marchais JE, Vu NV.Acad Med. 1996 Mar;71(3):274-83. doi: 10.1097/00001888-199603000-00021.PMID: 8607928

Effectiveness of problem based learning as an instructional tool for acquisition of content knowledge and promotion of critical thinking among medical students.

Tayyeb R.J Coll Physicians Surg Pak. 2013 Jan;23(1):42-6.PMID: 23286622

A comparison of clinical-scenario (case cluster) versus stand-alone multiple choice questions in a problem-based learning environment in undergraduate medicine.

Vuma S, Sa B.J Taibah Univ Med Sci. 2016 Nov 11;12(1):14-26. doi: 10.1016/j.jtumed.2016.08.014. eCollection 2017 Feb.PMID: 31435208 Free PMC article.

Problem-based learning: its role in undergraduate surgical education.

Chang G, Cook D, Maguire T, Skakun E, Yakimets WW, Warnock GL.Can J Surg. 1995 Feb;38(1):13-21.PMID: 7882203 Review.

How has problem based learning fared in Pakistan?

Mahmud W, Hyder O.J Coll Physicians Surg Pak. 2012 Oct;22(10):652-6. doi: 10.2012/JCPSP.652656.PMID: 23058150 Review.

Cited by

A simple approach of applying blended learning to problem-based learning is feasible, accepted and does not affect evaluation and exam results-a just pre-pandemic randomised controlled mixed-method study.

Servos U, Reiß B, Stosch C, Karay Y, Matthes J.Naunyn Schmiedebergs Arch Pharmacol. 2023 Jan;396(1):139-148. doi: 10.1007/s00210-022-02306-3. Epub 2022 Oct 20.PMID: 36264299 Free PMC article. Clinical Trial.

The Effects of Sequencing Strategies in Teaching Methods on Nursing Students' Knowledge Acquisition and Knowledge Retention.

Lin WT, Yu CY, Chou FH, Lin SY, Lee BO.Healthcare (Basel). 2022 Feb 25;10(3):430. doi: 10.3390/healthcare10030430.PMID: 35326908 Free PMC article.

Nursing students' experiences of applying problem-based learning to train the core competence teamwork and collaboration: An interview study.

Allert C, Dellkvist H, Hjelm M, Andersson EK.Nurs Open. 2022 Jan;9(1):569-577. doi: 10.1002/nop2.1098. Epub 2021 Oct 19.PMID: 34664786 Free PMC article.

Nursing students' experiences of what influences achievement of learning outcomes in a problem-based learning context: A qualitative descriptive study.

Svensson J, Axén A, Andersson EK, Hjelm M.Nurs Open. 2021 Jul;8(4):1863-1869. doi: 10.1002/nop2.842. Epub 2021 Mar 11.PMID: 33709559 Free PMC article.

Promoting Students' Sense of Coherence in Medical Education Using Transformative Learning Activities.

Hatlevik IKR, Hovdenak SS.Adv Med Educ Pract. 2020 Oct 30;11:807-816. doi: 10.2147/AMEP.S266960. eCollection 2020.PMID: 33154694 Free PMC article.

KMEL References

https://pubmed.ncbi.nlm.nih.gov/

References

  1.  
    1. Norman GR, Schmidt HG. The psychological basis of problem-based learning: a review of the evidence. Acad Med. 1992;67:557–565. doi: 10.1097/00001888-199209000-00002. - DOI - PubMed
  2.  
    1. Hartling L, Spooner C, Tjosvold L, Oswald A. Problem-based learning in pre-clinical medical education: 22 years of outcome research. Med Teach. 2010;32:28–35. doi: 10.3109/01421590903200789. - DOI - PubMed
  3.  
    1. Association of American Medical Colleges, Physicians for the twenty-first century. Report of the project panel on the general professional education of the physician and college preparation for medicine. J Med Educ. 1984; 59: 1-208 - PubMed
  4.  
    1. Walton HJ, Matthews MB. Essentials of problem-based learning. Med Educ. 1989;23:542–558. doi: 10.1111/j.1365-2923.1989.tb01581.x. - DOI - PubMed
  5.  
    1. Schmidt HG, Muijtjens AM, Van der Vleuten CP, Norman GR. Differential student attrition and differential exposure mask effects of problem-based learning in curriculum comparison studies. Acad Med. 2012;87:463–475. doi: 10.1097/ACM.0b013e318249591a. - DOI - PubMed
  6.  
    1. Vernon DT, Blake RL. Does problem-based learning work? A meta-analysis of evaluative research. Academic Medicine. 1993;68:550–63. doi: 10.1097/00001888-199307000-00015. - DOI - PubMed
  7.  
    1. Albanese MA, Mitchell S. Problem-based learning: a review of literature on its outcomes and implementation issues. Acad Med. 1993;68:52–81. doi: 10.1097/00001888-199301000-00012. - DOI - PubMed
  8.  
    1. Kirschner PA, Sweller J, Clark RE. Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching. Educational Psychologist. 2006;41:75–86. doi: 10.1207/s15326985ep4102_1. - DOI
  9.  
    1. Van Der Vleuten CP. The assessment of professional competence: Developments, research and practical implications. Adv Health Sci Educ Theory Pract. 1996;1:41–67. doi: 10.1007/BF00596229. - DOI - PubMed
  10.  
    1. Koh GC, Khoo HE, Wong ML, Koh D. The effects of problem-based learning during medical school on physician competency: a systematic review. CMAJ. 2008;178:34–41. doi: 10.1503/cmaj.070565. - DOI - PMC - PubMed
  11.  
    1. Neville AJ. Problem-based learning and medical education forty years on. A review of its effects on knowledge and clinical performance. Med Princ Pract. 2009;18:1–9. doi: 10.1159/000163038. - DOI - PubMed
  12.  
    1. Dochy F, Segers M, Van den Bossche P, Gijbels D. Effects of problem-based learning: a meta-analysis. Learning and Instruction. 2003;13:533–568. doi: 10.1016/s0959-4752(02)00025-7. - DOI
  13.  
    1. Nandi PL, Chan JN, Chan CP, Chan P, Chan LP. Undergraduate medical education: comparison of problem-based learning and conventional teaching. Hong Kong Med J. 2000;6:301–306. - PubMed
  14.  
    1. Berkson L. Problem-based learning: have the expectations been met? Acad Med. 1993;68:79–88. doi: 10.1097/00001888-199310000-00053. - DOI - PubMed
  15.  
    1. Schmidt HG, Rotgans JI, Yew EH. The process of problem-based learning: what works and why. Med Educ. 2011;45:792–806. doi: 10.1111/j.1365-2923.2011.04035.x. - DOI - PubMed
  16.  
    1. Maudsley G. Do we all mean the same thing by "problem-based learning"? A review of the concepts and a formulation of the ground rules. Academic Medicine. 1999;74:178–85. doi: 10.1097/00001888-199902000-00016. - DOI - PubMed
  17.  
    1. Kaufman DM , Mann KV . Achievement of Students in a conventional and problem based learning (PBL) curriculum. Adv Health Sci Educ Theory Pract. 1999;4(3):245–260. - PubMed
  18.  
    1. Hmelo CE, Evensen DH. Introduction to problem-based learning: gaining insights on learning interactions through multiple methods of inquiry. In Evensen DH, Hmelo CE, editors. Problem-based learning: a research perspective on learning interactions. Mahwah, NJ: Erlbaum; 2000.
  19.  
    1. Krathwohl DR. A Revision of Bloom's Taxonomy: An Overview. Theory Into Practice. 2002;41:212–218. doi: 10.1207/s15430421tip4104_2. - DOI
  20.  
    1. McParland M, Noble LM, Livingston G. The effectiveness of problem-based learning compared to traditional teaching in undergraduate psychiatry. Med Educ. 2004;38:859–867. doi: 10.1111/j.1365-2929.2004.01818.x. - DOI - PubMed
  21.  
    1. van Diest R, van Dalen J, Bak M, Schruers K, van der Vleuten C, Muijtjens A, Scherpbier A. Growth of knowledge in psychiatry and behavioural sciences in a problem-based learning curriculum. Med Educ. 2004;38:1295–1301. doi: 10.1111/j.1365-2929.2004.02022.x. - DOI - PubMed
  22.  
    1. Heijne-Penninga M, Kuks JB, Hofman WH, Muijtjens AM, Cohen-Schotanus J. Influence of PBL with open-book tests on knowledge retention measured with progress tests. Adv Health Sci Educ Theory Pract. 2013;18:485–495. doi: 10.1007/s10459-012-9386-8. - DOI - PMC - PubMed
  23.  
    1. Kaufman DM, Mann KV. Comparing achievement on the Medical Council of Canada Qualifying Examination Part I of students in conventional and problem-based learning curricula. Acad Med. 1998;73:1211–1213. doi: 10.1097/00001888-199811000-00022. - DOI - PubMed
  24.  
    1. Newman M. A pilot systematic review and meta-analysis on the effectiveness of Problem Based Learning: on behalf of the Campbell collaboration systematic review group on the effectiveness of problem based learning. Newcastle Upon Tyne, UK: Learning and Teaching Support Network-01, University of Newcastle upon Tyne; 2003.
  25.  
    1. Case SM, Swanson DB. Constructing written test questions for the basic and clinical sciences. Philadelphia, PA: National Board of Medical Examiners; 2001.
  26.  
    1. Masters JC, Hulsmeyer BS, Pike ME, Leichty K, Miller MT, Verst AL. Assessment of multiple-choice questions in selected test banks accompanying text books used in nursing education. J Nurs Educ. 2001;40:25–32. - PubMed
  27.  
    1. Morrison S, Free KW. Writing multiple-choice test items that promote and measure critical thinking. J Nurs Educ. 2001;40:17–24. - PubMed
  28.  
    1. Tarrant M, Knierim A, Hayes SK, Ware J. The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments. Nurse Educ Pract. 2006;6:354–363. doi: 10.1016/j.nepr.2006.07.002. - DOI - PubMed
  29.  
    1. Ebel RL, Frisbie DA. Essentials of educational measurement. Englewood Cliffs, NJ: Prentice Hall;1991.
  30.  
    1. Regehr G, Norman GR. Issues in cognitive psychology: implications for professional education. Acad Med. 1996;71:988–981001. doi: 10.1097/00001888-199609000-00015. - DOI - PubMed
  31.  
    1. Elstein AS, Shulman LS, Sprafka SA. Medical problem-solving: an analysis of clinical reasoning. Cambridge, Mass: Harvard University Press; 1978.
  32.  
    1. Berlyne DE. Curiosity and learning. Motiv Emot. 1978;2:97–175. doi: 10.1007/bf00993037. - DOI
  33.  
    1. Litman JA. Interest and deprivation factors of epistemic curiosity. Personality and Individual Differences. 2008;44:1585–1595. doi: 10.1016/j.paid.2008.01.014. - DOI
  34.  
    1. Litman J. Curiosity and the pleasures of learning: Wanting and liking new information. Cognition & Emotion. 2005;19:793–814. doi: 10.1080/02699930541000101. - DOI
  35.  
    1. Colliver JA. Effectiveness of problem based learning curricula research and theory. Acad Med. 2000;75(3):259–266. - PubMed
  36.  
    1. Meo SA. Evaluating learning among undergraduate medical students in schools with traditional and problem-based curricula. Adv Physiol Educ. 2013;37:249–253. doi: 10.1152/advan.00031.2013. - DOI - PubMed
  37.  
    1. Heijne-Penninga M, Kuks JB, Hofman WH, Muijtjens AM, Cohen-Schotanus J. Influence of PBL with open-book tests on knowledge retention measured with progress tests. Adv Health Sci Educ Theory Pract. 2013;18:485–495. doi: 10.1007/s10459-012-9386-8. - DOI - PMC - PubMed
  38.  
    1. Norman GR, Schmidt HG. Effectiveness of problem-based learning curricula: theory, practice and paper darts. Med Educ. 2000;34:721–728. doi: 10.1046/j.1365-2923.2000.00749.x. - DOI - PubMed
  39.  
    1. Dolmans DH, De Grave W, Wolfhagen IH, van der Vleuten CP. Problem-based learning: future challenges for educational practice and research. Med Educ. 2005;39:732–741. doi: 10.1111/j.1365-2929.2005.02205.x. - DOI - PubMed
  40.  
    1. Mamede S, Schmidt HG, Norman GR. Innovations in problem-based learning: what can we learn from recent studies? Adv Health Sci Educ Theory Pract. 2006;11:403–422. doi: 10.1007/s10459-006-9018-2. - DOI - PubMed

Page Navigation