Future of Medical Education Journal

Future of Medical Education Journal

Evaluation of the training program of the community medicine interns based on the Kirkpatrick model

Document Type : Original Article

Authors
Bahar Moarrab 1
Lida Jarahi 2
Seyed Masoud Hosseini 1
Ali Emadzadeh 1
Roya Moallem 3
Mojtaba Mousavi Bazaz 2
1 Department of Medical Education, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
2 Department of Community Medicine, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
3 Department of Medical Ethics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
10.22038/fmej.2024.83310.1606
Abstract
Background: Evaluation of the educational program plays a crucial role in improving educational quality. This study aimed to evaluate the educational programs of community medicine interns based on the Kirkpatrick model.
Method: This descriptive-analytical research was conducted in the Community Medicine Department of the Medical Faculty of the Mashhad University of Medical Sciences from 2015 to 2018. All medical students who were community medicine interns in health centers in Mashhad during four academic years were included in the study by census method (n = 568). The educational program was evaluated on three levels: reaction, learning, and behavior. P < 0.05 was considered significant in all statistical tests.
Results: The study found an overall satisfaction score of 87.02%, with a slight decline over the four academic years. However, the overall satisfaction remained relatively high. The mean learning score in all three categories progressively improved across the years (p<0.05). The total Kirkpatrick learning score also increased significantly (p< 0.001). The behavioral change scores showed a fluctuating overall upward trend over the four academic years, indicating the positive impact of the training program on interns' behavior. The improvement in behavioral change was statistically significant (F = 6.31, p = 0.00).
Conclusion: The investigation of the Community Medicine internship program utilizing the Kirkpatrick model offers a thorough comprehension of its efficacy in improving interns' satisfaction, learning of skills, and behavior.
Keywords
Kirkpatrick’s Evaluation
Medical Interns’ Education
Community Medicine
Subjects
  1. Goodarzvand M, Esmaieli M. The Impact of IT Use on Training Effectiveness. Journal of New Approaches in Educational Administration. 2011; 2 (7): 1-24.
  2. Venkatesan M, Dongre AR, Ganapathy K. Evaluation of skill-based training program on rational drug treatment for medical interns. J Family Med Prim Care. 2017; 6 (4): 832-5.
  3. Guimarães SC, Guimarães EPA, Souza Júnior ONd, Machado MdFAS, Freitas RWJFd, Nuto SdAS. Avaliação de programa de residência em medicina de família e comunidade pela ótica dos médicos residentes. Rev Bras Educ Med. 2024; 48.
  4. Almeneessier AS, AlYousefi NA, AlWatban LF, Alodhayani AA, Alzahrani AM, Alwalan SI, et al. Evaluation of Educational Workshops for Family Medicine Residents Using the Kirkpatrick Framework. Adv Med Educ Pract. 2021; 12 (null): 371-82.
  5. Jason H. Future medical education: Preparing, priorities, possibilities. Med Teach. 2018; 40 (10): 996-1003.
  6. Rabiee F, Moayedi S N, Naderi Z, Aliabadi Farahani K, Shamsi M. Effect of in-service educational courses on human resources efficiency from university experts’ point of view. Bimonthly of Education Strategies in Medical Sciences. 2011; 4 (2): 85-9.
  7. Mayer RE. Applying the science of learning to medical education. Med Educ. 2010; 44 (6): 543-9.
  8. Hojjati H, Mehralizadeh Yl, Farhadirad H, Alostany S, Aghamolaei M. Assessing the effectiveness of training outcome based on Kirkpatrick model: case study. Quarterly Journal of Nersing Management. 2013; 2 (3): 35-42.
  9. Karami M, Fardanesh H, Abbaspour A, Moallem M. Comparing effectiveness of systematic and constructive instructional design model in managers training and development. Journal of Management and Planning In Educational System. 2009; 2 (2): 9-30.
  10. Elayaperumal S, Venugopal V, Dongre AR, Kumar S. Process of Developing Palliative Care Curriculum for Training Medical Interns in a Tertiary Care Teaching Hospital in Puducherry, India. Indian J Palliat Care. 2021; 27 (2): 269-74.
  11. Kirkpatrick D, Kirkpatrick J. Evaluating training programs: The four levels: Berrett-Koehler Publishers; 2006.
  12. Alsalamah A, Callinan C. The Kirkpatrick model for training evaluation: bibliometric analysis after 60 years (1959–2020). Industrial and Commercial Training. 2022; 54 (1): 36-63.
  13. Asadi lari M, Moshfeghy Z, Shahpari M, Mohammad Alian F. Midwifery Students’ Satisfaction with Logbook as a Clinical Evaluation Tool in Shiraz University of Medical Sciences. Iranian Journal of Medical Education. 2015; 15 (0): 170-80.
  14. Asgari H, Ashoorion V, Ehsanpour S. Teaching and evaluation of field training course for health services management undergraduates: conventional and logbook methods. Iranian Journal of Medical Education. 2016; 16 (0): 552-60.
  15. Yaghobian M, Fakhri M, salmeh f, Yaghobi T, zad M, Shahmohammadi S. Assessment of the effect of log book on nursing and midwifery students' clinical skills. Middle East J Sci Res. 2011; 7 (6): 896-902.
  16. Lakshminarayanan S, Bhardwaj P, Srivastava J. Internship training in community medicine–Need for reorientation and strengthening. Indian J Community Health. 2014; 26 (4): 338-42.
  17. Shrivastava SR, Shrivastava PS. Evidence-based medicine workshop for teaching faculty of a medical college: Kirkpatrick level 1 evaluation. International Journal of Academic Medicine. 2018; 4 (3): 289-94.
  18. Johnson SB, Fair MA, Howley LD, Prunuske J, Cashman SB, Carney JK, et al. Teaching Public and Population Health in Medical Education: An Evaluation Framework. Academic Medicine. 2020; 95 (12): 1853-63.
  19. Albanese M. Problem-based learning: why curricula are likely to show little effect on knowledge and clinical skills. Med Educ. 2000; 34 (9): 729-38.
  20. Harden R. Essential skills for a medical teacher: an introduction to teaching and learning in medicine. Elsevier Health Sciences; 2020.
  21. Prince KJ, Boshuizen HP, Van der Vleuten CP, Scherpbier AJ. Students' opinions about their preparation for clinical practice. Med Educ. 2005; 39 (7): 704-12.
  22. Van der Hem-Stokroos H, Daelmans H, Van der Vleuten C, Haarman HTM, Scherpbier A. A qualitative study of constructive clinical learning experiences. Med teach. 2003; 25 (2): 120-6.
  23. Zare M, Vizeshfar F. Evaluation of Health Education Volunteering Program based on "Kirkpatrick Model". Journal of Health Promotion Management. 2019; 8 (1): 30-4.
  24. Bates R. A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence. Eval Program Plann. 2004; 27 (3): 341-7.
  25. Ashghali Farahani M, Maserat Aghdam Arjestan E, Haghani H. Effect of Role-play Training on the Knowledge of Nursing Students on Patient Education. Iran Journal of Nursing. 2018; 31 (115): 29-40.
Future of Medical Education Journal
Volume 14, Issue 4
Autumn 2024
Pages 21-27