Future of Medical Education Journal

Future of Medical Education Journal

Exploring Faculty Members Perspective on the Implementation of Take-home assessments in Medical Education during the COVID-19 Outbreak: A Qualitative study

Document Type : Original Article

Authors
Abtin Heidarzadeh 1
Samaneh Panjeh Ali Beik 2
Hanieh Zehtab Hashemi 3, 4
Parvane Parvasideh 2
1 Medical Education Research Center. Education Development Center. Guilan University of Medical Sciences, Rasht, Iran
2 National Center for Medical Education Assessment, Tehran, Iran
3 Department of Health Informatics, Virtual University of Medical Sciences, Tehran, Iran
4 National Centre for Medical Education Assessment, Tehran, Iran
10.22038/fmej.2022.59352.1421
Abstract
Background: In early 2020, due to COVID-19, public lockdowns challenged the academic community by conducting a wide range of remote exams. The current study planned to survey the faculty member's perspective on the challenges and the solution approach ahead of this sudden transmission and the feasible medical educational assessments conducted in an online Take-home format.
Methods: The current paper was a cross-sectional and descriptive study. We collected data through an online interview form consisting of close-ended and open-ended questions completed by Iranian universities of medical sciences teachers. We analyzed the received data using descriptive, inferential statistics and a thematic analysis approach through SPSS25 and MAXQDA2020 software.

Results: A total of 574 medical teachers enrolled in our survey. Midterm university exams and internal-university language tests were selected, by responders, as a suitable option for holding online assessments. Other summative or sensitive assessments were not eligible to use this process. We also extracted 640 codes related to challenges and solution approaches. The significant difficulties were the problems in the executive infrastructure (124codes), and improving the implementation of online testing (84 codes) was considered the best feasible solution in teachers' perceptions.

Conclusion: The results showed that teachers believed that high-stake tests, according to the current technical and cultural infrastructure, are not far from the mind and access. Still, there is a critical need to explore more to provide a stable and reliable online exams environment.
Keywords
Assessments, Take-home exams
COVID-19
Thematic analysis
Cheating
Medical Education  
  1. Bengtsson L. Take-Home Exams in Higher Education: A Systematic Review. Educ Sci, 2019; 9(4): 267.
  2. Guangul FM, Suhail AH, Khalit MI et al. Challenges of remote assessment in higher education in the context of COVID-19: a case study of Middle East College. Educ Asse Eval Acc 2020; 32: 519–35.
  3. Golub E. Pcs in the classroom and open book exams. Ubiquity. 2005 Mar 1; 2005 (March):1-; https://doi.org/10.1145/1066348.1066320
  4. Fuller R, Joynes V, Cooper J, Boursicot K. Roberts T. Could COVID-19 be our ‘there is no alternative’ (TINA) opportunity to enhance assessment? Med Teach. 2020; 42(7): 781–86.
  5. Cluskey Jr G, Ehlen C.R, Raiborn M.H. Thwarting online exam cheating without proctor supervision. Journal of Academic and Business Ethics. 2011; 4: 1–7.
  6. Alessio HM, Malay N, Maurer K, Bailer AJ, Rubin B. Examining the effect of proctoring on online test scores. Online Learn. 2017; 21: 146–61.
  7. Bilena E, Matrosa, A. Online cheating amid COVID-19. J Econ Behav Organ, 2021; 182: 196-211.
  8. Pesha AV, Kamarova TA. Online education: Challenges and opportunities for developing key competencies of the 21st century during the COVID-19 pandemic. Research Technologies of Pandemic Coronavirus Impact (RTCOV 2020). 2020:155-60.
  9. Chirumamilla A, Sindre G, Nguyen-Duc A. Cheating in e-exams and paper exams: the perceptions of engineering students and teachers s in Norway. Assess Eval High Educ. 2020;45(7):940-57.
  10. Li M, Luo L, Sikdar S, Nizam NI, Gao S, Shan H, et al. Optimized collusion prevention for online exams during social distancing. npj Sci. Learn. 2021; 6(5): 1-9.
  11. Papapanou M, Routsi E, Tsamakis K, Fotis L, Marinos G, Lidoriki I,  et al. Medical education challenges and innovations during COVID-19 pandemic. Postgrad Med J. 2021;0:1–7.
  12. Elzainy A, El Sadik A, Al Abdulmonem W. Experience of e-learning and online assessment during the COVID-19 pandemic at the College of Medicine, Qassim University. J. Taibah Univ. Medical Sci. 2020; 15(6):456-62.
  13. Mukhtar K Javed K, Arooj M, Sethi A. Advantages, Limitations and Recommendations for online learning during COVID-19 pandemic era. 2020; 36(COVID19-S4): COVID19-S27-S31. doi: https://doi.org/10.12669/pjms.36.COVID19-S4.2785
  14. Eaton SE. Academic Integrity during COVID-19: Reflections from the University of Calgary. Int Stud Educ Admin, 2020; 48(1): 80-85. http://hdl.handle.net/1880/112293
  15. Tindall I, Curtis G. Negative Emotionality Predicts Attitudes toward Plagiarism. J Acad Ethics. 2020; 18: 89-102.
  16. Hylton K, Levy Y, Dringus, LP. Utilizing webcam-based proctoring to deter misconduct in online exams. Comput Educ. 2016; 92: 53-63.
  17. The TOEFL® Test. Available from: https://www.ets.org/toefl
  18. Khan ZR, Hemnani P, Raheja S, Joshy, J. Raising Awareness on Contract Cheating –Lessons Learned from Running Campus-Wide Campaigns. J Acad Ethics. 2020; 18: 175–91.
  19. McKenzie A. COVID-19: A Silver Lining for Academic Integrity from a Pandemic. Canadian Perspectives on Academic Integrity, 2020; 3(2): 23-5.  
  20. Fask A, Englander F, Wang Z. Do online exams facilitate cheating? An experiment designed to separate possible cheating from the effect of the online test taking environment. J Acad Ethics. 2014; 12(2):101-12.
  21. Chatzigavriil A, Fernando T. Law e-assessment pilot study The London School of Economics and Political Science, Learning Technology and Innovation, London, UK. 2015.
  22. Myyry L, Joutsenvirta T. Open-book, open-web online examinations: Developing examination practices to support university students’ learning and self-efficacy. Active Learn High Educ.  2015; 16(2): 119-32.
  23. Lancaster T, Clarke R. Rethinking assessment by examination in the age of contract cheating. In Proceedings of the Plagiarism Across Europe Beyond, Brno, Czech Republic, 24–26 May 2017; ENAI: Brno, Czech Republic. 215–228
  24. Mayring P. Qualitative Content Analysis Qualitative Social Research.2002; 1(2). Available from http://www.qualitative-research.net/
  25. Hsiu-Fang H, and Shannon SE. Three models of uses and effect. Diplomacy & Statecraft, 2005; 12:2,1-28.
  26. Creswell J. Research design, qualitative and mixed methods approach, 2th edition. California: Sage publication; 2003.
  27. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006; 3(2):77-101.
  28. Sam AH, Reid MD, Amin A. High‐stakes remote‐access open‐book examinations. Medical education. 2020;54(8): 767-8
  29. Ullah A, Xiao H, Lilley M. Profile based student authentication in online examination. In International Conference on Information Society (i-Society 2012) 2012 Jun 25 (pp. 109-113). IEEE.
  30. Bailie JL, Jortberg MA. Online learner authentication: Verifying the identity of online users. J Online Learn Teach. 2009; 5(2):197-207.
  31. 44 Ullah A, Xiao H, Lilley M, Barker T. Using challenge questions for student authentication in online examination. International Journal for Infonomics (IJI). 2012; 5(3/4):9.
  32. López D, Cruz JL, Sánchez F, Fernández A. (2011, October). A take-home exam to assess professional skills. In 2011 Frontiers in Education Conference (FIE) (pp. F1C-1). IEEE.
  33. Clark TM, Callam CS, Paul NM, Stoltzfus MW, Turner D. Testing in the time of COVID-19: A sudden transition to un-proctored online exams. J. Chem. Educ. 2020; 97(9):3413-7.
  34. Lancaster T. Academic integrity for computer science instructors. In Higher education computer science 2018; (pp. 59-71). Springer, Cham.
  35. Okada A, Noguera I, Alexieva L, Rozeva A, Kocdar S, Brouns F, et al. Pedagogical approaches for e‐assessment with authentication and authorship verification in Higher Education. Br J Educ Tech. 2019;50(6):3264-82.
  36. Deborah LR. Cheating: Ethics in Everyday Life 1st Edition, Kindle Edition, Oxford University Press; 1 edition (October 18, 2017).
  37. Rahim AF. Guidelines for online assessment in emergency remote teaching during the COVID-19 pandemic. Educ Med J. 2020; 12(2):59-68.
  38. Golden J, Kohlbeck M. Addressing cheating when using test bank questions in online Classes. J Account Educ. 2020; 52:100671.
  39. Tan CK, Chua WL, Vu CK, Chang JP. High-stakes examinations during the COVID-19 pandemic: to proceed or not to proceed, that is the question. Postgrad Med. 2021; 97(1149):427-31.
  40. Birch E, de Wolf M. A novel approach to medical school examinations during the COVID-19 pandemic. Med Educ Online. 2020; 25(1):1785680.
  41. Pace EJ, Khera GK. The equity of remote-access open-book examinations during Covid-19 and beyond: Medical students’ perspective. Med teach. 2020;42(11):1314.
Future of Medical Education Journal
Volume 12, Issue 3
Summer 2022
Pages 29-36