Online vs Paper Examination in University EFL courses

Marija Stevkovska

doi:10.34301/alsc.v6i2.42

Authors

Marija Stevkovska International Balkan University

DOI:

https://doi.org/10.34301/alsc.v6i2.42

Keywords:

online examination, pen-and-paper tests, test design, academic dishonesty.

Abstract

Universities have long been struggling with academic dishonesty in both online and pen-and-paper examinations. Different authors have suggested various deterrents to decrease cheating during exams. The aim of this study is to investigate how the online environment affects academic dishonesty during online exams and to compare students’ behaviour during written and paper exams. The hypotheses tested is that there is a significant difference between mean values of the results achieved on pen-and-paper tests and online tests. The research adopted a cross-sectional study design. The Wilcoxon Signed Ranks Test confirmed the hypothesis as it showed that the scores on the online exam (mean rank = 35.9) were statistically higher than the ones on the pen-and-paper test (mean rank = 28.3), Z= -3.311, p=0.001 with a small effect size r = 0.29. This could be due to the test format and insufficient proctoring technology. Online cheating could be minimized by giving priority to formative assessment, by raising students’ awareness of the negative consequences of academic dishonesty, and implementing more sophisticated technologies to track students’ behavior during online exams. Additionally, multiple-choice questions should be replaced by open-ended questions. Finally, a speaking section could be added to online tests, which is to be passed successfully in order for students to receive a passing grade for the EFL course.

Downloads

Download data is not yet available.

References

Baumratner, J. (2022). Teaching Tools: Active Learning while Physically Distancing. Lousiana State University. https://docs.google.com/document/d/15ZtTu2pmQRU_eC3gMccVhVwDR57PDs4uxlMB7Bs1os8/edit?fbclid=IwAR2dypWOhTw8P-zHsQJeAKdsiWEJ7hnH8ZD7h7xSrhjruKPdsEkOevB9G9Y#heading=h.yjx9jic56h5n

Benson, R. and Brack, C. (2010). Online learning and assessment in higher education. 107–53. https://doi.org/10.1016/b978 -1-84334-577-0.50004-3

Best practices for on-line academic integrity [Internet]. 2020. [cited 26 Apr 2020]. Available from: https://iup.edu/ itsupportcenter/content-repository/academic -services/moodle/best-practices-for-on-line -academic-integrity/

Bilen, E. and Matros, A. (2021). Online Cheating amid COVID 19. Journal of Economic Behavior and Organization.182: 116-121.

Boitshwarelo, B., Reedy, A.K., and Trevor, B. (2017). Envisioning the use of online tests in assessing twenty-first century learning: a literature review. RPTEL 12, 16.https://doi.org/10.1186/s41039-017-0055-7

Butler-Henderson, K. and Crawford.J. (2020). A systematic review of online examinations: A pedagogical innovation for scalable authentication and integrity. Computers & Education, 159, pp. 1-12

Candrlic, S., Asenbrener-Katic, M, and Holenko Dlab, M. (2014). Online vs. Paper-Based Testing: A Comparison of Test Results. 775-780. 10.1109. MIPRO.2014.6859649.

Cucinotta, D., and Vanelli, M. (2020). WHO declares COVID-19 a pandemic. Acta Bio-Medica: AteneiParmensis, 91(1): 157-160.

Dendir, S., and Maxwell, S. (2020). Cheating in online courses: Evidence from online proctoring. Computers in Human Behavior Reports, Volume 2, ISSN 2451-9588, https://doi.org/10.1016/j.chbr.2020.100033.

Djenno, M., Insua, G.M., and Pho, A. (2015). From paper to pixels: using Google Forms for collaboration and assessment. Library Hi Tech News 32, 4: 9–13.

Dyer, J.M., Pettyjohn, H.C., Saladin, S. (2020). Academic dishonesty and testing: how student beliefs and test settings impact decisions to cheat. Journal of the National College testing Association, 4 (1): 1-30.

Fischbacher, U., and Föllmi-Heusi, F. (2013). Lies in Disguise-An Experimental Study on Cheating. Journal of the European Economic Association, 11(3): 525–547.

Gächter, S., and Schulz, J.F. (2016). Intrinsic Honesty And The Prevalence Of Rule Violations Across Societies. Nature, 531(7595): 496–499.

Gneezy, U. (2005). Deception: The Role of Consequences. American Economic Review, 95(1): 384–394.

Grijalva, T., Nowell, C., and Kerkvliet, J. (2006). Academic honesty and online courses. College Student Journal, 40(1): 180-185

Hasan, M., Islam, S., Shuchi, I.J. (2021). Using Mobile-Based Formative Assesment in ESL/EFL Speaking. JOLLT Journal of Languages and Language Teaching, Vol.9 , No.1 pp. 117-125. DOI: https://doi.org/10.33394/jollt.v9i1.3449

Humbarger, M., and DeVaney, S.A. (2005). Ethical values in the classroom: How college students responded. Journal of Family and Consumer Sciences, 97 (3): 40-47.

Ivanova, S., Sazonova, N., and Lavrova, A. (20180. Advantages, Disadvantages and Limitations of Using Google Forms for Online Tests (A Case Study of a Russian University). In M. Vlada, G. Albeanu, A. Adascalitei, & M. Popovici (Eds.), Proceedings f the 13th international conference on virtual learning, ICVL 2018: 142-148.Bucharest University Press.

King, C. G., Guyette, R.W., and Piotrowski, C. (2009). Online exams and cheating: An empirical analysis of business students’ views. The Journal of Educators Online, 6(1):1-11.

Kohlberg, L. (1971). Stages of moral development as a basis for moral education. In C.M. Beck, B. S. Crittenden and E. V. Sullivan (eds), Moral Education: Interdisciplinary Approaches (University of Toronto Press, 197l, pp 23–92).

Kolowich, S. (2016, October 26). Behind the webcam’s watchful eye, online proctoring takes hold. The Chronicle of Higher Education. Retrieved from https://www.chronicle.com/ resource/how-students-cheat-in-a-high-t/6122.

Krueger, K. (2015). How to catch students cheating on online tests [Internet]. [cited16 March 2021]. http://mediashift.org/ 2015/08/how-to-catch-students-cheating-on -online-tests/

Kujundziski, A., P. (2021).“Higher Education in an Online Environment – A Brief Overview of the Experience of International Balkan University.”IBU International Journal of Technical and Natural Sciences, Vol.1 Issue 2.

Lanier, M. (2006). Academic integrity and distance learning. Journal of Criminal Justice Education. 17(2): 244-261.

Lee, Jihyun, Ryan Jinyoung Kim, Shin-Young Park, and Marcus A. Henning. 2020. Using technologies to preventcheating in remote assessments during theCOVID-19 pandemic. Journal of Dental Education. 2020: 1-3. https://doi.org/10.1002/jdd.12350.

Mansor, A. Z. (2012). Top five creative ideas using web 2.0. Procedia – Social and Behavioral Sciences 59: 429–437.

McCabe, D. L., Kennetth, D. Butterfield, and Trevino, L.K. (2012). Cheating in College: Why Students do itand what Educators can do about it. Baltimore:Johns Hopkins University Press.

Miller, A., & Young-Jones, A. D. (2012). Academic integrity: Online classes compared to faceto-face classes. Journal of Instructional Psychology, 39(3), 138-145.

Nguyen, J. G. , Keuseman, K.J., and Humston, J.J. (2020). Minimize Online Cheating for Online Assessments During COVID-19 Pandemic. Chemical Education. 97, 9: 3429–3435. Publication date:August 3, 2020. https://doi.org/10.1021/acs.jchemed.0c00790

Niiya, Y., Ballantyne, R., North, M.C., and Crocker, J. (2008). Gender, contingencies of self-worth, and achievement goals as predictors of academic cheating in a controlled laboratory setting. Basic and Applied Social Psychology 30 (1): 76-83.

Noorbehbahani, F., Mohammadi, A. & Aminazadeh, M. A systematic review of research on cheating in online exams from 2010 to 2021. Educ Inf Technol (2022). https://doi.org/10.1007/s10639-022-10927-7

Peterson, J. (2019). “An Analysis of Academic Dishonesty in Online Classes”. Mid-Western Educational Researcher, Vol.31, Issue 1,pp. 24-36.

The realities of cheating in online classes & exams [Internet]. OnlineEducation. 2020 [cited 16 March 2021]. Available from: https://www.onlineeducation.com/features/ cheating-in-online-education.

Rahim, A. F. A. (2020). Guidelines for online assessment in emergency remote teaching during the COVID-19 pandemic. Education in Medical Journal. 2020; 12(2):59–68. https://doi.org/10.21315/eimj2020.12.2.6.

Ross, J. (2020). Crisis-driven online exam shift ‘chance to boost academic integrity. Times Higher Education (THE). [cited 15 March 2021]. https://www.timeshighereducation.com/news/crisis -driven-online-exam-shift-chance-boost -academic-integrity.

Samaie, M., Nejad, A. M., & Qaracholloo, M. (2016). An inquiry into the efficiency of WhatsApp for self and peer- assessments of oral language proficiency. British Journal of Educational Technology, 49 (1), pp.111-126.

Stonecypher, K.; Wilson, P. (2014). Academic Policies and Practices to Deter Cheating in Nursing Education, Nursing Education Perspectives, Vol.5, Issue 3, pp 167-179. doi: 10.5480/12-1028.1

Stuber-McEwen, D., Wiseley, P., and Hoggatt, S. (2009). Point, click, and cheat: Frequency and type of academic dishonesty in the virtual classroom. Online Journal of Distance Learning Administration. 12(3): 1-10.

Vanberg, C. (2017). Who Never Tells a Lie. Experimental Economics. 20(2): 448–459.

Wang, S., Hsu, H., Campbell, T., Coster, D., & Longhurst, M. (2014). An investigation of middle school science teachers’ and students’ use of technology inside and outside of classrooms: considering whether digital natives are more technology-savvy than their teachers. Educational Technology Research and Development, 62(6), 637.

Watson, G. R., and Sottile. J. (2010). Cheating in the Digital Age: Do Students Cheat More in Online Courses? Online Journal of Distance Learning Administration 13.1.n.pag.Web.

Williamson, M. H. (2018). Online Exams: The Need for Best Practices and Overcoming Challenges. The Journal of Public and Professional Sociology: Vol. 10 : Iss. 1 , Article 2. Available at: https://digitalcommons.kennesaw.edu/jpps/vol10/iss1/2

Woldeab, D., and Brothen, T. (2019). Online proctoring, test anxiety, and student performance. International Journal of E-Learning & Distance Education, 34 (1): 1-10.

Wolverton, B. (2016, August 28). The new cheating economy. The Chronicle of Higher Education. Retrieved from https://www.chronicle.com/article/The-New-CheatingEconomy/237587

Young, J.R. (2012). Online classes see cheating go high-tech. The Chronicle of Higher Education, 58: A24-A26.

Zogheib, S. (2014). Factors affecting pre-service teachers’ computer use for general purposes: Implications for computer training courses. Journal of Educational Technology Systems, 43(1), 35–53.