ChatGPT and Education: A Systematic Review

  1. Pattier, Daniel 1
  1. 1 Universidad Complutense de Madrid
    info

    Universidad Complutense de Madrid

    Madrid, España

    ROR 02p0gd045

Journal:
Revista Entropía Educativa

ISSN: 2981-4723

Year of publication: 2024

Volume: 2

Issue: 1

Pages: 80-102

Type: Article

GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Revista Entropía Educativa

Abstract

With the aim of establishing an evidence-based theoretical framework on the use of ChatGPT in the educational field, this paper presents a systematic review following the PRISMA methodology. The study includes scientific articles on the subject published in SCOPUS up until October 2023, resulting in a final sample of 58 publications. The findings highlight the advantages and disadvantages of this tool in education, key factors, and successful educational experiences. In conclusion, the research underscores the pressing need to foster a culture of adaptability and ethical awareness to ensure the effective integration of transformative technologies like ChatGPT into educational practices. Furthermore, it advocates for the implementation of robust mechanisms for critical reflection, regulatory oversight, and ethical training, directed towards both educators and students. The limitation of this study lies in the fact that it addresses an emerging and rapidly evolving topic. This paper offers important implications for the use of ChatGPT and similar applications in education.

€ View funding

Funding information

Trabajo financiado por el Ministerio de Ciencia e Innovación de España a través del proyecto I+D+i “El imperativo de la innovación educativa: análisis de su recepción y articulación en el sistema educativo español (IMP-NOVA)”

Funders

  • Ministerio de Ciencia e Innovación Spain
    • PID2022-138878NA-I00

Bibliographic References

  • Ajevski, M., Barker, K., Gilbert, A., Hardie, L., & Ryan, F. (2023). ChatGPT and the future of legal education and practice. The Law Teacher, 57(3), 352-364. https://doi.org/10.1080/03069400.2023.2207426
  • • Alasadi, E. A., & Baiz, C. R. (2023). Generative AI in Education and Research: Opportunities, Concerns, and Solutions. Journal of Chemical Education, 100(8), 2965-2971. https://doi.org/10.1021/acs.jchemed.3c00323
  • • Alexander, P. A. (2020). Methodological guidance paper: The art and science of quality systematic reviews. Review of Educational Research, 90(1), 6-23. https://doi.org/10.3102/0034654319854352
  • • Ali, K., Barhom, N., Tamimi, F., & Duggal, M. (2023). ChatGPT—A double‐edged sword for healthcare education? Implications for assessments of dental students. European Journal of Dental Education, 1-6. https://doi.org/10.1111/eje.12937
  • • Al-Tkhayneh, K. M., Alghazo, E. M., & Tahat, D. (2023). The Advantages and Disadvantages of Using Artificial Intelligence in Education. Journal of Educational and Social Research, 13(4), 105-117. https://doi.org/10.36941/jesr2023-0094
  • • Bitzenbauer, P. (2023). ChatGPT in physics education: A pilot study on easy-to-implement activities. Contemporary Educational Technology, 15(3), ep430. https://doi.org/10.30935/cedtech/13176
  • • Bogina, V., Hartman, A., Kufic, T., & Shulner-Tal, A. (2022). Educating Software and AI Stakeholders about Algorithmic Fairness, Accountability, Transparency and Ethics. International Journal of Artificial Intelligence in Education, 32(3), 808-833. https://doi.org/10.1007/s40593-021-00248-0
  • • Borger, J. G., Ng, A. P., Anderton, H., Ashdown, G. W., Auld, M., Blewitt, M. E., ... & Naik, S. H. (2023). Artificial intelligence takes center stage: exploring the capabilities and implications of ChatGPT and other AI‐assisted technologies in scientific research and education. Immunology and Cell Biology, 101, 923-935. https://doi.org/10.1111/imcb.12689 • Breeding T, Martinez B, Patel H, et al. The Utilization of ChatGPT in Reshaping Future Medical Education and Learning Perspectives: A Curse or a Blessing? The American SurgeonTM, 1-7. https://doi.org/10.1177/00031348231180 • Cassidy, C. (2023, 17 de enero). Lecturer detects bot-use in one fifth of assessments as concerns mount over AI in exams. The Guardian. http://bit.ly/47v8HbW • Castonguay, A., Farthing, P., Davies, S., Vogelsang, L., Kleib, M., Risling, T., & Green, N. (2023). Revolutionizing nursing education through Ai integration: A reflection on the disruptive impact of ChatGPT. Nurse Education Today, 129, 105916. https://doi.org/10.1016/j.nedt.2023.105916 • Chaudhry, I. S., Sarwary, S. A. M., El Refae, G. A., & Chabchoub, H. (2023). Time to Revisit Existing Student’s Performance Evaluation Approach in Higher Education Sector in a New Era of ChatGPT—A Case Study. Cogent Education, 10(1), 2210461. https://doi.org/10.1080/2331186X.2023.2210461
  • • Chiu, T. K. (2023). The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney. Interactive Learning Environments, 1-17. https://doi.org/10.1080/10494820.2 023.2253861
  • • Choi, E. P. H., Lee, J. J., Ho, M. H., Kwok, J. Y. Y., & Lok, K. Y. W. (2023). Chatting or cheating? The impacts of ChatGPT and other artificial intelligence language models on nurse education. Nurse Education Today, 125, 105796. https://doi.org/10.1016/j.nedt.2023.105796
  • • Choudhary, O. P., Saini, J., Challana, A. (2023). ChatGPT for Veterinary Anatomy Education: An Overview of the Prospects and Drawbacks. International Journal of Morphology, 41(4), 1198-1202. http://dx.doi.org/10.4067/S0717- 95022023000401198
  • • Cooper, G. (2023). Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence. Journal of Science Education and Technology, 32, 444–452. https://doi.org/10.1007/s10956-023-10039-y
  • • Currie, G., Singh, C., Nelson, T., Nabasenja, C., Al-Hayek, Y., & Spuur, K. (2023). ChatGPT in medical imaging higher education. Radiography, 29(4), 792- 799. https://doi.org/10.1016/j.radi.2023.05.011
  • • Dalalah, D., & Dalalah, O. M. (2023). The false positives and false negatives of generative AI detection tools in education and academic research: The case of ChatGPT. The International Journal of Management Education, 21(2), 100822. https://doi.org/10.1016/j.ijme.2023.100822
  • • Duan, Y., Edwards, J. S., & Dwivedi, Y. K. (2019). Artificial intelligence for decision making in the era of Big Data–evolution, challenges and research agenda. International Journal of Information Management, 48, 63-71. https://doi.org/10.1016/j.ijinfomgt.2019.01.021
  • • Ellis, A. R., & Slade, E. (2023). A New Era of Learning: Considerations for ChatGPT as a Tool to Enhance Statistics and Data Science Education. Journal of Statistics and Data Science Education, 31(2), 128-133. https://doi.org/10.1080/26939169.2023.2223609
  • • Fernández Herrero, J., Gómez Donoso, F., & Roig Vila, R. (2023). The first steps for adapting an artificial intelligence emotion expression recognition software for emotional management in the educational context. British Journal of Educational Technology, 54, 1939 –1963. https://doi.org/10.1111/bjet.13326
  • • Fiialka, S., Kornieva, Z., Honcharuk, T. (2023). ChatGPT in Ukrainian Education: Problems and Prospects. International Journal of Emerging Technologies in Learning (iJET), 18(17), 236–250. https://doi.org/10.3991/ijet.v18i17.42215
  • • Flynn, J. (2023). 15+ Incredible ChatGPT statistics [2023]: AI, users, and trends. Zippia. https://bit.ly/46g3iEq
  • • Forero-Corba, W., & Negre Bennasar, F. (2023). Techniques and applications of Machine Learning and Artificial Intelligence in education: a systematic review. RIED-Revista Iberoamericana De Educación a Distancia, 27(1). https://doi.org/10.5944/ried.27.1.37491
  • • Fütterer, T., Fischer, C., Alekseeva, A., Chen, X., Tate, T., Warschauer, M., & Gerjets, P. (2023). ChatGPT in education: global reactions to AI innovations. Scientific Reports, 13, 15310. https://doi.org/10.1038/s41598-023-42227-6
  • • Gill, S. S., Xu, M., Patros, P., Wu, H., Kaur, R., Kaur, K., ... & Buyya, R. (2024). Transformative effects of ChatGPT on modern education: Emerging Era of AI Chatbots. Internet of Things and Cyber-Physical Systems, 4, 19-23. https://doi.org/10.48550/arXiv.2306.03823
  • • Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Medical Education, 9, e45312. https://doi.org/10.2196/45312
  • • González-González, C.; Violant Holz, V.; Infante Moro, A.; Cáceres García, L. & Guzmán Franco, M.D. (2021). Educational robotics in inclusive contexts: The case of the hospital classrooms. Educación XX1, 24(1), 375-403, http://doi.org/10.5944/educXX1.27047
  • • Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421. https://doi.org/10.30935/cedtech/13036
  • • Hwang, G. J., Xie, H., Wah, B. W., & Gašević, D. (2020). Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers & Education: Artificial Intelligence, 1, 100001. https://doi.org/10.1016/j.caeai.2020.100001
  • • Intelligent. (2023, 23 de enero). Nearly 1/3 college students have used ChatGPT on written assessments. Intelligent. https://bit.ly/3QzeKoQ
  • • Ivanov, S., & Soliman, M. (2023). Game of algorithms: ChatGPT implications for the future of tourism education and research. Journal of Tourism Futures, 9(2), 214-221. https://doi.org/10.1108/JTF-02-2023-0038
  • • Jeon, J., & Lee, S. (2023). Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT. Education and Information Technologies, 1-20. https://doi.org/10.1007/s10639-023-11834-1
  • • Karakose, T., Demirkol, M., Aslan, N., Köse, H., & Yirci, R. (2023). A conversation with ChatGPT about the impact of the COVID-19 pandemic on education: Comparative review based on human–AI collaboration. Educational Process: International Journal, 12(3), 7-25. https://doi.org/10.22521/edupij.2023.123.1
  • • Keiper, M. C., Fried, G., Lupinek, J., & Nordstrom, H. (2023). Artificial intelligence in sport management education: Playing the AI game with ChatGPT. Journal of Hospitality, Leisure, Sport & Tourism Education, 33, 100456. https://doi.org/10.1016/j.jhlste.2023.100456
  • • Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023). ChatGPT-Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences, 39(2), 605-607. https://doi.org/10.12669/pjms.39.2.7653
  • • Khurma, O. A., Ali, N., & Hashem, R. (2023). Critical Reflections on ChatGPT in UAE Education: Navigating Equity and Governance for Safe and Effective Use. International Journal of Emerging Technologies in Learning, 18(14), 188- 199. https://doi.org/10.3991/ijet.v18i14.40935
  • • Kostka, I., & Toncelli, R. (2023). Exploring applications of ChatGPT to English language teaching: Opportunities, challenges, and recommendations. The Electronic Journal for English as a Second Language, 27(3). https://doi.org/10.55593/ej.27107in • Lake, B.M., & Baroni, M. (2023). Human-like systematic generalization through a meta-learning neural network. Nature, 623, 115-121. https://doi.org/10.1038/s41586-023-06668-3
  • • Lee, H. (2023). Using ChatGPT as a learning tool in acupuncture education: comparative study. JMIR Medical Education, 9, e47427. https://doi.org/10.2196/47427
  • • Loos, E., Gröpler, J., & Goudeau, M. L. S. (2023). Using ChatGPT in Education: Human Reflection on ChatGPT’s Self-Reflection. Societies, 13(8), 196. https://doi.org/10.3390/soc13080196
  • • Lower, K., Seth, I., Lim, B., & Seth, N. (2023). ChatGPT-4: transforming medical education and addressing clinical exposure challenges in the post-pandemic era. Indian Journal of Orthopaedics, 57, 1527–1544. https://doi.org/10.1007/s43465-023-00967-7
  • • Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., & Gerardou, F. S. (2023). Challenges and Opportunities of Generative AI for Higher Education as Explained by ChatGPT. Education Sciences, 13(9), 856. https://doi.org/10.3390/educsci13090856
  • • Mohammed, M., Kumar, N., Zawiah, M., Al-Ashwal, F. Y., Bala, A. A., Lawal, B. K., ... & Sha’aban, A. (2023). Psychometric Properties and Assessment of Knowledge, Attitude, and Practice towards ChatGPT in Pharmacy Practice and Education: A Study Protocol. Journal of Racial and Ethnic Health Disparities, 1-10. https://doi.org/10.1007/s40615-023-01696-1
  • • Moor, J. (2006). The Dartmouth College Artificial Intelligence Conference: The Next Fifty Years. AI Magazine, 27(4), 87-91. https://doi.org/10.1609/aimag. v27i4.1911
  • • Naidu, K., & Sevnarayan, K. (2023). ChatGPT: An ever-increasing encroachment of artificial intelligence in online assessment in distance education. Online Journal of Communication and Media Technologies, 13(3), e202336. https://doi.org/10.30935/ojcmt/13291
  • • Ngo, T.T.A. (2023). The Perception by University Students of the Use of ChatGPT in Education. International Journal of Emerging Technologies in Learning (iJET), 18(17), 4–19. https://doi.org/10.3991/ijet.v18i17.39019
  • • Nikolic, S., Daniel, S., Haque, R., Belkina, M., Hassan, G. M., Grundy, S., ... & Sandison, C. (2023). ChatGPT versus engineering education assessment: a multidisciplinary and multi-institutional benchmarking and analysis of this generative artificial intelligence tool to investigate assessment integrity. European Journal of Engineering Education, 48(4), 559-614. https://doi.org/10.1080/03043797.2023.2213169
  • • Oh, N., Choi, G. S., & Lee, W. Y. (2023). ChatGPT goes to the operating room: evaluating GPT-4 performance and its potential in surgical education and training in the era of large language models. Annals of Surgical Treatment and Research, 104(5), 269-273. https://doi.org/10.4174/astr.2023.104.5.269
  • • Page, M. J., McKenzie, J., E., Bossuyt, P., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J., & Moher, D. (2021). Updating guidance for reporting systematic reviews: development of the PRISMA 2020 statement. Journal of Clinical Epidemiology, 134, 103-112. https://doi.org/10.1016/j.jclinepi.2021.02.003
  • • Pattier, D. (2024). Inteligencia artificial y revisiones sistemáticas: Una experiencia con ChatGPT. En I. Cabero Fayos (Coord.), Perspectivas contemporáneas en educación: innovación, investigación y transformación (pp. 1156-1177). Dykinson.
  • • Pattier, D., & Reyero, D. (2022). Contributions from the theory of education to the investigation of the relationships between cognition and digital technology. Educación XX1, 25(2), 223-241. https://doi.org/10.5944/educxx1.31950
  • • Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism & Mass Communication Educator, 78(1), 84-93. https://doi. org/10.1177/107769582211495
  • • Pisica, A. I., Edu, T., Zaharia, R. M., & Zaharia, R. (2023). Implementing Artificial Intelligence in Higher Education: Pros and Cons from the Perspectives of Academics. Societies, 13(5), 118. https://doi.org/10.3390/soc13050118
  • • Rahimzadeh, V., Kostick-Quenet, K., Blumenthal Barby, J., & McGuire, A. L. (2023). Ethics education for healthcare professionals in the era of chatGPT and other large language models: Do we still need it?. The American Journal of Bioethics, 23(10), 17-27. https://doi.org/10.1080/15265161.2023.2233358
  • • Rahman, M. M., & Watanobe, Y. (2023). ChatGPT for education and research: Opportunities, threats, and strategies. Applied Sciences, 13(9), 5783. https://doi.org/10.3390/app13095783
  • • Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., ... & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning and Teaching, 6(1), 41-56. https://doi.org/10.37074/jalt.2023.6.1.29
  • • Rawas, S. (2023). ChatGPT: Empowering lifelong learning in the digital age of higher education. Education and Information Technologies, 1-14. https://doi.org/10.1007/s10639-023-12114-8
  • • Rodrigues, O. S., & Rodrigues, K. S. (2023). Artificial intelligence in education: the challenges of ChatGPT. Texto Livre, 16, e45997. https://doi.org/10.1590/1983-3652.2023.45997
  • • Rudolph, J., Tan, S., & Tan, S. (2023a). War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. Journal of Applied Learning and Teaching, 6(1), 364-389. https://doi.org/10.37074/jalt.2023.6.1.23
  • • Rudolph, J., Tan, S., & Tan, S. (2023b). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of Applied Learning and Teaching, 6(1), 342-363. https://doi.org/10.37074/jalt.2023.6.1.9
  • • Sallam, M., Salim, N., Barakat, M., & Al-Tammemi, A. (2023). ChatGPT applications in medical, dental, pharmacy, and public health education: A descriptive study highlighting the advantages and limitations. Narra J, 3(1), e103. http://doi.org/10.52225/narra.v3i1.103
  • • Sánchez-Ruiz, L. M., Moll-López, S., Nuñez-Pérez, A., Moraño-Fernández, J. A., & Vega-Fleitas, E. (2023). ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Applied Sciences, 13(10), 6039. https://doi.org/10.3390/app13106039
  • • Sedaghat, S. (2023). Early applications of ChatGPT in medical practice, education and research. Clinical Medicine, 23(3), 278-279. https://doi.org/10.7861/clinmed.2023-0078
  • • Sharma, M., & Sharma, S. (2023). A holistic approach to remote patient monitoring, fueled by ChatGPT and Metaverse technology: The future of nursing education. Nurse Education Today, 131, 105972. https://doi.org/10.1016/j.nedt.2023.105972
  • • Singh, H., Tayarani-Najaran, M. H., & Yaqoob, M. (2023). Exploring Computer Science Students’ Perception of ChatGPT in Higher Education: A Descriptive and Correlation Study. Education Sciences, 13(9), 924. https://doi.org/10.3390/educsci13090924
  • • Su, J., & Yang, W. (2023). Unlocking the power of ChatGPT: A framework for applying generative AI in education. ECNU Review of Education, 6(3), 355-366. https://doi.org/10.1177/20965311231168423
  • • Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning & Teaching, 6(1), 31-40. https://doi.org/10.37074/jalt.2023.6.1.17
  • • Tlili, A., Shehata, B., & Adarkwah, M. A. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(15), 1-24. https://doi.org/10.1186/s40561-023-00237-x
  • • Topol, E. J. (2019). High-performance medicine: the convergence of human and artificial intelligence. Nature Medicine, 25(1), 44-56. https://doi.org/10.1038/s41591-018-0300-7
  • • Totlis, T., Natsis, K., Filos, D., Ediaroglou, V., Mantzou, N., Duparc, F., & Piagkou, M. (2023). The potential role of ChatGPT and artificial intelligence in anatomy education: a conversation with ChatGPT. Surgical and Radiologic Anatomy, 45, 1321-1329. https://doi.org/10.1007/s00276-023-03229-1
  • • Uddin, S. J., Albert, A., Ovid, A., & Alsharef, A. (2023). Leveraging ChatGPT to Aid Construction Hazard Recognition and Support Safety Education and Training. Sustainability, 15(9), 7121. https://doi.org/10.3390/su15097121
  • • Vargas-Murillo, A. R., de la Asuncion, I. N. M., & de Jesús Guevara-Soto, F. (2023). Challenges and Opportunities of AI-Assisted Learning: A Systematic Literature Review on the Impact of ChatGPT Usage in Higher Education. International Journal of Learning, Teaching and Educational Research, 22(7), 122-135. https://doi.org/10.26803/ijlter.22.7.7
  • • Vicente-Yagüe-Jara, M.I., López-Martínez, O., Navarro-Navarro, V., & Cuéllar-Santiago, F. (2023). Writing, creativity, and artificial intelligence. ChatGPT in the university context. Comunicar, 77, 47-57. https://doi.org/10.3916/C77-2023-04
  • • Wandelt, S., Sun, X., & Zhang, A. (2023). AI-driven assistants for education and research? A case study on ChatGPT for air transport management. Journal of Air Transport Management, 113, 102483. https://doi.org/10.1016/j.jairtraman.2023.102483
  • • Wang, H., Wu, W., Dou, Z., He, L., & Yang, L. (2023). Performance and exploration of ChatGPT in medical examination, records and education in Chinese: Pave the way for medical AI. International Journal of Medical Informatics, 177, 105173. https://doi.org/10.1016/j.ijmedinf.2023.105173
  • • Wang, J., Tang, Y., Hare, R., Wang, F. Y. (2023). Parallel intelligent education with ChatGPT. Frontiers of Information Technology & Electronic Engineering, 1-7. https://doi.org/10.1631/FITEE.2300166
  • • Wu, T. T., Lee, H. Y., Wang, W. S., Lin, C. J., & Huang, Y. M. (2023). Leveraging computer vision for adaptive learning in STEM education: effect of engagement and self-efficacy. International Journal of Educational Technology in Higher Education, 20(1), 53. https://doi.org/10.1186/s41239-023-00422-5
  • • Yu, H., & Mi, Y. (2023). Application Model for Innovative Sports Practice Teaching in Colleges Using Internet of Things and Artificial Intelligence. Electronics, 12(4), 874. https://doi.org/10.3390/electronics12040874
  • • Zhu, C., Sun, M., Luo, J., Li, T., & Wang, M. (2023). How to harness the potential of ChatGPT in education?. Knowledge Management & E-Learning, 15(2), 133- 152. https://doi.org/10.34105/j.kmel.2023.15.008