The potential of ChatGPT as a learning tool. A randomized controlled trial of pharmacy students in Tromsø

Abstract

Background: Pharmacy education is evolving with technological advances and changing student needs, incorporating digital tools alongside traditional methods. Artificial intelligence (AI), particularly large language models like ChatGPT, offers interactive learning and real-time feedback, shifting from passive to active learning. However, there is a notable lack of research-based evidence on ChatGPT’s impact in enhancing pharmacy education outcomes which not only involves learning theoretical concepts but also developing critical thinking, clinical decision-making skills, and practical expertise to produce a qualified pharmacist. <p>

<p>Aim of study: The aim of the study was to evaluate the impact of ChatGPT on pharmacy students' short-term learning outcomes by comparing pretest and post-test scores. It also examined attitudes toward ChatGPT among users and non-users and analysed their study habits and improvements in participants' subject-specific questions. <p>

<p>Method: A single blinded randomized controlled trial (RCT) designed to evaluate the effectiveness of ChatGPT as a study aid for pharmacy students at the UiT-The Arctic University of Norway. The study consisted of four main phases, a questionnaire, a pre-test, study time, and a post-test. <p>

<p>Results: Thirty-one students participated in the study. The intervention increased the post-test score by around 0.5 points on a 0–12-point scale. This effect was not statistically significant. Pre-test score was only the significant predictor among all the variables involved in the study. Among ChatGPT users 90.48% mentioned that it is a helpful tool and 66.67% of them think that it is a better learning tool to improve their pharmaceutical studies. The most common reasons for not using ChatGPT by the non-users were fear of receiving incorrect information and a lack of awareness about this tool. The most improvement was seen in pharmacology and pharmacoepidemiology multiple-choice questions by the intervention group participants. <p>

<p>Conclusion: Although we were not able to detect a statistical difference, but we believe that there is a potential that the use of ChatGPT can lead to improved learning in pharmacy students.