Academic Journal
Development and evaluation of an e-learning program on drug-related problems for community pharmacists.
| Title: | Development and evaluation of an e-learning program on drug-related problems for community pharmacists. |
|---|---|
| Authors: | Vogt CJ; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany., Reuther A; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany., Wurmbach VS; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany., Weißenborn M; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany., Bittmann JA; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany., Wien K; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany., Lampert A; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany., Eknes EMB; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany.; Centre for Pharmacy, University Bergen, Bergen, Norway., Schäfer P; Chamber of Pharmacists Baden-Wurttemberg, Stuttgart, Germany., Seidling HM; Medical Faculty Heidelberg/Heidelberg University Hospital, Internal Medicine IX-Department of Clinical Pharmacology and Pharmacoepidemiology, Cooperation Unit Clinical Pharmacy, Heidelberg University, Im Neuenheimer Feld 410, 69120, Heidelberg, Germany. Hanna.seidling@med.uni-heidelberg.de. |
| Source: | International journal of clinical pharmacy [Int J Clin Pharm] 2026 Aug; Vol. 48 (4), pp. 1349-1358. Date of Electronic Publication: 2026 Mar 25. |
| Publication Type: | Journal Article |
| Language: | English |
| Journal Info: | Publisher: Springer Country of Publication: Netherlands NLM ID: 101554912 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 2210-7711 (Electronic) NLM ISO Abbreviation: Int J Clin Pharm Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: Dordrecht : Springer |
| MeSH Terms: | Pharmacists*/standards , Community Pharmacy Services*/standards , Education, Pharmacy, Continuing*/methods , Drug-Related Side Effects and Adverse Reactions*/diagnosis , Drug-Related Side Effects and Adverse Reactions*/prevention & control , Computer-Assisted Instruction*/methods , Computer-Assisted Instruction*/standards , Program Evaluation*/methods , Program Development*/methods , Program Development*/standards, Humans ; Female ; Male ; Adult |
| Abstract: | Introduction: Community pharmacists (CPs) are pivotal in the management of drug-related problems (DRPs), yet a need for additional training has been recognized. Aim: The aim was to develop and evaluate an e-learning program to enhance pharmacists' ability to detect and manage DRPs. Method: The e-learning program provided a self-paced learning experience with 10 modules, each focusing on a DRP. The DRPs were chosen as part of a previous Delphi consensus study. The development team, consisting of researchers, clinical pharmacists, and CPs, considered DRPs applicable if they occurred frequently and could be solved in a pharmacy. Moreover, a predefined checklist was established to guide the development of new modules and specify quality standards. Each module was structured into an educational phase (tutorials, pre- and post-knowledge quizzes, in-depth exercises), and a practical phase (documentation of anonymized patient encounters). After completing all modules, participants took a final comprehensive quiz with 2 questions per module (in total 20 questions). The program was evaluated on multiple levels: pharmacists' knowledge change, how they implemented this knowledge in practice, and their feedback. Data were analyzed descriptively. Comparison between the quizzes were calculated using the Wilcoxon test. Results: A total of 203 pharmacists registered to participate in the study, with participation declining across modules (184 participants completed Module 1 pre-knowledge quiz vs. 119 in Module 10). Across all modules, a significant knowledge increase was observed when comparing pre- and post-knowledge-quizzes (p < 0.001). Knowledge levels remained high in the final quiz (on average 1.63 ± 0.61 correct answers). Participants documented 13,778 patient encounters, thereof 5073 encounters with at least one DRP. According to the participants, most of the DRPs (90.1%, n = 4550) could be resolved. A total of 1137 feedbacks were received. Overall, feedback was positive, with participants highlighting improved abilities to engage with patients (85.2%, n = 969) and to identify DRPs (82.0%, n = 629). Conclusion: By bridging the gap between theoretical learning and practical application, this e-learning program improves pharmacists' skills in DRP management. (© 2026. The Author(s).) |
| Competing Interests: | Declarations. Competing interest: This work was financially supported by the Baden-Württemberg Chamber of Pharmacists (Germany). There are no other conflicts of interest regarding this work. Outside of the submitted work, Cathrin J. Vogt, Viktoria S. Wurmbach and Janina A. Bittmann received honoraria for lectures from the Landesapothekerkammer Baden-Württemberg (Chamber of Pharmacists in Baden-Württemberg). Patrick Schäfer received honoraria for being the author and editor of the book ‘Allgemeinpharmazie’. Hanna M. Seidling reports relationships with several research funds related to medication safety (e.g. G-BA Innovationsfonds, BMG, BMBF, BfArM, Förderinitiative Pharmazeutische Betreuung), including ongoing support for the eLearning programme (Chamber of Pharmacists, Baden-Württemberg). She also reports receiving honoraria for lectures and book chapters, travel reimbursements for congresses or meetings related to medication safety from professional organisations and publishing companies, and board membership of several organisations. Consent for participate: All participants consented to participate in the study while registering to the program. Consent to publish: N/a. Ethics approval: This study was performed in line with the principles of the Declaration of Helsinki. Ethical approval was obtained from the Medical Faculty of the University Hospital Heidelberg, with approval reference number S-607/2016. |
| References: | van Mil JW, Westerlund LO, Hersberger KE, et al. Drug-related problem classification systems. Ann Pharmacother. 2004;38(5):859–67. https://doi.org/10.1345/aph.1D182 . (PMID: 10.1345/aph.1D18215054145) Sell R, Schaefer M. Prevalence and risk factors of drug-related problems identified in pharmacy-based medication reviews. Int J Clin Pharm. 2020;42(2):588–97. https://doi.org/10.1007/s11096-020-00976-8 . (PMID: 10.1007/s11096-020-00976-8320263558452550) Ni XF, Yang CS, Bai YM, et al. Drug-related problems of patients in primary health care institutions: a systematic review. Front Pharmacol. 2021;12:698907. https://doi.org/10.3389/fphar.2021.698907 . (PMID: 10.3389/fphar.2021.698907344896958418140) Schindler E, Richling I, Rose O. Pharmaceutical care network Europe (PCNE) drug-related problem classification version 9.00: German translation and validation. Int J Clin Pharm. 2021;43(3):726–30. https://doi.org/10.1007/s11096-020-01150-w . (PMID: 10.1007/s11096-020-01150-w33025450) Lee H, Baek YH, Kim JH, et al. Trends of polypharmacy among older people in Asia, Australia and the United Kingdom: a multinational population-based study. Age Ageing. 2023;52(2):afad014. https://doi.org/10.1093/ageing/afad014 . (PMID: 10.1093/ageing/afad01436821644) Wang X, Liu K, Shirai K, et al. Prevalence and trends of polypharmacy in U.S. adults, 1999-2018. Glob Health Res Policy. 2023;8(1):25. https://doi.org/10.1186/s41256-023-00311-4 . (PMID: 10.1186/s41256-023-00311-43743423010337167) Van der Linden L, Tournoy J. Prevalence and trends in polypharmacy and excessive polypharmacy: a retrospective national database analysis (2012–2021). Int J Clin Pharm. 2024;46(4):987–91. https://doi.org/10.1007/s11096-024-01735-9 . (PMID: 10.1007/s11096-024-01735-938704778) Bou Malham C, El Khatib S, Cestac P, et al. Impact of pharmacist-led interventions on patient care in ambulatory care settings: a systematic review. Int J Clin Pract. 2021;75(11):e14864. https://doi.org/10.1111/ijcp.14864 . (PMID: 10.1111/ijcp.1486434523204) Kallio SE, Kiiski A, Airaksinen MSA, et al. Community pharmacists’ contribution to medication reviews for older adults: a systematic review. J Am Geriatr Soc. 2018;66(8):1613–20. https://doi.org/10.1111/jgs.15416 . (PMID: 10.1111/jgs.1541629972691) Vogt CJ, Moecker R, Jacke CO, et al. Exploring the heterogeneity in community pharmacist-led medication review studies - a systematic review. Res Social Adm Pharm. 2024;20(8):679–88. https://doi.org/10.1016/j.sapharm.2024.03.012 . (PMID: 10.1016/j.sapharm.2024.03.01238811260) Hochhold D, Nørgaard LS, Stewart D, et al. Identification, classification, and documentation of drug related problems in community pharmacy practice in Europe: a scoping review. Int J Clin Pharm. 2025;47(2):247–69. https://doi.org/10.1007/s11096-024-01834-7 . (PMID: 10.1007/s11096-024-01834-73977538211920317) Al-Taani GM, Ayoub NM. Community pharmacists’ routine provision of drug-related problem-reduction services. PLoS ONE. 2022;17(5):e0267379. https://doi.org/10.1371/journal.pone.0267379 . (PMID: 10.1371/journal.pone.0267379355075689067687) Mulder-Wildemors LGM, Heringa M, Floor-Schreudering A, et al. Reducing inappropriate drug use in older patients by use of clinical decision support in community pharmacy: a mixed-methods evaluation. Drugs Aging. 2020;37(2):115–23. https://doi.org/10.1007/s40266-019-00728-y . (PMID: 10.1007/s40266-019-00728-y31782128) Kallio S, Eskola T, Airaksinen M, et al. Identifying gaps in community pharmacists’ competence in medication risk management in routine dispensing. Innov Pharm. 2021;12(1):10. https://doi.org/10.24926/iip.v12i1.3510 . (PMID: 10.24926/iip.v12i1.3510) Kwint HF, Faber A, Gussekloo J, et al. Completeness of medication reviews provided by community pharmacists. J Clin Pharm Ther. 2014;39(3):248–52. https://doi.org/10.1111/jcpt.12132 . (PMID: 10.1111/jcpt.1213224521180) Zekan L, Mestrovic A, Seselja Perisin A, et al. Clinical knowledge of community pharmacists in Croatia for detecting drug-related problems. Int J Clin Pharm. 2017;39(6):1171–4. https://doi.org/10.1007/s11096-017-0546-z . (PMID: 10.1007/s11096-017-0546-z29038935) Ozucelik Y, Collins JC, Pace J. Identifying the educational needs of pharmacists engaging in professional development: a global systematic review. J Am Pharm Assoc (2003). 2025;65(5):102418. https://doi.org/10.1016/j.japh.2025.102418 . Lalonde L, Normandeau M, Lamarre D, et al. Evaluation of a training and communication-network nephrology program for community pharmacists. Pharm World Sci. 2008;30(6):924–33. https://doi.org/10.1007/s11096-008-9253-0 . (PMID: 10.1007/s11096-008-9253-018802782) Zekan L, Mestrovic A, Perisin AS, et al. Improving community pharmacists’ clinical knowledge to detect and resolve drug-related problems in Croatia: a before/after survey study investigating the efficacy of an educational intervention. BMJ Open. 2020;10(6):e034674. https://doi.org/10.1136/bmjopen-2019-034674 . (PMID: 10.1136/bmjopen-2019-034674324875737265009) Alhaqan A, Smith F, Bates I. A global evidence review of systemic factors influencing participation in pharmacy professional development activities. Res Social Adm Pharm. 2021;17(3):488–96. https://doi.org/10.1016/j.sapharm.2020.04.019 . (PMID: 10.1016/j.sapharm.2020.04.01932381423) Farrell B, Ward N, Jennings B, et al. Participation in online continuing education. Int J Pharm Pract. 2016;24(1):60–71. https://doi.org/10.1111/ijpp.12202 . (PMID: 10.1111/ijpp.1220226173959) Salter SM, Karia A, Sanfilippo FM, et al. Effectiveness of E-learning in pharmacy education. Am J Pharm Educ. 2014;78(4):83. https://doi.org/10.5688/ajpe78483 . (PMID: 10.5688/ajpe78483248509454028592) Kirkpatrick D. Great ideas revisited. Techniques for evaluating training programs. Revisiting Kirkpatrick’s four-level model. Train Dev. 1996;50:54–9. El Nsouli D, Nelson D, Nsouli L, et al. The application of Kirkpatrick’s evaluation model in the assessment of interprofessional simulation activities involving pharmacy students: a systematic review. Am J Pharm Educ. 2023;87(8):100003. https://doi.org/10.1016/j.ajpe.2023.02.003 . (PMID: 10.1016/j.ajpe.2023.02.00337597909) Blanco M, Prunuske J, DiCorcia M, et al. The DoCTRINE guidelines: defined criteria to report innovations in education. Acad Med. 2022;97(5):689–95. https://doi.org/10.1097/acm.0000000000004634 . (PMID: 10.1097/acm.000000000000463435171122) Boček Eknes EM. Detection and resolution of drug-related problems in community pharmacies. Development and pretesting of an eLearning-module [master thesis]. University of Bergen and Department of Clinical Pharmacology and Pharmacoepidemiology Heidelberg; 2017. R Foundation for statistical computing, Vienna, Austria; 2023. Nesterowicz K, Librowski T, Edelbring S. Validating e-learning in continuing pharmacy education: user acceptance and knowledge change. BMC Med Educ. 2014;14:33. https://doi.org/10.1186/1472-6920-14-33 . (PMID: 10.1186/1472-6920-14-33245285473927623) Laven A, Deters MA, Rose O, et al. PharmAdhere: training German community pharmacists with Objective Structured Clinical Examinations. Int J Clin Pharm. 2018;40(5):1317–27. https://doi.org/10.1007/s11096-018-0710-0 . (PMID: 10.1007/s11096-018-0710-030099664) Gheewala PA, Peterson GM, Zaidi ST, et al. A web-based training program to support chronic kidney disease screening by community pharmacists. Int J Clin Pharm. 2016;38(5):1080–6. https://doi.org/10.1007/s11096-016-0330-5 . (PMID: 10.1007/s11096-016-0330-527329381) Serhal S, Saini B, Bosnic-Anticevich S, et al. A multi-mode education program to enhance asthma care by pharmacists. Am J Pharm Educ. 2022;86(4):8633. https://doi.org/10.5688/ajpe8633 . (PMID: 10.5688/ajpe863334400397) Obreli-Neto PR, Marques Dos Reis T, Guidoni CM, et al. A systematic review of the effects of continuing education programs on providing clinical community pharmacy services. Am J Pharm Educ. 2016;80(5):88. https://doi.org/10.5688/ajpe80588 . (PMID: 10.5688/ajpe80588274029914937983) Marques Dos Reis T, de Oliveira Baldoni A, Campos AM, et al. A distance-learning course to improve drug-dispensing behaviors among brazilian community pharmacists. Am J Pharm Educ. 2019;83(8):6874. https://doi.org/10.5688/ajpe6874 . (PMID: 10.5688/ajpe6874318318906900818) Kimberlin CL, Berardo DH, Pendergast JF, et al. Effects of an education program for community pharmacists on detecting drug-related problems in elderly patients. Med Care. 1993;31(5):451–68. https://doi.org/10.1097/00005650-199305000-00007 . (PMID: 10.1097/00005650-199305000-000078501992) Frederick KD, Wheeler JS, Troy J, et al. From implementation to impact: evaluation of a pharmacist primary care certificate training program using the RE-AIM framework. J Am Pharm Assoc. 2003;2025:102962. https://doi.org/10.1016/j.japh.2025.102962 . (PMID: 10.1016/j.japh.2025.102962) Firman DR, Abu Ezzat N, Bustraan J, et al. Authentic learning environments for critical thinking and clinical reasoning skills in clinical pharmacology: a scoping review. Eur J Pharmacol. 2025;1006:178124. https://doi.org/10.1016/j.ejphar.2025.178124 . (PMID: 10.1016/j.ejphar.2025.17812440930483) Williams M, Peterson GM, Tenni PC, et al. A clinical knowledge measurement tool to assess the ability of community pharmacists to detect drug-related problems. Int J Pharm Pract. 2012;20(4):238–48. https://doi.org/10.1111/j.2042-7174.2012.00188.x . (PMID: 10.1111/j.2042-7174.2012.00188.x22775520) Seidling HM, Send AFJ, Bittmann J, et al. Medication review in German community pharmacies: post-hoc analysis of documented drug-related problems and subsequent interventions in the ATHINA-project. Res Social Adm Pharm. 2017;13(6):1127–34. https://doi.org/10.1016/j.sapharm.2016.10.016 . (PMID: 10.1016/j.sapharm.2016.10.01627816566) Williams M, Peterson GM, Tenni PC, et al. Drug-related problems detected in Australian community pharmacies: the PROMISe trial. Ann Pharmacother. 2011;45(9):1067–76. https://doi.org/10.1345/aph.1Q138 . (PMID: 10.1345/aph.1Q13821878658) |
| Contributed Indexing: | Keywords: Community pharmacy; Continuing education; Drug-related problems; e-learning |
| Entry Date(s): | Date Created: 20260325 Date Completed: 20260714 Latest Revision: 20260726 |
| Update Code: | 20260726 |
| PubMed Central ID: | PMC13369537 |
| DOI: | 10.1007/s11096-026-02111-5 |
| PMID: | 41879925 |
| Database: | MEDLINE |
Be the first to leave a comment!