Academic Journal
Feasibility of AI and Human Standardized Patients to Enhance Customer Discovery Communication Skills in Medical Students: Preliminary Evaluation of an Observational Cohort Study.
| Τίτλος: | Feasibility of AI and Human Standardized Patients to Enhance Customer Discovery Communication Skills in Medical Students: Preliminary Evaluation of an Observational Cohort Study. |
|---|---|
| Συγγραφείς: | Hafer N; University of Massachusetts Chan Medical School, Worcester, MA, United States., Chitre M; University of Massachusetts Chan Medical School, Worcester, MA, United States., Fischer M; University of Massachusetts Chan Medical School, Worcester, MA, United States., LeMoine J; University of Massachusetts Chan Medical School, Worcester, MA, United States.; My Diji Helpers, Inc, Watertown, MA, United States. |
| Πηγή: | JMIR formative research [JMIR Form Res] 2026 Sep 10; Vol. 10, pp. e95225. Date of Electronic Publication: 2026 Sep 10. |
| Τύπος έκδοσης: | Journal Article; Observational Study |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: JMIR Publications Country of Publication: Canada NLM ID: 101726394 Publication Model: Electronic Cited Medium: Internet ISSN: 2561-326X (Electronic) Linking ISSN: 2561326X NLM ISO Abbreviation: JMIR Form Res Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: Toronto, ON, Canada : JMIR Publications, [2017]- |
| Ιατρικοί όροι (MeSH): | Students, Medical*/statistics & numerical data , Students, Medical*/psychology , Patient Simulation* , Communication* , Artificial Intelligence*, Humans ; Cohort Studies ; Feasibility Studies ; Male ; Female ; Adult ; Generative Artificial Intelligence |
| Περίληψη: | Background: Medical students must build skills beyond traditional clinical domains to best shape the evolving health care system and fill a variety of professional roles after graduation. AI offers new methods for medical education. Objective: This study aimed to develop and evaluate the feasibility and preliminary effectiveness of traditional (human) standardized patient (SP) engagement and generative AI (GenAI)-generated SP engagement as a low-stakes way for students to practice customer discovery interviews. Methods: An interactive classroom experience was created in the UMass Chan Medical School interprofessional Center for Experiential Learning and Simulation (iCELS) using an observational cohort design to simulate 2 different interview scenarios with human SPs and AI-generated SPs. The simulation with human SPs was conducted with 74 first-year medical students in the Entrepreneurship, Biodesign, and Innovation Pathway starting in 2023. In 2026, 2 GenAI chatbot interview agents, using OpenAI GPT-5.2, were developed and added as an additional part of the simulation experience. The 2 scenario-specific GenAI agents (patient and clinician/physician) used structured instructions defining their roles, interview contexts, knowledge boundaries, response styles, time limits, feedback, and scoring rubric. The simulations took place over a single 2-hour session in the spring semester. Interview scenarios, sample questions and answers, and an evaluation rubric were developed for both SPs to promote consistency. Primary outcomes were student attitudes regarding the acceptability of the simulation and self-efficacy, collected via a validated online survey immediately after class. Students were asked to rate statements on a 3-point (1="not at all relevant," 2="somewhat relevant," and 3="very relevant"), 4-point (1="strongly disagree" to 4="strongly agree"), or 5-point (1="strongly disagree," 3="neutral," and 5="strongly agree") Likert scale and were also allowed to provide open-ended comments. Results: The students gave the simulation with human SPs high scores, with 85% (23/27) agreeing or strongly agreeing that the exercise met learning objectives, with a median score of 4 (IQR 1) on a 4-point Likert scale. Responses to the AI chatbot session had a bimodal distribution; for example, 65% (13/20) of students agreed that "This experience with an AI chatbot SP helped me practice my customer discovery interview skills" while 35% (7/20) disagreed with this statement. A Mann-Whitney U test compared responses between the human SP and AI chatbot groups and revealed no significant difference in responses. Conclusions: This preliminary study with an AI chatbot was able to replicate realistic customer discovery interviews in 2 different scenarios. Larger studies are needed to determine the feasibility and acceptability of these chatbots for practicing customer discovery skills. Future work will create transcripts of both the AI chatbot and human SP interviews and use independent raters to score interview quality based on our scoring rubric. Finally, we plan to enhance the chatbots to provide a more immersive and realistic experience for students. (©Nathaniel Hafer, Monika Chitre, Melissa Fischer, Julie LeMoine. Originally published in JMIR Formative Research (https://formative.jmir.org), 10.09.2026.) |
| References: | JMIR Med Educ. 2025 May 20;11:e63353. (PMID: 40393017) JMIR Med Educ. 2026 Mar 25;12:e90368. (PMID: 41881044) JMIR Med Educ. 2026 Jun 4;12:e93710. (PMID: 42241685) JMIR Med Educ. 2024 Sep 23;10:e58753. (PMID: 39312284) BMC Med Educ. 2025 Nov 24;25(1):1755. (PMID: 41286823) Front Digit Health. 2026 Jun 10;8:1830254. (PMID: 42359442) JMIR Med Educ. 2023 Aug 14;9:e50945. (PMID: 37578830) Acad Med. 2026 Oct 1;101(10):1265-1273. (PMID: 42391038) JMIR Med Educ. 2023 Jun 1;9:e48291. (PMID: 37261894) BMC Med Educ. 2025 Aug 30;25(1):1227. (PMID: 40885939) Med Educ. 2024 Nov;58(11):1276-1285. (PMID: 38639098) Med Educ Online. 2023 Dec;28(1):2228550. (PMID: 37347808) J Biomed Inform. 2009 Apr;42(2):377-81. (PMID: 18929686) JMIR Form Res. 2026 Jan 19;10:e82828. (PMID: 41553752) J Dent Educ. 2026 Apr 20;:. (PMID: 42003540) J Clin Transl Sci. 2025 Jul 24;9(1):e172. (PMID: 40979109) J Med Educ Curric Dev. 2022 May 12;9:23821205221091511. (PMID: 35592131) JMIR Med Educ. 2026 Apr 20;12:e87012. (PMID: 42008615) Int J Med Inform. 2026 Nov 1;220:106589. (PMID: 42400960) J Biomed Inform. 2019 Jul;95:103208. (PMID: 31078660) Med Teach. 2026 Jun;48(6):1012-1021. (PMID: 41518042) |
| Contributed Indexing: | Keywords: AI; GenAI; I-corps; academic success; artificial intelligence; entrepreneurship; generative artificial intelligence; interview; simulation training; undergraduate medical education |
| Entry Date(s): | Date Created: 20260910 Date Completed: 20260910 Latest Revision: 20260927 |
| Update Code: | 20260927 |
| PubMed Central ID: | PMC13613044 |
| DOI: | 10.2196/95225 |
| PMID: | 42721453 |
| Βάση Δεδομένων: | MEDLINE |
καταχωρήστε σχόλιο πρώτοι!