Academic Journal
Προβολή σε EDS

Jiving with LLMs: 1st-Year Students' Computer Programming Self-Efficacy after Reading Code with LLMs

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Jiving with LLMs: 1st-Year Students' Computer Programming Self-Efficacy after Reading Code with LLMs
Γλώσσα: English
Συγγραφείς: Michelle Jarvie-Eggart, Joseph Roy Teahen, Daniel T. Masker, José Padilla, Leo C. Ureel II, Laura E. Brown, Scott Pomerville, Jon Sticken
Πηγή: Journal of Teaching and Learning with Technology. 2025 14:65-87.
Διαθεσιμότητα: Indiana University. 107 South Indiana Avenue, Bryan Hall 203B, Bloomington, IN 47405. Tel: 317-274-5647; Fax: 317-278-2360; e-mail: josotl@iu.edu; Web site: https://scholarworks.iu.edu/journals/index.php/jotlt
Peer Reviewed: Y
Page Count: 23
Ημερομηνία έκδοσης: 2025
Τύπος εγγράφου: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Artificial Intelligence, Engineering Education, Computer Science Education, Coding, College Freshmen, Self Efficacy, Intellectual Disciplines, Student Characteristics, Sex, Technology Uses in Education, Student Attitudes, Intention, Programming Languages
Γεωγραφικοί όροι: Michigan
ISSN: 2165-2554
Περίληψη: This study investigated the impact of leveraging generative artificial intelligence (GenAI) to assist 1st-year engineering and computer science (CS) students in reading code in a new (to them) language. Students were asked to comment code in FORTRAN. They were then asked to run the code through ChatGPT-4.0 for its comments and reflect on what they learned from the experience. Participants completed survey items from Ramalingam and Wiedenbeck's Computer Programming Self-Efficacy Scale (CPSES) prior to and after the intervention. Additional open-ended reflective (qualitative) questions were added to the quantitative questions in the postintervention questionnaire. This study documents increases in self-efficacy for programming independence and persistence (Factor 1 of the CPSES) as well as for complex programming tasks (Factor 2) after students used ChatGPT for generating code explanations. Both CS and engineering students showed improvements in programming independence and persistence; but only engineers showed significant improvements in their confidence regarding complex programming tasks. Men experienced a significant increase in self-efficacy on Factor 1 while women experienced a significant increase on Factor 2. The qualitative data point to an increase in student understanding of the new code and suggest that although students may be more likely to use GenAI for assistance as they progress through programming courses, guiding students in using GenAI to understand code may shift students' intent away from using GenAI to write code for them. Thus, we recommend that programming faculty instruct students how to interact with GenAI.
Abstractor: As Provided
Entry Date: 2026
Αριθμός Καταχώρησης: EJ1494997
Βάση Δεδομένων: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1494997
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1494997
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Jiving with LLMs: 1st-Year Students' Computer Programming Self-Efficacy after Reading Code with LLMs
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Michelle+Jarvie-Eggart%22">Michelle Jarvie-Eggart</searchLink><br /><searchLink fieldCode="AR" term="%22Joseph+Roy+Teahen%22">Joseph Roy Teahen</searchLink><br /><searchLink fieldCode="AR" term="%22Daniel+T%2E+Masker%22">Daniel T. Masker</searchLink><br /><searchLink fieldCode="AR" term="%22José+Padilla%22">José Padilla</searchLink><br /><searchLink fieldCode="AR" term="%22Leo+C%2E+Ureel+II%22">Leo C. Ureel II</searchLink><br /><searchLink fieldCode="AR" term="%22Laura+E%2E+Brown%22">Laura E. Brown</searchLink><br /><searchLink fieldCode="AR" term="%22Scott+Pomerville%22">Scott Pomerville</searchLink><br /><searchLink fieldCode="AR" term="%22Jon+Sticken%22">Jon Sticken</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Teaching+and+Learning+with+Technology%22"><i>Journal of Teaching and Learning with Technology</i></searchLink>. 2025 14:65-87.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Indiana University. 107 South Indiana Avenue, Bryan Hall 203B, Bloomington, IN 47405. Tel: 317-274-5647; Fax: 317-278-2360; e-mail: josotl@iu.edu; Web site: https://scholarworks.iu.edu/journals/index.php/jotlt
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 23
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Engineering+Education%22">Engineering Education</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Science+Education%22">Computer Science Education</searchLink><br /><searchLink fieldCode="DE" term="%22Coding%22">Coding</searchLink><br /><searchLink fieldCode="DE" term="%22College+Freshmen%22">College Freshmen</searchLink><br /><searchLink fieldCode="DE" term="%22Self+Efficacy%22">Self Efficacy</searchLink><br /><searchLink fieldCode="DE" term="%22Intellectual+Disciplines%22">Intellectual Disciplines</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Characteristics%22">Student Characteristics</searchLink><br /><searchLink fieldCode="DE" term="%22Sex%22">Sex</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Intention%22">Intention</searchLink><br /><searchLink fieldCode="DE" term="%22Programming+Languages%22">Programming Languages</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Michigan%22">Michigan</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2165-2554
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study investigated the impact of leveraging generative artificial intelligence (GenAI) to assist 1st-year engineering and computer science (CS) students in reading code in a new (to them) language. Students were asked to comment code in FORTRAN. They were then asked to run the code through ChatGPT-4.0 for its comments and reflect on what they learned from the experience. Participants completed survey items from Ramalingam and Wiedenbeck's Computer Programming Self-Efficacy Scale (CPSES) prior to and after the intervention. Additional open-ended reflective (qualitative) questions were added to the quantitative questions in the postintervention questionnaire. This study documents increases in self-efficacy for programming independence and persistence (Factor 1 of the CPSES) as well as for complex programming tasks (Factor 2) after students used ChatGPT for generating code explanations. Both CS and engineering students showed improvements in programming independence and persistence; but only engineers showed significant improvements in their confidence regarding complex programming tasks. Men experienced a significant increase in self-efficacy on Factor 1 while women experienced a significant increase on Factor 2. The qualitative data point to an increase in student understanding of the new code and suggest that although students may be more likely to use GenAI for assistance as they progress through programming courses, guiding students in using GenAI to understand code may shift students' intent away from using GenAI to write code for them. Thus, we recommend that programming faculty instruct students how to interact with GenAI.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1494997
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1494997
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 23
        StartPage: 65
    Subjects:
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Engineering Education
        Type: general
      – SubjectFull: Computer Science Education
        Type: general
      – SubjectFull: Coding
        Type: general
      – SubjectFull: College Freshmen
        Type: general
      – SubjectFull: Self Efficacy
        Type: general
      – SubjectFull: Intellectual Disciplines
        Type: general
      – SubjectFull: Student Characteristics
        Type: general
      – SubjectFull: Sex
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Student Attitudes
        Type: general
      – SubjectFull: Intention
        Type: general
      – SubjectFull: Programming Languages
        Type: general
      – SubjectFull: Michigan
        Type: general
    Titles:
      – TitleFull: Jiving with LLMs: 1st-Year Students' Computer Programming Self-Efficacy after Reading Code with LLMs
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Michelle Jarvie-Eggart
      – PersonEntity:
          Name:
            NameFull: Joseph Roy Teahen
      – PersonEntity:
          Name:
            NameFull: Daniel T. Masker
      – PersonEntity:
          Name:
            NameFull: José Padilla
      – PersonEntity:
          Name:
            NameFull: Leo C. Ureel II
      – PersonEntity:
          Name:
            NameFull: Laura E. Brown
      – PersonEntity:
          Name:
            NameFull: Scott Pomerville
      – PersonEntity:
          Name:
            NameFull: Jon Sticken
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2165-2554
          Numbering:
            – Type: volume
              Value: 14
          Titles:
            – TitleFull: Journal of Teaching and Learning with Technology
              Type: main
ResultId 1