Evaluating Computer Science Students Reading Comprehension of Educational Multimedia-Enhanced Text Using Scalable Eye-Tracking Methodology

Bibliographic Details
Title: Evaluating Computer Science Students Reading Comprehension of Educational Multimedia-Enhanced Text Using Scalable Eye-Tracking Methodology
Language: English
Authors: Milan Turcáni, Zoltan Balogh (ORCID 0000-0002-8900-0693), Michal Kohútek
Source: Smart Learning Environments. 2024 11.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 28
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Descriptors: Computer Science Education, Eye Movements, Reading Comprehension, Knowledge Level, Tests, Video Technology, Open Source Technology, Cost Effectiveness, Illustrations, Vocabulary Development, High Achievement, Learning Problems, Comparative Analysis, Identification, Readability, Educational Benefits, Multimedia Materials
DOI: 10.1186/s40561-024-00318-5
ISSN: 2196-7091
Abstract: In this research, a mixed-method approach was employed to conduct large-scale eye-tracking measurements, traditionally associated with high costs and extensive time commitments. Utilizing consumer-grade webcams in conjunction with open-source software, data was collected from an expansive cohort of students, thereby demonstrating the scalability and cost-effectiveness of this innovative methodology. The primary objective of this research was to discern the disparities in reading behaviour when students were presented with standard text accompanied by illustrations, compared to the same text with highlighted key terms. The participants, comprised of first-year university students, completed a questionnaire and an introductory test to ascertain their knowledge level. Subsequently, they were segregated into two groups and participated in two reading sessions, during which their ocular movements were recorded. The amassed data underwent both qualitative analyses, facilitated by visualizations, and quantitative analysis, employing statistical measures on the data and test results. Notably, no significant difference was observed in the gaze patterns or test results between the experimental and control groups. However, a significant divergence in gaze patterns was identified between high-achieving students and those experiencing difficulties, as evidenced by the averaged composite heatmaps generated from the data. The findings underscore two pivotal points. Firstly, the feasibility of conducting large-scale eye-tracking experiments is demonstrated. Traditional studies in this field often employ small population samples due to the time and financial constraints associated with methods that utilize specialized eye-tracking hardware. In contrast, our methodology is scalable, relying on low-end hardware and enabling students to record data on their personal devices. Secondly, while eye-tracking may not provide substantial benefits for fine-tuning text already optimized for readability, it could serve as a valuable tool for identifying and assisting learners who are struggling. This mixed-method approach holds significant potential to revolutionize the conduct and interpretation of eye-tracking studies within educational settings.
Abstractor: As Provided
Notes: https://www.scidb.cn/en/detail?dataSetId=3c958d74e4c74790a48334a952ff0b67
Entry Date: 2024
Accession Number: EJ1428658
Database: ERIC
FullText Links:
  – Type: other
    Url: https://resolver.ebsco.com:443/public/rma-ftfapi/ejs/direct?AccessToken=46C7B74606130C6463C6&Show=Object
Text:
  Availability: 0
CustomLinks:
  – Url: https://dx.doi.org/doi:10.1186/s40561-024-00318-5
    Name: EDS - Springer Nature Journals (s7799221)
    Category: fullText
    Text: View record at Springer
Header DbId: eric
DbLabel: ERIC
An: EJ1428658
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating Computer Science Students Reading Comprehension of Educational Multimedia-Enhanced Text Using Scalable Eye-Tracking Methodology
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Milan+Turcáni%22">Milan Turcáni</searchLink><br /><searchLink fieldCode="AR" term="%22Zoltan+Balogh%22">Zoltan Balogh</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-8900-0693">0000-0002-8900-0693</externalLink>)<br /><searchLink fieldCode="AR" term="%22Michal+Kohútek%22">Michal Kohútek</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Smart+Learning+Environments%22"><i>Smart Learning Environments</i></searchLink>. 2024 11.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 28
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Science+Education%22">Computer Science Education</searchLink><br /><searchLink fieldCode="DE" term="%22Eye+Movements%22">Eye Movements</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Knowledge+Level%22">Knowledge Level</searchLink><br /><searchLink fieldCode="DE" term="%22Tests%22">Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Video+Technology%22">Video Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Open+Source+Technology%22">Open Source Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Cost+Effectiveness%22">Cost Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Illustrations%22">Illustrations</searchLink><br /><searchLink fieldCode="DE" term="%22Vocabulary+Development%22">Vocabulary Development</searchLink><br /><searchLink fieldCode="DE" term="%22High+Achievement%22">High Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Problems%22">Learning Problems</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Identification%22">Identification</searchLink><br /><searchLink fieldCode="DE" term="%22Readability%22">Readability</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Benefits%22">Educational Benefits</searchLink><br /><searchLink fieldCode="DE" term="%22Multimedia+Materials%22">Multimedia Materials</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1186/s40561-024-00318-5
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2196-7091
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In this research, a mixed-method approach was employed to conduct large-scale eye-tracking measurements, traditionally associated with high costs and extensive time commitments. Utilizing consumer-grade webcams in conjunction with open-source software, data was collected from an expansive cohort of students, thereby demonstrating the scalability and cost-effectiveness of this innovative methodology. The primary objective of this research was to discern the disparities in reading behaviour when students were presented with standard text accompanied by illustrations, compared to the same text with highlighted key terms. The participants, comprised of first-year university students, completed a questionnaire and an introductory test to ascertain their knowledge level. Subsequently, they were segregated into two groups and participated in two reading sessions, during which their ocular movements were recorded. The amassed data underwent both qualitative analyses, facilitated by visualizations, and quantitative analysis, employing statistical measures on the data and test results. Notably, no significant difference was observed in the gaze patterns or test results between the experimental and control groups. However, a significant divergence in gaze patterns was identified between high-achieving students and those experiencing difficulties, as evidenced by the averaged composite heatmaps generated from the data. The findings underscore two pivotal points. Firstly, the feasibility of conducting large-scale eye-tracking experiments is demonstrated. Traditional studies in this field often employ small population samples due to the time and financial constraints associated with methods that utilize specialized eye-tracking hardware. In contrast, our methodology is scalable, relying on low-end hardware and enabling students to record data on their personal devices. Secondly, while eye-tracking may not provide substantial benefits for fine-tuning text already optimized for readability, it could serve as a valuable tool for identifying and assisting learners who are struggling. This mixed-method approach holds significant potential to revolutionize the conduct and interpretation of eye-tracking studies within educational settings.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: Note
  Label: Notes
  Group: Note
  Data: https://www.scidb.cn/en/detail?dataSetId=3c958d74e4c74790a48334a952ff0b67
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1428658
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1428658
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1186/s40561-024-00318-5
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 28
    Subjects:
      – SubjectFull: Computer Science Education
        Type: general
      – SubjectFull: Eye Movements
        Type: general
      – SubjectFull: Reading Comprehension
        Type: general
      – SubjectFull: Knowledge Level
        Type: general
      – SubjectFull: Tests
        Type: general
      – SubjectFull: Video Technology
        Type: general
      – SubjectFull: Open Source Technology
        Type: general
      – SubjectFull: Cost Effectiveness
        Type: general
      – SubjectFull: Illustrations
        Type: general
      – SubjectFull: Vocabulary Development
        Type: general
      – SubjectFull: High Achievement
        Type: general
      – SubjectFull: Learning Problems
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Identification
        Type: general
      – SubjectFull: Readability
        Type: general
      – SubjectFull: Educational Benefits
        Type: general
      – SubjectFull: Multimedia Materials
        Type: general
    Titles:
      – TitleFull: Evaluating Computer Science Students Reading Comprehension of Educational Multimedia-Enhanced Text Using Scalable Eye-Tracking Methodology
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Milan Turcáni
      – PersonEntity:
          Name:
            NameFull: Zoltan Balogh
      – PersonEntity:
          Name:
            NameFull: Michal Kohútek
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-electronic
              Value: 2196-7091
          Numbering:
            – Type: volume
              Value: 11
          Titles:
            – TitleFull: Smart Learning Environments
              Type: main
ResultId 1