Academic Journal
Προβολή σε EDS
Συνδεδεμένο Πλήρες Κείμενο

Constructing a Computerized Adaptive Test for Multidimensional Mathematical Competence: Development, Simulation, and Validation

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Constructing a Computerized Adaptive Test for Multidimensional Mathematical Competence: Development, Simulation, and Validation
Γλώσσα: English
Συγγραφείς: Yao-Ting Sung, Yu-Chun Lien (ORCID 0009-0002-6428-5845), Yeh-Tai Chou, Wei-Hong Yang
Πηγή: International Journal of Science and Mathematics Education. 2026 24(6).
Διαθεσιμότητα: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 33
Ημερομηνία έκδοσης: 2026
Τύπος εγγράφου: Journal Articles
Reports - Research
Education Level: High Schools
Secondary Education
Grade 10
Descriptors: Test Construction, Computer Assisted Testing, Adaptive Testing, Mathematics Tests, Simulation, Test Validity, Item Response Theory, Item Banks, Accuracy, Efficiency, Educational Diagnosis, Data Analysis, High School Students, Grade 10
DOI: 10.1007/s10763-026-10701-y
ISSN: 1571-0068
1573-1774
Περίληψη: This study utilized Item Response Theory (IRT) and Computerized Adaptive Testing (CAT) techniques to develop and preliminarily evaluate a multidimensional Mathematics Competence Assessment and Diagnosis (MCAD). The research consisted of three studies: First, we followed a five-step process to construct the item bank, which included Item Construction, Booklet Design, Participants, Procedure, and Data Analysis. Second, we conducted a simulation study to assess measurement precision and testing efficiency. The results indicated that MCAD's measurement precision exceeded that of unidimensional CAT and random administration of items, requiring less than 33% of the items needed by these methods to achieve equivalent reliability. Third, after developing the MCAD system, we carried out a preliminary empirical study involving 105 tenth-grade students. We used their Comprehensive Assessment Program for Junior High School Students (CAP) mathematics test as a criterion to examine the MCAD's criterion-related evidence, which was found to be over 0.7. However, the high correlations among dimensions and the characteristics of the empirical sample suggest that dimension-specific interpretations should be made cautiously. Overall, the findings provide preliminary support for MCAD as a potentially efficient tool for assessing mathematical competence.
Abstractor: As Provided
Entry Date: 2026
Αριθμός Καταχώρησης: EJ1514474
Βάση Δεδομένων: ERIC
FullText Links:
  – Type: other
    Url: https://resolver.ebsco.com:443/public/rma-ftfapi/ejs/direct?AccessToken=4817894B898F1A0F7D32&Show=Object
Text:
  Availability: 0
CustomLinks:
  – Url: https://dx.doi.org/doi:10.1007/s10763-026-10701-y
    Name: EDS - Springer Nature Journals (s7799221)
    Category: fullText
    Text: View record at Springer
Header DbId: eric
DbLabel: ERIC
An: EJ1514474
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Constructing a Computerized Adaptive Test for Multidimensional Mathematical Competence: Development, Simulation, and Validation
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Yao-Ting+Sung%22">Yao-Ting Sung</searchLink><br /><searchLink fieldCode="AR" term="%22Yu-Chun+Lien%22">Yu-Chun Lien</searchLink> (ORCID <externalLink term="http://orcid.org/0009-0002-6428-5845">0009-0002-6428-5845</externalLink>)<br /><searchLink fieldCode="AR" term="%22Yeh-Tai+Chou%22">Yeh-Tai Chou</searchLink><br /><searchLink fieldCode="AR" term="%22Wei-Hong+Yang%22">Wei-Hong Yang</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Science+and+Mathematics+Education%22"><i>International Journal of Science and Mathematics Education</i></searchLink>. 2026 24(6).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 33
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+10%22">Grade 10</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Adaptive+Testing%22">Adaptive Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Tests%22">Mathematics Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Simulation%22">Simulation</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Banks%22">Item Banks</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Efficiency%22">Efficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Diagnosis%22">Educational Diagnosis</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Analysis%22">Data Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Students%22">High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+10%22">Grade 10</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s10763-026-10701-y
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1571-0068<br />1573-1774
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study utilized Item Response Theory (IRT) and Computerized Adaptive Testing (CAT) techniques to develop and preliminarily evaluate a multidimensional Mathematics Competence Assessment and Diagnosis (MCAD). The research consisted of three studies: First, we followed a five-step process to construct the item bank, which included Item Construction, Booklet Design, Participants, Procedure, and Data Analysis. Second, we conducted a simulation study to assess measurement precision and testing efficiency. The results indicated that MCAD's measurement precision exceeded that of unidimensional CAT and random administration of items, requiring less than 33% of the items needed by these methods to achieve equivalent reliability. Third, after developing the MCAD system, we carried out a preliminary empirical study involving 105 tenth-grade students. We used their Comprehensive Assessment Program for Junior High School Students (CAP) mathematics test as a criterion to examine the MCAD's criterion-related evidence, which was found to be over 0.7. However, the high correlations among dimensions and the characteristics of the empirical sample suggest that dimension-specific interpretations should be made cautiously. Overall, the findings provide preliminary support for MCAD as a potentially efficient tool for assessing mathematical competence.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1514474
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1514474
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s10763-026-10701-y
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 33
    Subjects:
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Adaptive Testing
        Type: general
      – SubjectFull: Mathematics Tests
        Type: general
      – SubjectFull: Simulation
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Item Banks
        Type: general
      – SubjectFull: Accuracy
        Type: general
      – SubjectFull: Efficiency
        Type: general
      – SubjectFull: Educational Diagnosis
        Type: general
      – SubjectFull: Data Analysis
        Type: general
      – SubjectFull: High School Students
        Type: general
      – SubjectFull: Grade 10
        Type: general
    Titles:
      – TitleFull: Constructing a Computerized Adaptive Test for Multidimensional Mathematical Competence: Development, Simulation, and Validation
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Yao-Ting Sung
      – PersonEntity:
          Name:
            NameFull: Yu-Chun Lien
      – PersonEntity:
          Name:
            NameFull: Yeh-Tai Chou
      – PersonEntity:
          Name:
            NameFull: Wei-Hong Yang
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 1571-0068
            – Type: issn-electronic
              Value: 1573-1774
          Numbering:
            – Type: volume
              Value: 24
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: International Journal of Science and Mathematics Education
              Type: main
ResultId 1