Report
Προβολή σε EDS

Validity Arguments for Using CRASE® Confidence Scoring on ACT Writing Test Essays. Research Report. R2611

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Validity Arguments for Using CRASE® Confidence Scoring on ACT Writing Test Essays. Research Report. R2611
Γλώσσα: English
Συγγραφείς: Scott Wood, Dongmei Li, Sungjin Nam, ACT Education Corp.
Πηγή: ACT Education Corp. 2026.
Διαθεσιμότητα: ACT Education Corp. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
Peer Reviewed: N
Page Count: 26
Ημερομηνία έκδοσης: 2026
Τύπος εγγράφου: Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Scoring, Writing Tests, Writing Evaluation, Essays, Validity, College Entrance Examinations, Automation, Computer Assisted Testing, Accuracy, Evaluation Methods
Assessment and Survey Identifiers: ACT Assessment
Περίληψη: In October 2022, ACT started using CRASE®, its automated scoring engine, to provide one of the two scores for online essays in the international administration of the ACT® test with writing. Since then, CRASE has been used to score essays for ACT District (spring 2023), ACT State (fall 2023), and ACT National (December 2023) online testing. Beginning in April 2026, ACT confidence scoring will be applied to selected essays on the ACT writing test for National online testing. ACT confidence scoring is defined as using only automated scoring to score a subset of writing test essays--if CRASE deems that it is highly confident in its scores--while sending all the other essays to a human to determine the second score as ACT has traditionally done since October 2022. In this report, Section 2 provides a concise history of CRASE and its newest version, CRASE5. Section 3 briefly explains the essay-scoring process. Section 4 describes the data and research questions for this study. Section 5 provides the results from applying ACT confidence scoring on ACT writing test essays, including information about rater accuracy and the expected differences in raw and scale scores. Finally, Section 6 presents conclusions about ACT confidence scoring.
Abstractor: ERIC
Entry Date: 2026
Αριθμός Καταχώρησης: ED681515
Βάση Δεδομένων: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED681515
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED681515
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Validity Arguments for Using CRASE® Confidence Scoring on ACT Writing Test Essays. Research Report. R2611
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Scott+Wood%22">Scott Wood</searchLink><br /><searchLink fieldCode="AR" term="%22Dongmei+Li%22">Dongmei Li</searchLink><br /><searchLink fieldCode="AR" term="%22Sungjin+Nam%22">Sungjin Nam</searchLink><br /><searchLink fieldCode="AR" term="%22ACT+Education+Corp%2E%22">ACT Education Corp.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22ACT+Education+Corp%22"><i>ACT Education Corp</i></searchLink>. 2026.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: ACT Education Corp. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 26
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Tests%22">Writing Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Evaluation%22">Writing Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Essays%22">Essays</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22College+Entrance+Examinations%22">College Entrance Examinations</searchLink><br /><searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22ACT+Assessment%22">ACT Assessment</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In October 2022, ACT started using CRASE®, its automated scoring engine, to provide one of the two scores for online essays in the international administration of the ACT® test with writing. Since then, CRASE has been used to score essays for ACT District (spring 2023), ACT State (fall 2023), and ACT National (December 2023) online testing. Beginning in April 2026, ACT confidence scoring will be applied to selected essays on the ACT writing test for National online testing. ACT confidence scoring is defined as using only automated scoring to score a subset of writing test essays--if CRASE deems that it is highly confident in its scores--while sending all the other essays to a human to determine the second score as ACT has traditionally done since October 2022. In this report, Section 2 provides a concise history of CRASE and its newest version, CRASE5. Section 3 briefly explains the essay-scoring process. Section 4 describes the data and research questions for this study. Section 5 provides the results from applying ACT confidence scoring on ACT writing test essays, including information about rater accuracy and the expected differences in raw and scale scores. Finally, Section 6 presents conclusions about ACT confidence scoring.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED681515
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED681515
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 26
    Subjects:
      – SubjectFull: Scoring
        Type: general
      – SubjectFull: Writing Tests
        Type: general
      – SubjectFull: Writing Evaluation
        Type: general
      – SubjectFull: Essays
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: College Entrance Examinations
        Type: general
      – SubjectFull: Automation
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Accuracy
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: ACT Assessment
        Type: general
    Titles:
      – TitleFull: Validity Arguments for Using CRASE® Confidence Scoring on ACT Writing Test Essays. Research Report. R2611
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: ACT Education Corp.
      – PersonEntity:
          Name:
            NameFull: Scott Wood
      – PersonEntity:
          Name:
            NameFull: Dongmei Li
      – PersonEntity:
          Name:
            NameFull: Sungjin Nam
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Type: published
              Y: 2026
          Titles:
            – TitleFull: ACT Education Corp
              Type: main
ResultId 1