Report
Προβολή σε EDS

CRASE5® for ACT Writing Technical Report. Research Report. R2544

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: CRASE5® for ACT Writing Technical Report. Research Report. R2544
Γλώσσα: English
Συγγραφείς: Scott W. Wood, Sungjin Nam, Dongmei Li, ACT Education Corp.
Πηγή: ACT Education Corp. 2026.
Διαθεσιμότητα: ACT Education Corp. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
Peer Reviewed: N
Page Count: 31
Ημερομηνία έκδοσης: 2026
Τύπος εγγράφου: Reports - Evaluative
Education Level: Higher Education
Postsecondary Education
Descriptors: College Entrance Examinations, Writing Tests, Scoring, Automation, Algorithms, Validity, Sex, Race, Essays, Response Style (Tests), Computer Assisted Testing
Assessment and Survey Identifiers: ACT Assessment
Περίληψη: Starting in October 2022, ACT began using its automated scoring engine, CRASE®, to provide one of the two rater scores for ACT writing essays in the ACT International program. Since CRASE began to score ACT writing, there has been a desire to add new engine functionalities in order to expand the kinds of essays CRASE can handle. The new functionalities include automatically detecting off-topic essays, automatically detecting disturbing content, leveraging modern model-fitting approaches, and providing information about the confidence of the engine in assigning scores. A new version of CRASE, called CRASE5, was developed in 2025 to incorporate these new functionalities. The primary purpose of this report is to replicate the studies listed in the CRASE+ technical report using the new generic scoring models produced in CRASE5. The results presented in this report, especially when compared to the corresponding results in the original report, should provide validity evidence that the updated CRASE5 generic scoring models perform as well as the original CRASE+ generic scoring models. This report follows the organization of the CRASE+ technical report. Section I provides an introduction. Section II contains a brief overview of CRASE and CRASE5. Section III discusses the data and processes used to train and validate the engine, while Section IV provides validation results. Section V contains a subgroup analysis of the CRASE5 scores. Section VI describes how condition codes are handled by CRASE5.
Abstractor: ERIC
Entry Date: 2026
Αριθμός Καταχώρησης: ED681484
Βάση Δεδομένων: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED681484
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED681484
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: CRASE5® for ACT Writing Technical Report. Research Report. R2544
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Scott+W%2E+Wood%22">Scott W. Wood</searchLink><br /><searchLink fieldCode="AR" term="%22Sungjin+Nam%22">Sungjin Nam</searchLink><br /><searchLink fieldCode="AR" term="%22Dongmei+Li%22">Dongmei Li</searchLink><br /><searchLink fieldCode="AR" term="%22ACT+Education+Corp%2E%22">ACT Education Corp.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22ACT+Education+Corp%22"><i>ACT Education Corp</i></searchLink>. 2026.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: ACT Education Corp. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 31
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2026
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Evaluative
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22College+Entrance+Examinations%22">College Entrance Examinations</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Tests%22">Writing Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br /><searchLink fieldCode="DE" term="%22Algorithms%22">Algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Sex%22">Sex</searchLink><br /><searchLink fieldCode="DE" term="%22Race%22">Race</searchLink><br /><searchLink fieldCode="DE" term="%22Essays%22">Essays</searchLink><br /><searchLink fieldCode="DE" term="%22Response+Style+%28Tests%29%22">Response Style (Tests)</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22ACT+Assessment%22">ACT Assessment</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Starting in October 2022, ACT began using its automated scoring engine, CRASE®, to provide one of the two rater scores for ACT writing essays in the ACT International program. Since CRASE began to score ACT writing, there has been a desire to add new engine functionalities in order to expand the kinds of essays CRASE can handle. The new functionalities include automatically detecting off-topic essays, automatically detecting disturbing content, leveraging modern model-fitting approaches, and providing information about the confidence of the engine in assigning scores. A new version of CRASE, called CRASE5, was developed in 2025 to incorporate these new functionalities. The primary purpose of this report is to replicate the studies listed in the CRASE+ technical report using the new generic scoring models produced in CRASE5. The results presented in this report, especially when compared to the corresponding results in the original report, should provide validity evidence that the updated CRASE5 generic scoring models perform as well as the original CRASE+ generic scoring models. This report follows the organization of the CRASE+ technical report. Section I provides an introduction. Section II contains a brief overview of CRASE and CRASE5. Section III discusses the data and processes used to train and validate the engine, while Section IV provides validation results. Section V contains a subgroup analysis of the CRASE5 scores. Section VI describes how condition codes are handled by CRASE5.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED681484
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED681484
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 31
    Subjects:
      – SubjectFull: College Entrance Examinations
        Type: general
      – SubjectFull: Writing Tests
        Type: general
      – SubjectFull: Scoring
        Type: general
      – SubjectFull: Automation
        Type: general
      – SubjectFull: Algorithms
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Sex
        Type: general
      – SubjectFull: Race
        Type: general
      – SubjectFull: Essays
        Type: general
      – SubjectFull: Response Style (Tests)
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: ACT Assessment
        Type: general
    Titles:
      – TitleFull: CRASE5® for ACT Writing Technical Report. Research Report. R2544
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: ACT Education Corp.
      – PersonEntity:
          Name:
            NameFull: Scott W. Wood
      – PersonEntity:
          Name:
            NameFull: Sungjin Nam
      – PersonEntity:
          Name:
            NameFull: Dongmei Li
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2026
          Titles:
            – TitleFull: ACT Education Corp
              Type: main
ResultId 1