Validity Arguments for Using CRASE® Confidence Scoring on ACT Writing Test Essays. Research Report. R2611

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Validity Arguments for Using CRASE® Confidence Scoring on ACT Writing Test Essays. Research Report. R2611
Γλώσσα: English
Συγγραφείς: Scott Wood, Dongmei Li, Sungjin Nam, ACT Education Corp.
Πηγή: ACT Education Corp. 2026.
Διαθεσιμότητα: ACT Education Corp. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
Peer Reviewed: N
Page Count: 26
Ημερομηνία έκδοσης: 2026
Τύπος εγγράφου: Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Scoring, Writing Tests, Writing Evaluation, Essays, Validity, College Entrance Examinations, Automation, Computer Assisted Testing, Accuracy, Evaluation Methods
Assessment and Survey Identifiers: ACT Assessment
Περίληψη: In October 2022, ACT started using CRASE®, its automated scoring engine, to provide one of the two scores for online essays in the international administration of the ACT® test with writing. Since then, CRASE has been used to score essays for ACT District (spring 2023), ACT State (fall 2023), and ACT National (December 2023) online testing. Beginning in April 2026, ACT confidence scoring will be applied to selected essays on the ACT writing test for National online testing. ACT confidence scoring is defined as using only automated scoring to score a subset of writing test essays--if CRASE deems that it is highly confident in its scores--while sending all the other essays to a human to determine the second score as ACT has traditionally done since October 2022. In this report, Section 2 provides a concise history of CRASE and its newest version, CRASE5. Section 3 briefly explains the essay-scoring process. Section 4 describes the data and research questions for this study. Section 5 provides the results from applying ACT confidence scoring on ACT writing test essays, including information about rater accuracy and the expected differences in raw and scale scores. Finally, Section 6 presents conclusions about ACT confidence scoring.
Abstractor: ERIC
Entry Date: 2026
Αριθμός Καταχώρησης: ED681515
Βάση Δεδομένων: ERIC