Report
CRASE5® for ACT Writing Technical Report. Research Report. R2544
| Τίτλος: | CRASE5® for ACT Writing Technical Report. Research Report. R2544 |
|---|---|
| Γλώσσα: | English |
| Συγγραφείς: | Scott W. Wood, Sungjin Nam, Dongmei Li, ACT Education Corp. |
| Πηγή: | ACT Education Corp. 2026. |
| Διαθεσιμότητα: | ACT Education Corp. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org |
| Peer Reviewed: | N |
| Page Count: | 31 |
| Ημερομηνία έκδοσης: | 2026 |
| Τύπος εγγράφου: | Reports - Evaluative |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | College Entrance Examinations, Writing Tests, Scoring, Automation, Algorithms, Validity, Sex, Race, Essays, Response Style (Tests), Computer Assisted Testing |
| Assessment and Survey Identifiers: | ACT Assessment |
| Περίληψη: | Starting in October 2022, ACT began using its automated scoring engine, CRASE®, to provide one of the two rater scores for ACT writing essays in the ACT International program. Since CRASE began to score ACT writing, there has been a desire to add new engine functionalities in order to expand the kinds of essays CRASE can handle. The new functionalities include automatically detecting off-topic essays, automatically detecting disturbing content, leveraging modern model-fitting approaches, and providing information about the confidence of the engine in assigning scores. A new version of CRASE, called CRASE5, was developed in 2025 to incorporate these new functionalities. The primary purpose of this report is to replicate the studies listed in the CRASE+ technical report using the new generic scoring models produced in CRASE5. The results presented in this report, especially when compared to the corresponding results in the original report, should provide validity evidence that the updated CRASE5 generic scoring models perform as well as the original CRASE+ generic scoring models. This report follows the organization of the CRASE+ technical report. Section I provides an introduction. Section II contains a brief overview of CRASE and CRASE5. Section III discusses the data and processes used to train and validate the engine, while Section IV provides validation results. Section V contains a subgroup analysis of the CRASE5 scores. Section VI describes how condition codes are handled by CRASE5. |
| Abstractor: | ERIC |
| Entry Date: | 2026 |
| Αριθμός Καταχώρησης: | ED681484 |
| Βάση Δεδομένων: | ERIC |
καταχωρήστε σχόλιο πρώτοι!