Academic Journal
Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test
| Τίτλος: | Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test |
|---|---|
| Γλώσσα: | English |
| Συγγραφείς: | Ebru Balta (ORCID |
| Πηγή: | International Journal of Assessment Tools in Education. 2025 12(3):681-700. |
| Διαθεσιμότητα: | International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate |
| Peer Reviewed: | Y |
| Page Count: | 20 |
| Ημερομηνία έκδοσης: | 2025 |
| Τύπος εγγράφου: | Journal Articles Reports - Research |
| Descriptors: | Adaptive Testing, Computer Assisted Testing, Paper and Pencil Tests, Test Validity, Audits (Verification), Cheating, Student Behavior, Scores |
| ISSN: | 2148-7456 |
| Περίληψη: | Unproctored Computerized Adaptive Testing (CAT) is gaining traction due to its convenience, flexibility, and scalability, particularly in high-stakes assessments. However, the lack of proctor can give rise to aberrant testing behavior. These behaviors can impair the validity of test scores. This paper explores the use of a verification test to detect aberrant testing behavior in unproctored CAT environments. This study aims to use multiple measures to detect aberrant response patterns in CAT via a paper-and-pencil (P&P) test as well as to compare the sensitivity and specificity performances of the [log-likelihood subscript z] person-fit statistic (PFS) using no-stage and two-stage ([log-likelihood subscript z] is used after the Kullback-Leibler divergence (KLD) measure) methods in different conditions. Three factors were manipulated -- the aberrance percentage, the aberrance scenario, and the aberrant examinee's ability range. The study found that in all scenarios, the specificity performance of [log-likelihood subscript z] in classifying examinees was higher than its sensitivity performance in no-stage and two-stage analyses. However, the sensitivity performance of [log-likelihood subscript z] was higher in two-stage analysis. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Αριθμός Καταχώρησης: | EJ1482832 |
| Βάση Δεδομένων: | ERIC |
| ISSN: | 2148-7456 |
|---|