Academic Journal
View in EDS

Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test

Bibliographic Details
Title: Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test
Language: English
Authors: Ebru Balta (ORCID 0000-0002-2173-7189), Arzu Uçar (ORCID 0000-0002-0099-1348)
Source: International Journal of Assessment Tools in Education. 2025 12(3):681-700.
Availability: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate
Peer Reviewed: Y
Page Count: 20
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Descriptors: Adaptive Testing, Computer Assisted Testing, Paper and Pencil Tests, Test Validity, Audits (Verification), Cheating, Student Behavior, Scores
ISSN: 2148-7456
Abstract: Unproctored Computerized Adaptive Testing (CAT) is gaining traction due to its convenience, flexibility, and scalability, particularly in high-stakes assessments. However, the lack of proctor can give rise to aberrant testing behavior. These behaviors can impair the validity of test scores. This paper explores the use of a verification test to detect aberrant testing behavior in unproctored CAT environments. This study aims to use multiple measures to detect aberrant response patterns in CAT via a paper-and-pencil (P&P) test as well as to compare the sensitivity and specificity performances of the [log-likelihood subscript z] person-fit statistic (PFS) using no-stage and two-stage ([log-likelihood subscript z] is used after the Kullback-Leibler divergence (KLD) measure) methods in different conditions. Three factors were manipulated -- the aberrance percentage, the aberrance scenario, and the aberrant examinee's ability range. The study found that in all scenarios, the specificity performance of [log-likelihood subscript z] in classifying examinees was higher than its sensitivity performance in no-stage and two-stage analyses. However, the sensitivity performance of [log-likelihood subscript z] was higher in two-stage analysis.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1482832
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1482832
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1482832
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ebru+Balta%22">Ebru Balta</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-2173-7189">0000-0002-2173-7189</externalLink>)<br /><searchLink fieldCode="AR" term="%22Arzu+Uçar%22">Arzu Uçar</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-0099-1348">0000-0002-0099-1348</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Assessment+Tools+in+Education%22"><i>International Journal of Assessment Tools in Education</i></searchLink>. 2025 12(3):681-700.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 20
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Adaptive+Testing%22">Adaptive Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Paper+and+Pencil+Tests%22">Paper and Pencil Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Audits+%28Verification%29%22">Audits (Verification)</searchLink><br /><searchLink fieldCode="DE" term="%22Cheating%22">Cheating</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Behavior%22">Student Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2148-7456
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Unproctored Computerized Adaptive Testing (CAT) is gaining traction due to its convenience, flexibility, and scalability, particularly in high-stakes assessments. However, the lack of proctor can give rise to aberrant testing behavior. These behaviors can impair the validity of test scores. This paper explores the use of a verification test to detect aberrant testing behavior in unproctored CAT environments. This study aims to use multiple measures to detect aberrant response patterns in CAT via a paper-and-pencil (P&P) test as well as to compare the sensitivity and specificity performances of the [log-likelihood subscript z] person-fit statistic (PFS) using no-stage and two-stage ([log-likelihood subscript z] is used after the Kullback-Leibler divergence (KLD) measure) methods in different conditions. Three factors were manipulated -- the aberrance percentage, the aberrance scenario, and the aberrant examinee's ability range. The study found that in all scenarios, the specificity performance of [log-likelihood subscript z] in classifying examinees was higher than its sensitivity performance in no-stage and two-stage analyses. However, the sensitivity performance of [log-likelihood subscript z] was higher in two-stage analysis.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1482832
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1482832
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
        StartPage: 681
    Subjects:
      – SubjectFull: Adaptive Testing
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Paper and Pencil Tests
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Audits (Verification)
        Type: general
      – SubjectFull: Cheating
        Type: general
      – SubjectFull: Student Behavior
        Type: general
      – SubjectFull: Scores
        Type: general
    Titles:
      – TitleFull: Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ebru Balta
      – PersonEntity:
          Name:
            NameFull: Arzu Uçar
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2148-7456
          Numbering:
            – Type: volume
              Value: 12
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: International Journal of Assessment Tools in Education
              Type: main
ResultId 1