Conference
Comparing Expert and AI-Based Assessments in Evaluating Learner Knowledge
| Τίτλος: | Comparing Expert and AI-Based Assessments in Evaluating Learner Knowledge |
|---|---|
| Γλώσσα: | English |
| Συγγραφείς: | Mohamad Al Assaad, Houssam Kanso |
| Πηγή: | International Association for Development of the Information Society. 2026. |
| Διαθεσιμότητα: | International Association for the Development of the Information Society. e-mail: secretariat@iadis.org; Web site: http://www.iadisportal.org |
| Peer Reviewed: | Y |
| Page Count: | 4 |
| Ημερομηνία έκδοσης: | 2026 |
| Τύπος εγγράφου: | Speeches/Meeting Papers Reports - Evaluative |
| Descriptors: | Artificial Intelligence, Student Evaluation, Evaluation Methods, Man Machine Systems, Computer Assisted Testing |
| Περίληψη: | The rapid development of large language models (LLMs) has introduced new possibilities for educational assessment, particularly in the creation of learner evaluation tools. Traditionally, expert-designed tests have been the standard for assessing knowledge, relying on subject-matter expertise, pedagogical principles, and alignment with curriculum objectives. In contrast, LLMs such as ChatGPT can now generate assessment items on demand, offering scalability and adaptability but raising questions about validity, reliability, and educational value. This paper compares expert-created assessments with LLM-generated assessments to evaluate their effectiveness in measuring learner knowledge, in the computer science and project management fields. Through this comparison, we aim to highlight both the strengths and limitations of AI-based assessment generation and evaluation. The findings have implications for the future of educational assessment design, teacher practice, and the responsible integration of AI in learning environments. [For the full proceedings, see ED682246.] |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Αριθμός Καταχώρησης: | ED682314 |
| Βάση Δεδομένων: | ERIC |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED682314 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED682314 AccessLevel: 3 PubType: Conference PubTypeId: conference PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Comparing Expert and AI-Based Assessments in Evaluating Learner Knowledge – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Mohamad+Al+Assaad%22">Mohamad Al Assaad</searchLink><br /><searchLink fieldCode="AR" term="%22Houssam+Kanso%22">Houssam Kanso</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22International+Association+for+Development+of+the+Information+Society%22"><i>International Association for Development of the Information Society</i></searchLink>. 2026. – Name: Avail Label: Availability Group: Avail Data: International Association for the Development of the Information Society. e-mail: secretariat@iadis.org; Web site: http://www.iadisportal.org – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 4 – Name: DatePubCY Label: Publication Date Group: Date Data: 2026 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Speeches/Meeting Papers<br />Reports - Evaluative – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Man+Machine+Systems%22">Man Machine Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The rapid development of large language models (LLMs) has introduced new possibilities for educational assessment, particularly in the creation of learner evaluation tools. Traditionally, expert-designed tests have been the standard for assessing knowledge, relying on subject-matter expertise, pedagogical principles, and alignment with curriculum objectives. In contrast, LLMs such as ChatGPT can now generate assessment items on demand, offering scalability and adaptability but raising questions about validity, reliability, and educational value. This paper compares expert-created assessments with LLM-generated assessments to evaluate their effectiveness in measuring learner knowledge, in the computer science and project management fields. Through this comparison, we aim to highlight both the strengths and limitations of AI-based assessment generation and evaluation. The findings have implications for the future of educational assessment design, teacher practice, and the responsible integration of AI in learning environments. [For the full proceedings, see ED682246.] – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2026 – Name: AN Label: Accession Number Group: ID Data: ED682314 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED682314 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 4 Subjects: – SubjectFull: Artificial Intelligence Type: general – SubjectFull: Student Evaluation Type: general – SubjectFull: Evaluation Methods Type: general – SubjectFull: Man Machine Systems Type: general – SubjectFull: Computer Assisted Testing Type: general Titles: – TitleFull: Comparing Expert and AI-Based Assessments in Evaluating Learner Knowledge Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Mohamad Al Assaad – PersonEntity: Name: NameFull: Houssam Kanso IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2026 Titles: – TitleFull: International Association for Development of the Information Society Type: main |
| ResultId | 1 |