Academic Journal

Challenges of human-subject studies in engineering design research — from experience-informed point observations to context-aware validation of design knowledge.

Λεπτομέρειες βιβλιογραφικής εγγραφής
Τίτλος: Challenges of human-subject studies in engineering design research — from experience-informed point observations to context-aware validation of design knowledge.
Συγγραφείς: Jiao, Roger1 (AUTHOR) rjiao@gatech.edu
Πηγή: Journal of Engineering Design. Jul2026, Vol. 37 Issue 7, p2547-2564. 18p.
Θεματικοί όροι: *Engineering design, Test validity, Research methodology, Human experimentation, Model validation, Evaluation methodology
Περίληψη: Human-subject studies are now a common vehicle for generating empirical evidence in engineering design research, spanning protocol studies, controlled experiments, surveys, interviews, and mixed–methods approaches. Yet a recurring difficulty in current practice is that many studies remain experience–informed point observations, such as single artifacts, simplified tasks, convenience samples, or narrow decision regimes, while making broad claims about engineering design knowledge or practice. This perspective argues that the central issue is not the inclusion of human participants, but rather under–specification of design context and misalignment of validation logic, i.e. importing methods and reporting conventions from adjacent disciplines can improve transparency, but does not, by itself, establish engineering–level applicability or transferability. We synthesise state–of–the–art norms from human factors and ergonomics, human-computer interaction and open science practices, social science qualitative research, and clinical and observational research reporting, and evaluate their strengths and limitations in the context of engineering design. A central organising reflection is an artifact-decision map that frames two orthogonal validity drivers regarding artifact realism and decision realism, and links a study's position to defensible claim scope. We envision a pragmatic pipeline, including a lightweight Metric–Measure–Method (3M) discipline, and actionable guidance for researchers to strengthen context–aware validation while preserving methodological diversity. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Engineering Design is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Βάση Δεδομένων: Business Source Index
Περιγραφή
ISSN:09544828
DOI:10.1080/09544828.2026.2626235