Academic Journal
Augmented Testing to support Manual GUI-based Regression Testing: An Empirical Study
| Τίτλος: | Augmented Testing to support Manual GUI-based Regression Testing: An Empirical Study |
|---|---|
| Συγγραφείς: | Bauer, Andreas, Author, Frattini, Julian, 1995-, Author, Alégroth, Emil, 1984-, Author |
| Συνεισφορές: | Bauer, Andreas, Author, Frattini, Julian, 1995-, Author, Alégroth, Emil, 1984-, Author |
| Πηγή: | Empirical Software Engineering. 29(6) |
| Θεματικοί όροι: | GUI-based testing, GUI testing, Augmented Testing, manual teting, Bayesian data analysis, Systemteknik, Systems Engineering |
| Περιγραφή: | Context: Manual graphical user interface (GUI) software testing presents a substantial part of the overall practiced testing efforts, despite various research efforts to further increase test automation. Augmented Testing (AT), a novel approach for GUI testing, aims to aid manual GUI-based testing through a tool-supported approach where an intermediary visual layer is rendered between the system under test (SUT) and the tester, superimposing relevant test information.Objective: The primary objective of this study is to gather empirical evidence regarding AT's efficiency compared to manual GUI-based regression testing. Existing studies involving testing approaches under the AT definition primarily focus on exploratory GUI testing, leaving a gap in the context of regression testing. As a secondary objective, we investigate AT's benefits, drawbacks, and usability issues when deployed with the demonstrator tool, Scout.Method: We conducted an experiment involving 13 industry professionals, from six companies, comparing AT to manual GUI-based regression testing. These results were complemented by interviews and Bayesian data analysis (BDA) of the study's quantitative results.Results: The results of the Bayesian data analysis revealed that the use of AT shortens test durations in 70% of the cases on average, concluding that AT is more efficient.When comparing the means of the total duration to perform all tests, AT reduced the test duration by 36% in total. Participant interviews highlighted nine benefits and eleven drawbacks of AT, while observations revealed four usability issues.Conclusion: This study makes an empirical contribution to understanding Augmented Testing, a promising approach to improve the efficiency of GUI-based regression testing in practice. Furthermore, it underscores the importance of continual refinements of AT. |
| Περιγραφή αρχείου: | electronic |
| Σύνδεσμος πρόσβασης: | https://urn.kb.se/resolve?urn=urn:nbn:se:bth-25391 https://doi.org/10.1007/s10664-024-10522-z |
| Βάση Δεδομένων: | SwePub |
| ISSN: | 13823256 15737616 |
|---|---|
| DOI: | 10.1007/s10664-024-10522-z |