Dissertation/ Thesis
AI or LLM assisted software testing : a mapping study
| Τίτλος: | AI or LLM assisted software testing : a mapping study |
|---|---|
| Συγγραφείς: | Al Amin, Shamim |
| Συνεισφορές: | Lappeenrannan-Lahden teknillinen yliopisto LUT, Lappeenranta-Lahti University of Technology LUT |
| Έτος έκδοσης: | 2025 |
| Συλλογή: | LUTPub (LUT University / LUT yliopisto) |
| Θεματικοί όροι: | AI assisted software testing, LLM based test generation, automated test analysis, security vulnerabilities in AI generated code, static analysis and CWE mapping, ODC guided quality assessment, CI/CD pipeline integration, ethical AI in testing, reproducibility and transparency, systematic literature review (SLR), fi=Kestävää teollisuutta, innovaatioita ja infrastruktuureja|en=Industry, innovation and infrastructure, fi=School of Engineering Science, Tietotekniikka|en=School of Engineering Science, Computer Science |
| Περιγραφή: | Modern software systems are increasingly distributed, frequently updated and deployed in security-critical contexts, which reduces the effectiveness of testing approaches that rely heavily on manual effort and fragile automation. AI, particularly large language models (LLMs), is being applied to automate and support software testing activities. This study presents a systematic mapping analysis based on a Systematic Literature Review (SLR) of peer-reviewed research on AI/LLM-assisted software testing, focusing on integration strategies, adoption motivations, limitations, quality impacts and ethical considerations. Searches in IEEE Xplore, ACM Digital Library, ScienceDirect, Wiley Online Library and Google Scholar retrieved 33,572 records. After multi-stage screening and quality assessment, 34 primary studies were included and synthesized using research question driven thematic analysis. The results highlight that the current integration is mostly focused on generation. The most modern applications are those that help with unit test generation and enhancement, test suite augmentation and debugging. Other uses include finding bugs, helping with test-oracle and automating CI/CD but coverage of non-functional and specialized testing is still limited. Adoption is motivated by the need to improve coverage, reduce manual effort and accelerate feedback cycles. Key challenges include hallucinations and semantic errors in generated artifacts, weak or inconsistent oracle strategies, non-determinism and reproducibility issues and security and privacy risks associated with prompts, logs and generated code. Overall, the evidence suggests that AI/LLM assisted testing can improve software quality when supported by validation mechanisms, secure integration practices and appropriate human oversight. |
| Τύπος εγγράφου: | master thesis |
| Περιγραφή αρχείου: | fulltext |
| Γλώσσα: | English |
| Relation: | https://lutpub.lut.fi/handle/10024/171117 |
| Διαθεσιμότητα: | https://lutpub.lut.fi/handle/10024/171117 |
| Rights: | fi=Kaikki oikeudet pidätetään.|en=All rights reserved.| |
| Αριθμός Καταχώρησης: | edsbas.B6F37E3A |
| Βάση Δεδομένων: | BASE |
καταχωρήστε σχόλιο πρώτοι!