| Περίληψη: |
1) Software testing and test case generation are critical steps that require significant time and expertise, especially in complexandhigh-riskenvironments suchasbankingtransactionsystems. Sincecreatingtest cases is time-consuming and prone to errors, it is essential to apply artificial intelligence technologies to accelerate the process and enhance test coverage. 2) This research develops and compares the performance of four Large Language Models (LLMs): LLaMA3.2-3B, Typhoon2-8b, Gemma-3-4b, and Qwen3-8B, for automated test case generation in software testing. 3) The research methodology consists of four main steps: 3.1) Utilizing a dataset of 20,000 test cases, which covers 15,763 positive and 4,237 negative cases within the banking transaction domain. 3.2) Fine-tuning the models using the LoRA technique and the LangChain framework, integrated with the ChromaDB vector database through a Retrieval-Augmented Generation(RAG)architecture.3.3) Evaluatingperformanceusingvector-based metrics, including Cosine Distance, Euclidean Distance,and Manhattan Distance.3.4) Assessingtest casecoverageusingTest Coverage, Functional Coverage, and Requirement Coverage, combined with evaluations from software testing experts. 4) The results indicate that Qwen3-8B achieved the lowest loss (0.1558), demonstrating the highest learning accuracy, while Gemma-3-4b obtained the lowest Euclidean Distance (0.5494) and Manhattan Distance (11.8533), indicating the closest similarity to the ground-truth data. In terms of coverage, Gemma-3-4b achieved the highest Test Coverage (93%) and Functional Coverage (91%), whereas Qwen3-8B achieved the highest Requirement Coverage (92%). Furthermore, expert evaluations revealed that Gemma-3-4b received the highest average score of 43.2, equivalent to 86.4%. In conclusion, the study demonstrates that employing LLMs for test case generation can significantly improve the coverage, accuracy, and efficiency of software testing. Additionally, these models can be seamlessly integrated into chatbot systems to automatically generate test cases based on software requirements, highlighting their high practical potential for real-world applications in the software development industry. [ABSTRACT FROM AUTHOR] |