Academic Journal
An empirical study to compare three web test automation approaches: NLP‐based, programmable, and capture&replay.
| Τίτλος: | An empirical study to compare three web test automation approaches: NLP‐based, programmable, and capture&replay. |
|---|---|
| Συγγραφείς: | Leotta, Maurizio, Ricca, Filippo, Marchetto, Alessandro, Olianas, Dario |
| Πηγή: | Journal of Software: Evolution & Process; May2024, Vol. 36 Issue 5, p1-24, 24p |
| Θεματικοί όροι: | Empirical research, Automation, Natural language processing, Natural languages |
| Περίληψη: | A new advancement in test automation is the use of natural language processing (NLP) to generate test cases (or test scripts) from natural language text. NLP is innovative in this context and promises of reducing test cases creation time and simplifying understanding for "non‐developer" software testers as well. Recently, many vendors have launched on the market many proposals of NLP‐based tools and testing frameworks but their superiority has never been empirically validated. This paper investigates the adoption of NLP‐based test automation in the web context with a series of case studies conducted to compare the costs of the NLP testing approach—measured in terms of test cases development and test cases evolution—with respect to more consolidated approaches, that is, programmable (or script‐based) testing and capture&replay testing. The results of our study show that NLP‐based test automation appears to be competitive for small‐ to medium‐sized test suites such as those considered in our empirical study. It minimizes the total cumulative cost (development and evolution) and does not require software testers with programming skills. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Software: Evolution & Process is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Βάση Δεδομένων: | Complementary Index |
| FullText | Links: – Type: other Text: Availability: 0 |
|---|---|
| Header | DbId: edb DbLabel: Complementary Index An: 176846237 RelevancyScore: 958 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 957.830749511719 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: An empirical study to compare three web test automation approaches: NLP‐based, programmable, and capture&replay. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Leotta%2C+Maurizio%22">Leotta, Maurizio</searchLink><br /><searchLink fieldCode="AR" term="%22Ricca%2C+Filippo%22">Ricca, Filippo</searchLink><br /><searchLink fieldCode="AR" term="%22Marchetto%2C+Alessandro%22">Marchetto, Alessandro</searchLink><br /><searchLink fieldCode="AR" term="%22Olianas%2C+Dario%22">Olianas, Dario</searchLink> – Name: TitleSource Label: Source Group: Src Data: Journal of Software: Evolution & Process; May2024, Vol. 36 Issue 5, p1-24, 24p – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Empirical+research%22">Empirical research</searchLink><br /><searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+language+processing%22">Natural language processing</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+languages%22">Natural languages</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: A new advancement in test automation is the use of natural language processing (NLP) to generate test cases (or test scripts) from natural language text. NLP is innovative in this context and promises of reducing test cases creation time and simplifying understanding for "non‐developer" software testers as well. Recently, many vendors have launched on the market many proposals of NLP‐based tools and testing frameworks but their superiority has never been empirically validated. This paper investigates the adoption of NLP‐based test automation in the web context with a series of case studies conducted to compare the costs of the NLP testing approach—measured in terms of test cases development and test cases evolution—with respect to more consolidated approaches, that is, programmable (or script‐based) testing and capture&replay testing. The results of our study show that NLP‐based test automation appears to be competitive for small‐ to medium‐sized test suites such as those considered in our empirical study. It minimizes the total cumulative cost (development and evolution) and does not require software testers with programming skills. [ABSTRACT FROM AUTHOR] – Name: Abstract Label: Group: Ab Data: <i>Copyright of Journal of Software: Evolution & Process is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edb&AN=176846237 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/smr.2606 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 24 StartPage: 1 Subjects: – SubjectFull: Empirical research Type: general – SubjectFull: Automation Type: general – SubjectFull: Natural language processing Type: general – SubjectFull: Natural languages Type: general Titles: – TitleFull: An empirical study to compare three web test automation approaches: NLP‐based, programmable, and capture&replay. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Leotta, Maurizio – PersonEntity: Name: NameFull: Ricca, Filippo – PersonEntity: Name: NameFull: Marchetto, Alessandro – PersonEntity: Name: NameFull: Olianas, Dario IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 05 Text: May2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 20477473 Numbering: – Type: volume Value: 36 – Type: issue Value: 5 Titles: – TitleFull: Journal of Software: Evolution & Process Type: main |
| ResultId | 1 |