Dataset
View in EDS

Replication package: The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source

Bibliographic Details
Title: Replication package: The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source
Authors: orcid:0000-0002-2916-4020, orcid:0000-0001-7903-8236
Publisher Information: Blekinge Institute of Technology
Blekinge tekniska högskola
Publication Year: 2026
Subject Terms: Software Engineering, Programvaruteknik
Description: Replication package for the study "The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source" Summary of files included: results.xls contains the final results of mapping code review guidelines to observed code review comments in pull requests. repositories_all.zip includes a CSV file listing all identified GitHub repositories that meet our search criteria. repositories-top100.xlsx provides an overview of the top 100 (by star count) repositories that are considered in the study. GitHub-Crawler-code-only includes the scripts used to gather all relevant data from GitHub. GitHub-Crawler-with-data includes the scripts used to gather all relevant data from GitHub, with intermediate results from the crawling process, such as all pull requests and metadata for each repository. (~3.6 GB uncompressed) CodeBook.xlsx provides a codebook that defines the guidelines and the rules for mapping comments to these guidelines. Coding_with_IRR_metrics.zip contains the coding of a random sample of 200 PRs by an independent coder, including inter-rater reliability (IRR) metrics. How to Read the Results The file results.xls contains all pull requests (PRs) from 84 repositories that modify GUI-based test files. The columns in the main sheet are as follows: Repository: The name of the GitHub repository. PR_id: The unique identifier for a PR within a repository. An ID may appear in multiple repositories as it is a sequential number assigned in each repository. URL: A link that allows direct access to the PR on GitHub. Guidelines: Our mapping of code review comments to previously proposed guidelines. If multiple guidelines are identified in a PR, they are separated by the pipe symbol "|". Notes: Researcher notes regarding the mapping of comments to guidelines. These notes are used to highlight specific aspects of the PR that led to the mapping to a guideline. Checked: The letter "y" indicates the PR was reviewed by both authors who performed the mapping. A "d" marks PRs that contain only emojis, which we do not ...
Document Type: dataset
Language: English
Relation: https://doi.org/10.5281/zenodo.18664471
DOI: 10.5281/zenodo.18664471
Availability: https://doi.org/10.5281/zenodo.18664471
Rights: info:eu-repo/semantics/openAccess ; https://creativecommons.org/licenses/by/4.0/
Accession Number: edsbas.B46CBD77
Database: BASE
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://doi.org/10.5281/zenodo.18664471#
    Name: EDS - BASE (ns324271)
    Category: fullText
    Text: View record from BASE
Header DbId: edsbas
DbLabel: BASE
An: edsbas.B46CBD77
RelevancyScore: 933
AccessLevel: 3
PubType: Dataset
PubTypeId: unknown
PreciseRelevancyScore: 932.635681152344
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Replication package: The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22orcid%3A0000-0002-2916-4020%22">orcid:0000-0002-2916-4020</searchLink><br /><searchLink fieldCode="AR" term="%22orcid%3A0000-0001-7903-8236%22">orcid:0000-0001-7903-8236</searchLink>
– Name: Publisher
  Label: Publisher Information
  Group: PubInfo
  Data: Blekinge Institute of Technology<br />Blekinge tekniska högskola
– Name: DatePubCY
  Label: Publication Year
  Group: Date
  Data: 2026
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Software+Engineering%22">Software Engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Programvaruteknik%22">Programvaruteknik</searchLink>
– Name: Abstract
  Label: Description
  Group: Ab
  Data: Replication package for the study "The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source" Summary of files included: results.xls contains the final results of mapping code review guidelines to observed code review comments in pull requests. repositories_all.zip includes a CSV file listing all identified GitHub repositories that meet our search criteria. repositories-top100.xlsx provides an overview of the top 100 (by star count) repositories that are considered in the study. GitHub-Crawler-code-only includes the scripts used to gather all relevant data from GitHub. GitHub-Crawler-with-data includes the scripts used to gather all relevant data from GitHub, with intermediate results from the crawling process, such as all pull requests and metadata for each repository. (~3.6 GB uncompressed) CodeBook.xlsx provides a codebook that defines the guidelines and the rules for mapping comments to these guidelines. Coding_with_IRR_metrics.zip contains the coding of a random sample of 200 PRs by an independent coder, including inter-rater reliability (IRR) metrics. How to Read the Results The file results.xls contains all pull requests (PRs) from 84 repositories that modify GUI-based test files. The columns in the main sheet are as follows: Repository: The name of the GitHub repository. PR_id: The unique identifier for a PR within a repository. An ID may appear in multiple repositories as it is a sequential number assigned in each repository. URL: A link that allows direct access to the PR on GitHub. Guidelines: Our mapping of code review comments to previously proposed guidelines. If multiple guidelines are identified in a PR, they are separated by the pipe symbol "|". Notes: Researcher notes regarding the mapping of comments to guidelines. These notes are used to highlight specific aspects of the PR that led to the mapping to a guideline. Checked: The letter "y" indicates the PR was reviewed by both authors who performed the mapping. A "d" marks PRs that contain only emojis, which we do not ...
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: dataset
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: NoteTitleSource
  Label: Relation
  Group: SrcInfo
  Data: https://doi.org/10.5281/zenodo.18664471
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.5281/zenodo.18664471
– Name: URL
  Label: Availability
  Group: URL
  Data: https://doi.org/10.5281/zenodo.18664471
– Name: Copyright
  Label: Rights
  Group: Cpyrght
  Data: info:eu-repo/semantics/openAccess ; https://creativecommons.org/licenses/by/4.0/
– Name: AN
  Label: Accession Number
  Group: ID
  Data: edsbas.B46CBD77
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.B46CBD77
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.5281/zenodo.18664471
    Languages:
      – Text: English
    Subjects:
      – SubjectFull: Software Engineering
        Type: general
      – SubjectFull: Programvaruteknik
        Type: general
    Titles:
      – TitleFull: Replication package: The Prevalence of Code Review Guidelines for GUI-Based Testing in Open-Source
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: orcid:0000-0002-2916-4020
      – PersonEntity:
          Name:
            NameFull: orcid:0000-0001-7903-8236
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-locals
              Value: edsbas
            – Type: issn-locals
              Value: edsbas.oa
ResultId 1