Dataset
Dataset of a Study of Computational reproducibility of Jupyter notebooks from biomedical publications
| Τίτλος: | Dataset of a Study of Computational reproducibility of Jupyter notebooks from biomedical publications |
|---|---|
| Συγγραφείς: | Sheeba Samuel, Daniel Mietchen |
| Στοιχεία εκδότη: | Zenodo |
| Έτος έκδοσης: | 2023 |
| Συλλογή: | Zenodo |
| Θεματικοί όροι: | Jupyter Notebook, Computational reproducibility, biomedical publications, GitHub, PubMed Central, Python, workflow documentation, dependency decay |
| Περιγραφή: | This repository contains the dataset for the study of computational reproducibility of Jupyter notebooks from biomedical publications. Our focus lies in evaluating the extent of reproducibility of Jupyter notebooks derived from GitHub repositories linked to publications present in the biomedical literature repository, PubMed Central. We analyzed the reproducibility of Jupyter notebooks from GitHub repositories associated with publications indexed in the biomedical literature repository PubMed Central. The dataset includes the metadata information of the journals, publications, the Github repositories mentioned in the publications and the notebooks present in the Github repositories. Data Collection and Analysis We use the code for reproducibility of Jupyter notebooks from the study done by Pimentel et al., 2019 and adapted the code from ReproduceMeGit. We provide code for collecting the publication metadata from PubMed Central using NCBI Entrez utilities via Biopython. Our approach involves searching PMC using the esearch function for Jupyter notebooks using the query: ``(ipynb OR jupyter OR ipython) AND github''. We meticulously retrieve data in XML format, capturing essential details about journals and articles. By systematically scanning the entire article, encompassing the abstract, body, data availability statement, and supplementary materials, we extract GitHub links. Additionally, we mine repositories for key information such as dependency declarations found in files like requirements.txt, setup.py, and pipfile. Leveraging the GitHub API, we enrich our data by incorporating repository creation dates, update histories, pushes, and programming languages. All the extracted information is stored in a SQLite database. After collecting and creating the database tables, we ran a pipeline to collect the Jupyter notebooks contained in the GitHub repositories based on the code from Pimentel et al., 2019. Our reproducibility pipeline was started on 27 March 2023. Repository Structure Our repository is organized into ... |
| Τύπος εγγράφου: | dataset |
| Γλώσσα: | English |
| ISSN: | 2047-217X |
| Relation: | https://zenodo.org/records/8226725; oai:zenodo.org:8226725; https://doi.org/10.5281/zenodo.8226725 |
| DOI: | 10.5281/zenodo.8226725 |
| Διαθεσιμότητα: | https://doi.org/10.5281/zenodo.8226725 https://zenodo.org/records/8226725 |
| Rights: | Creative Commons Zero v1.0 Universal ; cc0-1.0 ; https://creativecommons.org/publicdomain/zero/1.0/legalcode |
| Αριθμός Καταχώρησης: | edsbas.162B634D |
| Βάση Δεδομένων: | BASE |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://doi.org/10.5281/zenodo.8226725# Name: EDS - BASE (ns324271) Category: fullText Text: View record from BASE – Url: https://resolver.ebsco.com/c/fiv2js/result?sid=EBSCO:edsbas&genre=article&issn=2047217X&ISBN=&volume=&issue=&date=20230101&spage=&pages=&title=Dataset of a Study of Computational reproducibility of Jupyter notebooks from biomedical publications&atitle=Dataset%20of%20a%20Study%20of%20Computational%20reproducibility%20of%20Jupyter%20notebooks%20from%20biomedical%20publications&aulast=Sheeba%20Samuel&id=DOI:10.5281/zenodo.8226725 Name: Full Text Finder (for New FTF UI) (ns324271) Category: fullText Text: Full Text Finder MouseOverText: Full Text Finder |
|---|---|
| Header | DbId: edsbas DbLabel: BASE An: edsbas.162B634D RelevancyScore: 848 AccessLevel: 3 PubType: Dataset PubTypeId: unknown PreciseRelevancyScore: 848.330749511719 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Dataset of a Study of Computational reproducibility of Jupyter notebooks from biomedical publications – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Sheeba+Samuel%22">Sheeba Samuel</searchLink><br /><searchLink fieldCode="AR" term="%22Daniel+Mietchen%22">Daniel Mietchen</searchLink> – Name: Publisher Label: Publisher Information Group: PubInfo Data: Zenodo – Name: DatePubCY Label: Publication Year Group: Date Data: 2023 – Name: Subset Label: Collection Group: HoldingsInfo Data: Zenodo – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Jupyter+Notebook%22">Jupyter Notebook</searchLink><br /><searchLink fieldCode="DE" term="%22Computational+reproducibility%22">Computational reproducibility</searchLink><br /><searchLink fieldCode="DE" term="%22biomedical+publications%22">biomedical publications</searchLink><br /><searchLink fieldCode="DE" term="%22GitHub%22">GitHub</searchLink><br /><searchLink fieldCode="DE" term="%22PubMed+Central%22">PubMed Central</searchLink><br /><searchLink fieldCode="DE" term="%22Python%22">Python</searchLink><br /><searchLink fieldCode="DE" term="%22workflow+documentation%22">workflow documentation</searchLink><br /><searchLink fieldCode="DE" term="%22dependency+decay%22">dependency decay</searchLink> – Name: Abstract Label: Description Group: Ab Data: This repository contains the dataset for the study of computational reproducibility of Jupyter notebooks from biomedical publications. Our focus lies in evaluating the extent of reproducibility of Jupyter notebooks derived from GitHub repositories linked to publications present in the biomedical literature repository, PubMed Central. We analyzed the reproducibility of Jupyter notebooks from GitHub repositories associated with publications indexed in the biomedical literature repository PubMed Central. The dataset includes the metadata information of the journals, publications, the Github repositories mentioned in the publications and the notebooks present in the Github repositories. Data Collection and Analysis We use the code for reproducibility of Jupyter notebooks from the study done by Pimentel et al., 2019 and adapted the code from ReproduceMeGit. We provide code for collecting the publication metadata from PubMed Central using NCBI Entrez utilities via Biopython. Our approach involves searching PMC using the esearch function for Jupyter notebooks using the query: ``(ipynb OR jupyter OR ipython) AND github''. We meticulously retrieve data in XML format, capturing essential details about journals and articles. By systematically scanning the entire article, encompassing the abstract, body, data availability statement, and supplementary materials, we extract GitHub links. Additionally, we mine repositories for key information such as dependency declarations found in files like requirements.txt, setup.py, and pipfile. Leveraging the GitHub API, we enrich our data by incorporating repository creation dates, update histories, pushes, and programming languages. All the extracted information is stored in a SQLite database. After collecting and creating the database tables, we ran a pipeline to collect the Jupyter notebooks contained in the GitHub repositories based on the code from Pimentel et al., 2019. Our reproducibility pipeline was started on 27 March 2023. Repository Structure Our repository is organized into ... – Name: TypeDocument Label: Document Type Group: TypDoc Data: dataset – Name: Language Label: Language Group: Lang Data: English – Name: ISSN Label: ISSN Group: ISSN Data: 2047-217X – Name: NoteTitleSource Label: Relation Group: SrcInfo Data: https://zenodo.org/records/8226725; oai:zenodo.org:8226725; https://doi.org/10.5281/zenodo.8226725 – Name: DOI Label: DOI Group: ID Data: 10.5281/zenodo.8226725 – Name: URL Label: Availability Group: URL Data: https://doi.org/10.5281/zenodo.8226725<br />https://zenodo.org/records/8226725 – Name: Copyright Label: Rights Group: Cpyrght Data: Creative Commons Zero v1.0 Universal ; cc0-1.0 ; https://creativecommons.org/publicdomain/zero/1.0/legalcode – Name: AN Label: Accession Number Group: ID Data: edsbas.162B634D |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.162B634D |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.5281/zenodo.8226725 Languages: – Text: English Subjects: – SubjectFull: Jupyter Notebook Type: general – SubjectFull: Computational reproducibility Type: general – SubjectFull: biomedical publications Type: general – SubjectFull: GitHub Type: general – SubjectFull: PubMed Central Type: general – SubjectFull: Python Type: general – SubjectFull: workflow documentation Type: general – SubjectFull: dependency decay Type: general Titles: – TitleFull: Dataset of a Study of Computational reproducibility of Jupyter notebooks from biomedical publications Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Sheeba Samuel – PersonEntity: Name: NameFull: Daniel Mietchen IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2023 Identifiers: – Type: issn-print Value: 2047217X – Type: issn-locals Value: edsbas – Type: issn-locals Value: edsbas.oa |
| ResultId | 1 |