SciDataFlow: a tool for improving the flow of data through science.
Where this comes from
- Record sourced from PubMed, PMID 38180848.
- Also identified by DOI 10.1093/bioinformatics/btad754 and PMC identifier 10786673.
- Licence recorded as CC BY.
- The licence permits redistribution, so the abstract is shown in full and the full text is available from the publisher.
Abstract
Managing data and code in open scientific research is complicated by two key problems: large datasets often cannot be stored alongside code in repository platforms like GitHub, and iterative analysis can lead to unnoticed changes to data, increasing the risk that analyses are based on older versions of data. SciDataFlow is a fast, concurrent command-line tool paired with a simple Data Manifest specification that streamlines tracking data changes, uploading data to remote repositories, and pulling in all data necessary to reproduce a computational analysis. SciDataFlow is available at https://github.com/vsbuffalo/scidataflow.
Medical subject headings
- Software
- Data Management