A fast machine learning dataloader for epigenetic tracks from BigWig files.
basic_science · Level V
Where this comes from
- Record sourced from PubMed, PMID 38175786.
- Also identified by DOI 10.1093/bioinformatics/btad767 and PMC identifier 10782802.
- Licence recorded as CC BY.
- The licence permits redistribution, so the abstract is shown in full and the full text is available from the publisher.
Abstract
We created bigwig-loader, a data-loader for epigenetic profiles from BigWig files that decompresses and processes information for multiple intervals from multiple BigWig files in parallel. This is an access pattern needed to create training batches for typical machine learning models on epigenetics data. Using a new codec, the decompression can be done on a graphical processing unit (GPU) making it fast enough to create the training batches during training, mitigating the need for saving preprocessed training examples to disk. The bigwig-loader installation instructions and source code can be accessed at https://github.com/pfizer-opensource/bigwig-loader.
Medical subject headings
- Software
- Epigenomics