Skip to content

hpci improves reproducibility of computational biology research by integrating Continuous Integration with High Performance Computing clusters.

Oct 2026 · Bioinformatics · 0 citations
Medicine

Abstract

MOTIVATION The reproducibility crisis in bioinformatics and computational biology can be mitigated by using Continuous Integration (CI), a proven software engineering practice, to automate the testing of analysis pipelines and models. However, the adoption of CI in bioinformatics is limited as existing solutions are typically tightly linked to specific CI platforms, specific HPC job schedulers, or require actions from HPC administrators. RESULTS We developed hpci, a platform-agnostic, open-source utility that integrates CI platforms (e.g., GitHub Actions, GitLab CI) with common HPC job schedulers (Slurm, PBS). hpci operates as a standard unprivileged user via SSH, and requires no cluster-side installation. It terminates on the CI runner using the exact same exit code generated by the HPC job, providing feedback to researchers and preventing downstream CI steps if there are errors. We demonstrate hpci's utility across five diverse computational biology workflows on HPC, highlighting the value of automated testing and continuous analysis for verifying reproducibility in bioinformatics workflows. AVAILABILITY hpci is implemented in Haskell and is available under the GPL-3.0 licence. Source code and binaries can be downloaded from https://github.com/Garvan-Data-Science-Platform/hpci.Source code is archived in Software Heritage via Zenodo (https://zenodo.org/records/19587650).

Read PDF

Similar papers

Review Open access Sep 2026

Software engineering for reproducible pipeline development in bioinformatics

This work presents a software-engineering perspective for developing reproducible bioinformatics pipelines, with emphasis on pipeline-specific code, and reinterpreted the SOLID principles in this context at two levels: workflow management systems and pipeline implementation.

D. Pérez-Rodríguez, Alba Nogueira-Rodríguez, Jorge Vieira et al. · 0 citations
Preprint Sep 2026

Performance vs Portability in Heterogeneous HPC Environments: Why Pre-execution Benchmarking is Required

Cloud computing and high-performance computing (HPC) typically follow different paradigms: cloud services are often orchestrated using Kubernetes, whereas HPC workloads are managed through batch schedulers such as Slurm. Growing demand for shared computational resources increases the need for interoperability between t...

M. Mačernis · 0 citations

On the co-design of runtimes, systems and programming interfaces for HPC

(English) High-performance computing (HPC) platforms are evolving towards increasingly complex architectures: many-core CPUs with multi-level NUMA hierarchies, heterogeneity with multiple classes of accelerators and higher-capacity interconnects. The increasing complexity and variety of resources in these machines make...

David Álvarez Robert · 0 citations
Open access Jul 2025

ORCHA: A performance portability system for extreme heterogeneity

The core design goal is to let users decide the application’s hardware mapping and orchestration by editing only the high-level recipe—without modifying the maintained source code or binding the application to a particular runtime system.

Youngjun Lee, Klaus Weide, Wesley Kwiecinski et al. · 1 citation
Sep 2026

LineShine: online acceleration for HPC-AI converged scientific computing

LineShine is presented, a newly deployed exascale supercomputer whose online acceleration architecture provides a new design point for converged HPC and AI and demonstrates that its balanced architecture and software stack can translate system capability into high throughput, robust scalability, and sustained scientifi...

Yu-Tong Lu, Guang-Nan Feng, Hao-Huan Fu · 2 citations

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Reinforcing the value of human understanding at MIT

During the School of Humanities, Arts, and Social Sciences’ 75th Anniversary Symposium, President Sally Kornbluth said “MIT has never needed your particular insight and guidance more than we do now.”

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.