Workflows: Difference between revisions
Jump to navigation
Jump to search
IA migration §1c: create Workflows section landing hub (via create-page on MediaWiki MCP Server) |
Replace performance optimizations with Parallel Workflows |
||
| Line 10: | Line 10: | ||
* [[Scheduled tasks (cron)]] — running recurring tasks with scrontab | * [[Scheduled tasks (cron)]] — running recurring tasks with scrontab | ||
=== | === Parallel Workflows === | ||
* [[Performance Optimization/Multiple CPUs]] — using several cores in one job | * [[Performance Optimization/Multiple CPUs]] — using several cores in one job | ||
* [[Performance Optimization/Multiple nodes (MPI)]] — scaling across nodes with MPI | * [[Performance Optimization/Multiple nodes (MPI)]] — scaling across nodes with MPI | ||
* [[Performance Optimization/Multiple nodes (arrayjobs)]] — scaling with job arrays | * [[Performance Optimization/Multiple nodes (arrayjobs)]] — scaling with job arrays | ||
Revision as of 14:15, 21 July 2026
Guidelines and tools for building reproducible, efficient research workflows on Anunna.
In this section
- Workflow Migration from Laptop to HPC — moving your work to the cluster
- Reproducibility Guidelines — keeping your work reproducible
- Workflow Engines (Snakemake, Nextflow) — managing multi-step pipelines
- Debugging Jobs — working out why a job failed
- Checkpointing — saving and restarting long jobs
- Scheduled tasks (cron) — running recurring tasks with scrontab
Parallel Workflows
- Performance Optimization/Multiple CPUs — using several cores in one job
- Performance Optimization/Multiple nodes (MPI) — scaling across nodes with MPI
- Performance Optimization/Multiple nodes (arrayjobs) — scaling with job arrays