https://wiki.anunna.wur.nl/index.php?action=history&feed=atom&title=Workflow_Migration_from_Laptop_to_HPC 2026-06-19T08:36:43Z Revision history for this page on the wiki MediaWiki 1.45.3 https://wiki.anunna.wur.nl/index.php?title=Workflow_Migration_from_Laptop_to_HPC&diff=2868&oldid=prev 2026-06-18T14:22:14Z

<p>IA migration §8: new Workflow Migration from Laptop to HPC (onboarding guide) (via create-page on MediaWiki MCP Server)</p> <p><b>New page</b></p><div>Moving your work from a laptop or workstation to Anunna is mostly a change of mindset: instead of running things interactively and waiting at your screen, you describe what you want, hand it to the scheduler, and let it run. This page is a high-level guide to making that transition.<br /> <br /> == What changes ==<br /> <br /> * &#039;&#039;&#039;You do not run work interactively.&#039;&#039;&#039; On your laptop you run a script and watch it. On the cluster you submit it as a job and the scheduler runs it when resources are free — see [[Batch Jobs]]. The [[Login Nodes|login nodes]] are only for editing, transferring data, and submitting jobs.<br /> * &#039;&#039;&#039;You ask for resources explicitly.&#039;&#039;&#039; CPUs, memory, time, and GPUs are all requested up front — see [[Scheduler Overview (Slurm)]].<br /> * &#039;&#039;&#039;Storage is tiered.&#039;&#039;&#039; Active data goes on the fast [[Compute Storage|Lustre]] filesystem, not your home directory, and you need to know what is backed up — see [[Storage Systems Overview]] and [[Backup Policy]].<br /> * &#039;&#039;&#039;Software comes from modules.&#039;&#039;&#039; Instead of installing everything yourself, you load it with [[Environment Modules|modules]], or install into your own environment — see [[Installing Personal Software]].<br /> <br /> == A typical first migration ==<br /> <br /> # Get an account and log in — see [[Who Can Access?]] and [[SSH Access]].<br /> # Move your data and code across — see [[Data Transfer Methods]].<br /> # Find your software as modules, or set up your own environment — see [[Software Overview]].<br /> # Test on something small in an [[Interactive Jobs|interactive job]] to check it runs on the cluster.<br /> # Wrap the working commands in a batch script and submit it — see [[Batch Jobs]].<br /> # Scale up: many inputs at once with [[Array Jobs|job arrays]], or more cores and nodes with [[Performance Optimization/Multiple CPUs|threads]] and [[Performance Optimization/Multiple nodes (MPI)|MPI]].<br /> # For multi-step analyses, consider a [[Workflow Engines (Snakemake, Nextflow)|workflow engine]].<br /> <br /> == Tips ==<br /> <br /> * Start small. Get one step working as a job before scaling to your whole dataset.<br /> * Request only the resources you need — over-requesting just means longer waits in the queue.<br /> * Keep your work reproducible from the start — see [[Reproducibility Guidelines]].<br /> <br /> == See also ==<br /> * [[Batch Jobs]]<br /> * [[Software Overview]]<br /> * [[Storage Systems Overview]]<br /> * [[Reproducibility Guidelines]]</div>

Haars0011