Jump to content

Main Page: Difference between revisions

From HPCwiki
Hjmegens (talk | contribs)
No edit summary
 
mNo edit summary
 
(225 intermediate revisions by 20 users not shown)
Line 1: Line 1:
= '''Animal Breeding & Genomics Centre Wiki''' =
Anunna is a [http://en.wikipedia.org/wiki/High-performance_computing High Performance Computing] (HPC) cluster hosted by [https://www.wur.nl/ Wageningen University & Research]. It is open to all WUR research groups, and to other organisations and companies running collaborative projects with WUR.


You reach the cluster over [[SSH Access|SSH]] at <code>login.anunna.wur.nl</code>, or through your browser at the [[Apps Portal]] (https://apps.anunna.wur.nl/).


'''Welcome to the Animal Breeding and Genomics Centre Wiki Site!'''
== [[About]] ==
* <h3>[[Mission and Governance]]</h3> What Anunna is for and who runs it
* <h3>[[Roadmap]]</h3> How we decide what to work on
* <h3>[[Cluster Architecture Overview]]</h3> How the cluster is put together
* <h3>[[Compute_Hardware_Overview]]</h3> The node types and their hardware
* <h3>[[Storage Systems Overview]]</h3> The storage tiers at a glance
* <h3>[[Tariffs]]</h3> Costs of using Anunna
* <h3>[[Network & Security]]</h3> Interconnect and data-security posture
* <h3>[[History of the Cluster]]</h3> How Anunna came to be
* <h3>[[Sustainability]]</h3> Green-HPC policy and measures
* <h3>[[FAQ]]</h3> Frequently Asked Questions
* <h3>[[Policies and Terms of Use]]</h3> Who may use Anunna and on what terms
*


The intended use of this Wiki is to share information between members of the ABGC. You may like to add pages on lab-protocols, bioinformatics protocols and scripts, meeting schedules, best practices, important addresses, meeting room locations, etc, etc.
== [[Get Started]] ==
* <h3>[[Who Can Access?]]</h3> Eligibility
* <h3>[[Account Application Process]]</h3> How to request an account
* <h3>[[User Responsibilities]]</h3> What is expected of you as a user
* <h3>[[SSH Access]]</h3> Logging in over SSH to the cluster
* <h3>[[Apps Portal]]</h3> Using applications on Anunna through your web browser
* <h3>[[Workflow Migration from Laptop to HPC]]</h3> Moving your work to the cluster from your computer
* <h3>[[Grant_Support_%26_Acknowledgement|Grant support & Acknowledgement]]</h3> Guidance and standard text that can be used in grant proposals, research papers, theses and other publications.


In the true spirit of the WikiMedia foundation, we aim to keep the restrictions to access as low as possible. This means that this site will generally not be a good place to share sensitive information on projects etc. The group-specific portals (such as [https://portal2.wur.nl/sites/abg/ ABG portal]) will be a better place for that. The advantage of a Wiki is that it is searchable, and setting up a Wiki page to share your specific topic is really easy.
== [[System Access]] ==
* <h3>[[Login Nodes]]</h3> The entry point you connect to
* <h3>[[Compute Nodes]]</h3> Where your jobs run, and how to reach them
* <h3>[[Filesystems]]</h3> The storage tiers
* <h3>[[Quotas]]</h3> Storage limits and how to check them
* <h3>[[Remote Access (VPN, Gateway)]]</h3> Reaching Anunna from off campus
* <h3>[[Data Transfer Methods]]</h3> Moving data to and from Anunna


Currently you will need to create an account (link is found upper right corner of this site) to be able to create and edit pages. Please feel free to add content to this Wiki to make this a useful resource for Animal Breeding and Genomics Centre members and guests!
== [[Scheduling|Job Scheduling and Resource Management]] ==
* <h3>[[Scheduler Overview (Slurm)]]</h3> How scheduling works
* <h3>[[Partitions / Queues]]</h3> The available partitions
* <h3>[[Choosing a node (constraints)]]</h3> Targeting particular hardware
* <h3>[[Batch Jobs]]</h3> Submitting a batch script
* <h3>[[Interactive Jobs]]</h3> An interactive shell on a compute node
* <h3>[[Array Jobs]]</h3> Running many similar jobs at once
* <h3>[[Monitoring Jobs]]</h3> Checking on your jobs
* <h3>[[Cancelling Jobs]]</h3> Stopping a job
* <h3>[[Reservations]]</h3> Reserving nodes
* <h3>[[Fair Use Policy]]</h3> Using shared resources considerately


== Topics ==
== [[Software]] ==
{| width="100%"
* <h3>[[Software Overview]]</h3> The software landscape
|- valign="top"
* <h3>[[Environment Modules]]</h3> Loading software with modules and buckets
| width="25%" |
* <h3>[[Installing Personal Software]]</h3> Installing into your own space
* [[about ABGC|about ABGC ]]
* <h3>[[Licensed Software]]</h3> Software that needs a licence
* [[ABGC secretariat|Front office and secretariat]]
* [[events|events]]
| width="25%" |
* [[courses|courses]]
* [[ABGC lab|molecular lab]]
* [[Computer cluster | High Performance Compute infrastructure]]
| width="25%" |
* [[ABGC bioinformatics |bioinformatics]]
* [[quantitative genetics]]
* [[Genomics Journal Club | Genomics Journal Club]]
|}


== Groups ==
* <h3>Scripting languages</h3>
{| width="100%"
** <h4>[[Python]]</h4> Python modules and environment managers
|- valign="top"
** <h4>[[R]]</h4> R modules, packages, and parallel R jobs
| width="25%" |
** <h4>[[Julia]]</h4> Loading Julia, packages, and running it in a job
* [[Animal Breeding and Genetics|Animal Breeding and Genetics chair group]]
| width="25%" |
* [[Genetics and Genomics|Genetic and Genomics Research Cluster]]
| width="25%" |
|}


== About this Wiki ==
* <h3>Containers</h3>
{| width="100%"
** <h4>[[Apptainer]]</h4> Portable, reproducible containers for HPC
|- valign="top"
 
| width="25%" |
* <h3>MPI implementations</h3>
* [[ABGCwiki:About| About ABGCwiki]]
** <h4>[[OpenMPI]]</h4> The MPI library Anunna is built around
| width="25%" |
** <h4>[[IntelMPI]]</h4> Intel MPI, with the Intel compilers and MKL
* [[Special:Listusers|users]]
 
| width="25%" |
== [[Storage]] ==
|}
* <h3>[[Storage Systems Overview]]</h3> The storage tiers at a glance
* <h3>[[Home Directory]]</h3> Your personal space
* <h3>[[Compute Storage]]</h3> The fast Lustre filesystem for active work
* <h3>[[Shared Storage]]</h3> Sharing data within a group
* <h3>[[Backup Policy]]</h3> What is backed up, and what is not
* <h3>[[Archival Storage]]</h3> Long-term storage on tape
* <h3>[[Quotas]]</h3> Storage limits
* <h3>[[Data Lifecycle Policy]]</h3> How data moves from active to archived to removed
* <h3>[[Data storage best practices|Data Storage Best Practices]]</h3> Keeping data safe, tidy, and cheap
* <h3>[[Data Transfer Best Practices]]</h3> Moving data efficiently and reliably
* <h3>[[Handling Sensitive Data (GDPR, etc.)]]</h3> Confidential and personal data
 
== Graphical Interface Applications ==
* <h3>[[Portal Overview]]</h3> What the portal is and how the dashboard is laid out
* <h3>[[Running GUI Applications]]</h3> The general way to launch and connect to a graphical application
* <h3>[[How to Launch a Desktop Session]]</h3> Start a full Linux desktop in your browser
* <h3>[[Jupyter]]</h3> Jupyter notebooks
* <h3>[[RStudio]]</h3> The RStudio IDE for R and Python
* <h3>[[File Browser]]</h3> Manage your files in the browser
* <h3>[[Shell Access]]</h3> A terminal in the browser
* <h3>[[Jobs Queue Overview]]</h3> See your jobs in the browser
 
== [[Training]] ==
* <h3>[[Training Materials]]</h3> Course slides and self-study resources
* <h3>[[Tutorials]]</h3> Hands-on tutorials
* <h3>[[Workshops]]</h3> Instructor-led courses and their dates
 
== [[Support]] ==
* <h3>[[How to Get Help]]</h3> Who to contact and how
* <h3>[[Support Ticket System]]</h3> The WUR support portal
* <h3>[[Reporting Incidents]]</h3> Writing a good problem report
* <h3>[[Known Issues]]</h3> Current problems and workarounds
* <h3>[[Our User community]]</h3> The Anunna user community
* <h3>[[Maintenance Schedule]]</h3> Planned downtimes
 
== [[For PIs]] ==
* <h3>[[Dos and Don'ts]]</h3> Good and bad practice at a glance
* <h3>[[Managing Group Members]]</h3> Working with groups
* <h3>[[Storage Requests]]</h3> Requesting more storage
* <h3>[[Resource Allocation Requests]]</h3> Requesting larger or dedicated allocations
* <h3>[[External Collaborator Access]]</h3> Giving access to collaborators outside WUR
* <h3>[[Reporting Usage]]</h3> Tracking your group's usage and costs
* <h3>[[Grant Support & Acknowledgement]]</h3> Facility descriptions and support for funding applications
 
== [[Workflows]] ==
* <h3>[[Workflow Migration from Laptop to HPC]]</h3> Moving your work to the cluster
* <h3>[[Reproducibility Guidelines]]</h3> Keeping your work reproducible
* <h3>[[Workflow Engines (Snakemake, Nextflow)]]</h3> Managing multi-step pipelines
* <h3>[[Debugging Jobs]]</h3> Working out why a job failed
* <h3>[[Checkpointing]]</h3> Saving and restarting long jobs
* <h3>[[Scheduled tasks (cron)|Scheduled Tasks (cron)]]</h3> Running recurring tasks with scrontab
 
* <h3>Parallel Workflows</h3>
** <h4>[[Workflows/Parallel-Computing|Parallel Computing]]</h4> What parallel computing means on Anunna, and which type fits your work
** <h4>[[Workflows/Serial|Serial]]</h4> One program on a single core — the baseline
** <h4>[[Workflows/Embarassinly-Parallel|Embarrassingly Parallel]]</h4> Running the same program many times over
** <h4>[[Workflows/Multi-threaded|Multi-threaded]]</h4> Many cores on one machine, within a single process
** <h4>[[Workflows/Multi-Process|Multi-Process]]</h4> One calculation spread across several machines
 
== Quick links ==
 
* [[How to Get Help]] — contact the HPC team
* [[Maintenance Schedule]] — planned downtimes
* [[Glossary of Terms]] — common HPC and Anunna terms explained
 
== External links ==
 
* [https://www.wur.nl/en/Value-Creation-Cooperation/Facilities/Wageningen-Shared-Research-Facilities/Our-facilities/Show/High-Performance-Computing-Cluster-HPC-Anunna.htm Wageningen Shared Research Facilities — HPC]

Latest revision as of 06:49, 31 August 2026

Anunna is a High Performance Computing (HPC) cluster hosted by Wageningen University & Research. It is open to all WUR research groups, and to other organisations and companies running collaborative projects with WUR.

You reach the cluster over SSH at login.anunna.wur.nl, or through your browser at the Apps Portal (https://apps.anunna.wur.nl/).

  • Scripting languages

    • Python modules and environment managers
    • R modules, packages, and parallel R jobs
    • Loading Julia, packages, and running it in a job
  • Containers

    • Portable, reproducible containers for HPC
  • MPI implementations

    • The MPI library Anunna is built around
    • Intel MPI, with the Intel compilers and MKL

Graphical Interface Applications