Main Page: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
(123 intermediate revisions by 19 users not shown) | |||
Line 1: | Line 1: | ||
Anunna is a [http://en.wikipedia.org/wiki/High-performance_computing High Performance Computer] (HPC) infrastructure hosted by [https://www.wur.nl/en/show/supercomputer-anunna-opens-up-more-opportunities-for-data-storage-and-artificial-intelligence-applications.htm Wageningen University & Research Centre]. It is open for use for all WUR research groups as well as other organizations, including companies, that have collaborative projects with WUR. | |||
== | == Access Policy == | ||
[[ | [[Access_Policy | Main Article: Access Policy]] | ||
Access needs to be granted actively (by creation of an account on the cluster by FB-IT). Use of resources is limited by the scheduler. Note that the use of Anunna is not free of charge. | |||
= Using Anunna = | |||
* | * [[Tariffs | Costs associated with resource usage]] | ||
==== | == Gaining access to Anunna== | ||
Access to the cluster and file transfer are traditionally done via [http://en.wikipedia.org/wiki/Secure_Shell SSH and SFTP]. | |||
* [[log_in_to_B4F_cluster | Logging into cluster using ssh]] | |||
* [[file_transfer | File transfer options]] | |||
* [[Services | Alternative access methods, and extra features and services on Anunna]] | |||
* [[Filesystems | Data storage methods on Anunna]] | |||
== Using Anunna for courses == | |||
* [[steps_for_courses | Steps involved to run a course on Anunna]] | |||
= Events = | |||
* [[Courses]] that have happened and are happening | |||
* [[Downtime]] that will affect all users | |||
* [[Meetings]] that may affect the policies of Anunna | |||
= Software = | |||
* [[Modules]] | |||
* [[Apptainer]] | |||
* [[Python]] | |||
* [[R]] | |||
* [[Julia]] | |||
=Web Apps= | |||
*[[Jupyter]] | |||
[[ | |||
= Other Software = | |||
== | == Cluster Scheduler == | ||
Anunna uses Slurm as job scheduler. | |||
* [[Using_Slurm | Submit jobs with Slurm]] | |||
* [[node_usage_graph | Be aware of how much work the cluster is under right now with 'node_usage_graph']] | |||
* [[SLURM_Compare | Rosetta Stone of Workload Managers]] | |||
== Installation of software by users == | |||
* [[Domain_specific_software_on_B4Fcluster_installation_by_users | Installing domain specific software: installation by users]] | * [[Domain_specific_software_on_B4Fcluster_installation_by_users | Installing domain specific software: installation by users]] | ||
Line 178: | Line 50: | ||
* [[Installing_R_packages_locally | Installing R packages locally]] | * [[Installing_R_packages_locally | Installing R packages locally]] | ||
* [[Setting_up_Python_virtualenv | Setting up and using a virtual environment for Python3 ]] | * [[Setting_up_Python_virtualenv | Setting up and using a virtual environment for Python3 ]] | ||
* [[Virtual_environment_Python_3.4_or_higher | Setting up and using a virtual environment for Python3.4 or higher ]] | |||
* [[Installing WRF and WPS]] | |||
* [[Running scripts on a fixed timeschedule (cron)]] | |||
=== Being in control of Environment parameters | == Installed software == | ||
* [[Globally_installed_software | Globally installed software]] | |||
* [[ABGC_modules | ABGC specific modules]] | |||
= Useful Notes = | |||
== Being in control of Environment parameters == | |||
* [[Using_environment_modules | Using environment modules]] | * [[Using_environment_modules | Using environment modules]] | ||
Line 187: | Line 69: | ||
* [[Setting_up_Python_virtualenv | Setting up and using a virtual environment for Python3 ]] | * [[Setting_up_Python_virtualenv | Setting up and using a virtual environment for Python3 ]] | ||
== Miscellaneous = | == Controlling costs == | ||
* [[SACCT | using SACCT to see your costs]] | |||
* [[get_my_bill | using the "get_my_bill" script to estimate costs]] | |||
== Management == | |||
Product Owner of Anunna is Alexander van Ittersum (Wageningen UR,FB-IT, C&PS). [[User: prins089 | Fons Prinsen (Wageningen UR, FB-IT, C&PS)]] is responsible for [[Maintenance_and_Management | Maintenance and Management]] of the cluster. | |||
* [[Roadmap | Ambitions regarding innovation, support and administration of Anunna ]] | |||
= Miscellaneous = | |||
* [[Mailinglist | Electronic mail discussion lists]] | |||
* [[History_of_the_Cluster | Historical information on the startup of Anunna]] | |||
* [[Bioinformatics_tips_tricks_workflows | Bioinformatics tips, tricks, and workflows]] | * [[Bioinformatics_tips_tricks_workflows | Bioinformatics tips, tricks, and workflows]] | ||
* [[Parallel_R_code_on_SLURM | Running parallel R code on SLURM]] | |||
* [[Convert_between_MediaWiki_and_other_formats | Convert between MediaWiki format and other formats]] | |||
* [[Manual GitLab | GitLab: Create projects and add scripts]] | |||
* [[Monitoring_executions | Monitoring job execution]] | |||
* [[Shared_folders | Working with shared folders in the Lustre file system]] | |||
* [[Old_binaries | Running older binaries on the updated OS]] | |||
= See also = | |||
* [[Maintenance_and_Management | Maintenance and Management]] | |||
* [[BCData | BCData]] | |||
* [[Mailinglist | Electronic mail discussion lists]] | |||
* [[About_ABGC | About ABGC]] | * [[About_ABGC | About ABGC]] | ||
* [[Computer_cluster | High Performance Computing @ABGC]] | * [[Computer_cluster | High Performance Computing @ABGC]] | ||
* [[Lustre_PFS_layout | Lustre Parallel File System layout]] | * [[Lustre_PFS_layout | Lustre Parallel File System layout]] | ||
= External links = | |||
{| width="90%" | {| width="90%" | ||
|- valign="top" | |- valign="top" | ||
| width="30%" | | | width="30%" | | ||
* [ | * [https://www.wur.nl/en/Value-Creation-Cooperation/Facilities/Wageningen-Shared-Research-Facilities/Our-facilities/Show/High-Performance-Computing-Cluster-HPC-Anunna.htm SRF offers a HPC facilty] | ||
| width="30%" | | | width="30%" | | ||
* [http://en.wikipedia.org/wiki/Scientific_Linux Scientific Linux] | * [http://en.wikipedia.org/wiki/Scientific_Linux Scientific Linux] | ||
* [http://en.wikipedia.org/wiki/Help:Cheatsheet Help with editing Wiki pages] | |||
|} | |} |
Latest revision as of 08:51, 28 October 2024
Anunna is a High Performance Computer (HPC) infrastructure hosted by Wageningen University & Research Centre. It is open for use for all WUR research groups as well as other organizations, including companies, that have collaborative projects with WUR.
Access Policy
Access needs to be granted actively (by creation of an account on the cluster by FB-IT). Use of resources is limited by the scheduler. Note that the use of Anunna is not free of charge.
Using Anunna
Gaining access to Anunna
Access to the cluster and file transfer are traditionally done via SSH and SFTP.
- Logging into cluster using ssh
- File transfer options
- Alternative access methods, and extra features and services on Anunna
- Data storage methods on Anunna
Using Anunna for courses
Events
- Courses that have happened and are happening
- Downtime that will affect all users
- Meetings that may affect the policies of Anunna
Software
Web Apps
Other Software
Cluster Scheduler
Anunna uses Slurm as job scheduler.
- Submit jobs with Slurm
- Be aware of how much work the cluster is under right now with 'node_usage_graph'
- Rosetta Stone of Workload Managers
Installation of software by users
- Installing domain specific software: installation by users
- Setting local variables
- Installing R packages locally
- Setting up and using a virtual environment for Python3
- Setting up and using a virtual environment for Python3.4 or higher
- Installing WRF and WPS
- Running scripts on a fixed timeschedule (cron)
Installed software
Useful Notes
Being in control of Environment parameters
- Using environment modules
- Setting local variables
- Set a custom temporary directory location
- Installing R packages locally
- Setting up and using a virtual environment for Python3
Controlling costs
Management
Product Owner of Anunna is Alexander van Ittersum (Wageningen UR,FB-IT, C&PS). Fons Prinsen (Wageningen UR, FB-IT, C&PS) is responsible for Maintenance and Management of the cluster.
Miscellaneous
- Electronic mail discussion lists
- Historical information on the startup of Anunna
- Bioinformatics tips, tricks, and workflows
- Running parallel R code on SLURM
- Convert between MediaWiki format and other formats
- GitLab: Create projects and add scripts
- Monitoring job execution
- Working with shared folders in the Lustre file system
- Running older binaries on the updated OS
See also
- Maintenance and Management
- BCData
- Electronic mail discussion lists
- About ABGC
- High Performance Computing @ABGC
- Lustre Parallel File System layout