|
|
| (64 intermediate revisions by 10 users not shown) |
| Line 1: |
Line 1: |
| Anunna is a [http://en.wikipedia.org/wiki/High-performance_computing High Performance Computer] (HPC) infrastructure hosted by [http://www.wageningenur.nl/nl/activiteit/Opening-High-Performance-Computing-cluster-HPC.htm Wageningen University & Research Centre]. It is open for use for all WUR research groups as well as other organizations, including companies, that have collaborative projects with WUR. | | Anunna is a [http://en.wikipedia.org/wiki/High-performance_computing High Performance Computing] (HPC) cluster hosted by [https://www.wur.nl/ Wageningen University & Research]. It is open to all WUR research groups, and to other organisations and companies running collaborative projects with WUR. |
|
| |
|
| = Using Anunna =
| | You reach the cluster over [[SSH Access|SSH]] at <code>login.anunna.wur.nl</code>, or through your browser at the [[Apps Portal]] (https://apps.anunna.wur.nl/). |
| * [[Tariffs | Costs associated with resource usage]]
| |
|
| |
|
| == Gaining access to Anunna== | | == Documentation == |
| Access to the cluster and file transfer are traditionally done via [http://en.wikipedia.org/wiki/Secure_Shell SSH and SFTP].
| |
| * [[log_in_to_B4F_cluster | Logging into cluster using ssh and file transfer]]
| |
| * [[Services | Alternative access methods, and extra features and services on Anunna]]
| |
| * [[Filesystems | Accessible storage methods on Anunna]]
| |
|
| |
|
| == Access Policy == | | === Start here === |
| [[Access_Policy | Main Article: Access Policy]]
| |
|
| |
|
| Access needs to be granted actively (by creation of an account on the cluster by FB-IT). Use of resources is limited by the scheduler. Depending on availability of queues ('partitions') granted to a user, priority to the system's resources is regulated. Note that the use of Anunna is not free of charge. List price of CPU time and storage, and possible discounts on that list price for your organisation, can be retrieved from CAT-AGRO or FB-ICT.
| | * [[About]] — what Anunna is, how it is built and run, and the policies that apply |
| | * [[Get Started]] — eligibility, getting an account, and logging in |
| | * [[Glossary of Terms]] — common HPC and Anunna terms explained |
|
| |
|
| == testing == | | === Using the cluster === |
| * [[New_page | my shiny new test page]]
| |
|
| |
|
| = Events =
| | * [[System Access]] — login and compute nodes, filesystems, data transfer |
| * [[Courses]] that have happened and are happening | | * [[Scheduling]] — submitting and managing jobs with SLURM |
| * [[Downtime]] that will affect all users | | * [[Software]] — modules, languages, containers, and licensed software |
| * [[Meetings]] that may affect the policies of Anunna | | * [[Storage]] — the storage tiers and how data is kept and protected |
| | * [[Apps Portal]] — graphical applications and desktops in your browser |
| | * [[Workflows]] — reproducible, efficient research workflows |
|
| |
|
| = Other Software = | | === Help and more === |
|
| |
|
| == Cluster Management Software and Scheduler ==
| | * [[Training]] — courses, tutorials, and reference material |
| Anunna uses Bright Cluster Manager software for overall cluster management, and Slurm as job scheduler.
| | * [[Support]] — getting help, reporting problems, and cluster status |
| * [[BCM_on_B4F_cluster | Monitor cluster status with BCM]] | | * [[For PIs]] — projects, allocations, and group management for group leaders |
| * [[Using_Slurm | Submit jobs with Slurm]] | |
| * [[node_usage_graph | Be aware of how much work the cluster is under right now with 'node_usage_graph']]
| |
| * [[SLURM_Compare | Rosetta Stone of Workload Managers]] | |
|
| |
|
| == Installation of software by users == | | == Quick links == |
|
| |
|
| * [[Domain_specific_software_on_B4Fcluster_installation_by_users | Installing domain specific software: installation by users]] | | * [[How to Get Help]] — contact the HPC team |
| * [[Setting local variables]] | | * [[Tariffs]] — costs of using Anunna |
| * [[Installing_R_packages_locally | Installing R packages locally]]
| | * [[Maintenance Schedule]] — planned downtimes |
| * [[Setting_up_Python_virtualenv | Setting up and using a virtual environment for Python3 ]]
| |
| * [[Virtual_environment_Python_3.4_or_higher | Setting up and using a virtual environment for Python3.4 or higher ]]
| |
| * [[Installing WRF and WPS]] | |
|
| |
|
| == Installed software == | | == External links == |
|
| |
|
| * [[Globally_installed_software | Globally installed software]] | | * [https://www.wur.nl/en/Value-Creation-Cooperation/Facilities/Wageningen-Shared-Research-Facilities/Our-facilities/Show/High-Performance-Computing-Cluster-HPC-Anunna.htm Wageningen Shared Research Facilities — HPC] |
| * [[ABGC_modules | ABGC specific modules]]
| |
| | |
| = Useful Notes =
| |
| | |
| == Being in control of Environment parameters ==
| |
| | |
| * [[Using_environment_modules | Using environment modules]]
| |
| * [[Setting local variables]]
| |
| * [[Setting_TMPDIR | Set a custom temporary directory location]]
| |
| * [[Installing_R_packages_locally | Installing R packages locally]]
| |
| * [[Setting_up_Python_virtualenv | Setting up and using a virtual environment for Python3 ]]
| |
| | |
| == Controlling costs ==
| |
| | |
| * [[SACCT | using SACCT to see your costs]]
| |
| * [[get_my_bill | using the "get_my_bill" script to estimate costs]]
| |
| | |
| == Management ==
| |
| Project Leader of Anunna is Stephen Janssen (Wageningen UR,FB-IT, Service Management). [[User:dawes001 | Gwen Dawes (Wageningen UR, FB-IT, Infrastructure)]] and [[User:bexke002 | Stefan Bexkens (Wageningen UR,FB-IT, Infrastructure)]] are responsible for [[Maintenance_and_Management | Maintenance and Management]] of the cluster.
| |
| | |
| * [[Roadmap | Ambitions regarding innovation, support and administration of Anunna ]]
| |
| | |
| = Miscellaneous =
| |
| * [[Mailinglist | Electronic mail discussion lists]]
| |
| * [[History_of_the_Cluster | Historical information on the startup of Anunna]]
| |
| * [[Bioinformatics_tips_tricks_workflows | Bioinformatics tips, tricks, and workflows]]
| |
| * [[Parallel_R_code_on_SLURM | Running parallel R code on SLURM]]
| |
| * [[Convert_between_MediaWiki_and_other_formats | Convert between MediaWiki format and other formats]]
| |
| * [[Manual GitLab | GitLab: Create projects and add scripts]]
| |
| * [[Monitoring_executions | Monitoring job execution]]
| |
| * [[Shared_folders | Working with shared folders in the Lustre file system]]
| |
| | |
| = See also =
| |
| * [[Maintenance_and_Management | Maintenance and Management]]
| |
| * [[BCData | BCData]]
| |
| * [[Mailinglist | Electronic mail discussion lists]]
| |
| * [[About_ABGC | About ABGC]]
| |
| * [[Computer_cluster | High Performance Computing @ABGC]]
| |
| * [[Lustre_PFS_layout | Lustre Parallel File System layout]]
| |
| | |
| = External links =
| |
| {| width="90%"
| |
| |- valign="top"
| |
| | width="30%" |
| |
| * [http://www.breed4food.com/en/show/Breed4Food-initiative-reinforces-the-Netherlands-position-as-an-innovative-country-in-animal-breeding-and-genomics.htm Breed4Food programme]
| |
| * [http://www.wageningenur.nl/en/Expertise-Services/Facilities/CATAgroFood-3/CATAgroFood-3/Our-facilities/Show/High-Performance-Computing-Cluster-HPC.htm CATAgroFood offers a HPC facilty]
| |
| * [http://www.cobb-vantress.com Cobb-Vantress homepage]
| |
| | |
| | width="30%" |
| |
| * [https://www.crv4all.nl CRV homepage]
| |
| * [http://www.hendrix-genetics.com Hendrix Genetics homepage]
| |
| * [http://www.topigs.com TOPIGS homepage]
| |
| | width="30%" |
| |
| * [http://en.wikipedia.org/wiki/Scientific_Linux Scientific Linux]
| |
| * [http://en.wikipedia.org/wiki/Help:Cheatsheet Help with editing Wiki pages]
| |
| |}
| |