Modules - Revision history

Honfi001: Updates

2025-11-20T16:28:41Z

Updates

← Older revision		Revision as of 18:28, 20 November 2025
Line 7:		Line 7:
	The point is to have a conveyor belt of software and have more up-to-date software with more modern build tools (GCC, MPI, intel), which makes the software more maintainable. The conveyor belt also enables the use of more modern toolchains (foss, intel), which will enable software to run more efficiently.		The point is to have a conveyor belt of software and have more up-to-date software with more modern build tools (GCC, MPI, intel), which makes the software more maintainable. The conveyor belt also enables the use of more modern toolchains (foss, intel), which will enable software to run more efficiently.

	For each bucket, we intend to keep one version of software.~~Currently there~~ are ~~five~~ buckets available: legacy, groups, 2023, 2024 and GPU		For each bucket, we intend to keep one version of software. These are the buckets currently available at Anunna: legacy, utilities, groups, 2023, 2024 and GPU

	The new modules have been built with the aid of EasyBuild (https://easybuild.io/)		The new modules have been built with the aid of EasyBuild (https://easybuild.io/)

	EasyBuild makes use of publicly shared recipe's, called ~~EasyConfigs~~. Have a look at their repository for available software:		EasyBuild makes use of publicly shared recipe's, called easyconfigs. Have a look at their repository for available software:

	https://github.com/easybuilders/easybuild-easyconfigs/tree/develop/easybuild/easyconfigs		https://github.com/easybuilders/easybuild-easyconfigs/tree/develop/easybuild/easyconfigs
Line 17:		Line 17:
	===Requesting Modules===		===Requesting Modules===

	~~In principle~~, ~~all modules from the above listed repository should be available for installation on Anunna~~. ~~Please reach out~~ to the ~~admins per support ticket if~~ you ~~want to~~ request ~~the installation~~ of ~~a new module~~. ~~In the future we plan to build a module deployment pipeline~~ with ~~an easy to use user interface, where modules can~~ be ~~requested and installed with minimal admin interference. More on this later.~~.		If a module you require is not available, please submit a software request at https://ideas.anunna.wur.nl . There you are able to follow the progress of the software you need and upvote the request of other users. The software or features with more upvotes will be prioritised sooner.

	===Module Organization===		===Module Organization===

Honfi001 at 16:22, 20 November 2025

2025-11-20T16:22:30Z

← Older revision		Revision as of 18:22, 20 November 2025
Line 26:		Line 26:
	* '''2023''' - software built using the 2023 compilers and toolchain. It is meant to contain a single version of each software.		* '''2023''' - software built using the 2023 compilers and toolchain. It is meant to contain a single version of each software.
	* '''2024''' - software built using the 2024 compilers and toolchain. It is meant to contain a single version of each software.		* '''2024''' - software built using the 2024 compilers and toolchain. It is meant to contain a single version of each software.
			* '''utilities''' - software that is not dependent on specific compilers or toolchains.
	* '''groups''' - This bucket contains subfolders containing module files for groups in and outside the WUR.		* '''groups''' - This bucket contains subfolders containing module files for groups in and outside the WUR.
	* '''GPU''' - CUDA, cuDNN and related packages that are independent of toolchains		* '''GPU''' - CUDA, cuDNN and related packages that are independent of toolchains

Honfi001 at 14:51, 13 December 2024

2024-12-13T14:51:50Z

← Older revision		Revision as of 16:51, 13 December 2024
Line 23:		Line 23:
	Modules are to be organized into buckets by year or additional categories. Current buckets are		Modules are to be organized into buckets by year or additional categories. Current buckets are

	* legacy - old software that is no longer maintained or updated, but it is still used in active research.		* '''legacy''' - old software that is no longer maintained or updated, but it is still used in active research.
	* 2023 - software built using the 2023 compilers and toolchain. It is meant to contain a single version of each software.		* '''2023''' - software built using the 2023 compilers and toolchain. It is meant to contain a single version of each software.
	* 2024 - software built using the 2024 compilers and toolchain. It is meant to contain a single version of each software.		* '''2024''' - software built using the 2024 compilers and toolchain. It is meant to contain a single version of each software.
	* groups - This bucket contains subfolders containing module files for groups in and outside the WUR.		* '''groups''' - This bucket contains subfolders containing module files for groups in and outside the WUR.
	* GPU - CUDA, cuDNN and related packages that are independent of toolchains		* '''GPU''' - CUDA, cuDNN and related packages that are independent of toolchains

	In order to access the modules of the 2023 bucket one needs to execute the following commands:		In order to access the modules of the '''2023''' bucket one needs to execute the following commands:

	<pre>module load 2023</pre>		<pre>module load 2023</pre>

Prins0891 at 13:57, 13 December 2024

2024-12-13T13:57:46Z

← Older revision		Revision as of 15:57, 13 December 2024
Line 7:		Line 7:
	The point is to have a conveyor belt of software and have more up-to-date software with more modern build tools (GCC, MPI, intel), which makes the software more maintainable. The conveyor belt also enables the use of more modern toolchains (foss, intel), which will enable software to run more efficiently.		The point is to have a conveyor belt of software and have more up-to-date software with more modern build tools (GCC, MPI, intel), which makes the software more maintainable. The conveyor belt also enables the use of more modern toolchains (foss, intel), which will enable software to run more efficiently.

	For each bucket, we intend to keep one version of software.Currently there are five buckets available		For each bucket, we intend to keep one version of software.Currently there are five buckets available: legacy, groups, 2023, 2024 and GPU

	* legacy - old unmaintained packages		The new modules have been built with the aid of EasyBuild (https://easybuild.io/)
	* groups - bucket containing modules ~~for individual groups.~~
	* 2023 - packages built with the 2023 toolchain
	* 2024 - packages built with the ~~2024 toolchain~~
	* GPU - mainly CUDA and related packages that are independent of ~~toolchains~~.

	~~The~~ new modules ~~have been built~~ with ~~the aid of EasyBuild~~		EasyBuild makes use of publicly shared recipe's, called EasyConfigs. Have a look at their repository for available software:

			https://github.com/easybuilders/easybuild-easyconfigs/tree/develop/easybuild/easyconfigs

			===Requesting Modules===

			In principle, all modules from the above listed repository should be available for installation on Anunna. Please reach out to the admins per support ticket if you want to request the installation of a new module. In the future we plan to build a module deployment pipeline with an easy to use user interface, where modules can be requested and installed with minimal admin interference. More on this later..

	===Module Organization===		===Module Organization===

Prins0891 at 13:50, 13 December 2024

2024-12-13T13:50:52Z

← Older revision		Revision as of 15:50, 13 December 2024
Line 16:		Line 16:

	The new modules have been built with the aid of EasyBuild		The new modules have been built with the aid of EasyBuild


	~~==Module Migration==~~

	* Current modules are crowded, disorganized and inefficient
	* Modules are being organized in buckets for each year, with a legacy bucket for old software
	* legacy software is no longer maintained
	* Module in the main location are going to be removed after the 10 December 2024 downtime
	* 2023 and legacy bucket are already available
	* Users are encouraged to adapt their code to the new bucket system as soon as possible to avoid disruption



	===Module Organization===		===Module Organization===

Prins0891 at 13:49, 13 December 2024

2024-12-13T13:49:19Z

← Older revision		Revision as of 15:49, 13 December 2024
Line 7:		Line 7:
	The point is to have a conveyor belt of software and have more up-to-date software with more modern build tools (GCC, MPI, intel), which makes the software more maintainable. The conveyor belt also enables the use of more modern toolchains (foss, intel), which will enable software to run more efficiently.		The point is to have a conveyor belt of software and have more up-to-date software with more modern build tools (GCC, MPI, intel), which makes the software more maintainable. The conveyor belt also enables the use of more modern toolchains (foss, intel), which will enable software to run more efficiently.

	For each bucket, we intend to keep one version of software.Currently there are ~~three~~ buckets available		For each bucket, we intend to keep one version of software.Currently there are five buckets available

	* legacy - old unmaintained packages		* legacy - old unmaintained packages

Honfi001 at 09:43, 13 December 2024

2024-12-13T09:43:08Z

← Older revision		Revision as of 11:43, 13 December 2024
Line 10:		Line 10:

	* legacy - old unmaintained packages		* legacy - old unmaintained packages
	* 2023 - packages ~~for~~ the 2023 toolchain		* groups - bucket containing modules for individual groups.
			* 2023 - packages built with the 2023 toolchain
			* 2024 - packages built with the 2024 toolchain
	* GPU - mainly CUDA and related packages that are independent of toolchains.		* GPU - mainly CUDA and related packages that are independent of toolchains.

Line 19:		Line 21:

	* Current modules are crowded, disorganized and inefficient		* Current modules are crowded, disorganized and inefficient
	* Modules are being organized in buckets for each year with a legacy bucket for old software		* Modules are being organized in buckets for each year, with a legacy bucket for old software
	* legacy software is no longer maintained		* legacy software is no longer maintained
	* Module in the main location are going to be removed after the 10 December 2024 downtime		* Module in the main location are going to be removed after the 10 December 2024 downtime
	* 2023 and legacy bucket are already available		* 2023 and legacy bucket are already available
	* Users are encouraged to adapt their code to the new bucket system as soon as possible to avoid disruption		* Users are encouraged to adapt their code to the new bucket system as soon as possible to avoid disruption



Line 32:		Line 35:
	* legacy - old software that is no longer maintained or updated, but it is still used in active research.		* legacy - old software that is no longer maintained or updated, but it is still used in active research.
	* 2023 - software built using the 2023 compilers and toolchain. It is meant to contain a single version of each software.		* 2023 - software built using the 2023 compilers and toolchain. It is meant to contain a single version of each software.
			* 2024 - software built using the 2024 compilers and toolchain. It is meant to contain a single version of each software.
			* groups - This bucket contains subfolders containing module files for groups in and outside the WUR.
	* GPU - CUDA, cuDNN and related packages that are independent of toolchains		* GPU - CUDA, cuDNN and related packages that are independent of toolchains

Prins0891 at 11:50, 22 November 2024

2024-11-22T11:50:58Z

← Older revision		Revision as of 13:50, 22 November 2024
Line 21:		Line 21:
	* Modules are being organized in buckets for each year with a legacy bucket for old software		* Modules are being organized in buckets for each year with a legacy bucket for old software
	* legacy software is no longer maintained		* legacy software is no longer maintained
	* Module in the main location are going to be removed ~~at some point (not yet defined)~~		* Module in the main location are going to be removed after the 10 December 2024 downtime
	* 2023 and legacy bucket are already available		* 2023 and legacy bucket are already available
	* Users are encouraged to adapt their code to the new bucket system as soon as possible to avoid disruption		* Users are encouraged to adapt their code to the new bucket system as soon as possible to avoid disruption

Honfi001: /* Module Organization */

2024-09-04T15:06:03Z

Module Organization

← Older revision		Revision as of 17:06, 4 September 2024
Line 41:		Line 41:

	<pre>module avail</pre>		<pre>module avail</pre>

			===Why Buckets?===

			As time goes by, software is developed with newer compilers and tools. So the buckets are snapshots of these new compilers and tools that have been used to develop and build these pieces of software. The compilers will determine which processor operations will be supported by the software, so if a job runs software from two different compilers conflicts, errors or unwanted behaviour may occur.

			Therefore, it is best to have jobs with software built from the same compiler. This is the purpose of the buckets, where all the software should be built with the same compiler.

	==Usage==		==Usage==

Honfi001: /* Module Migration */

2024-08-27T07:37:58Z

Module Migration

← Older revision		Revision as of 09:37, 27 August 2024
Line 18:		Line 18:
	==Module Migration==		==Module Migration==

	* ~~current~~ modules are crowded, disorganized and inefficient		* Current modules are crowded, disorganized and inefficient
	* Modules are being organized in buckets for each year with a legacy bucket for old software		* Modules are being organized in buckets for each year with a legacy bucket for old software
	* legacy software is no longer maintained		* legacy software is no longer maintained
Line 30:		Line 30:
	Modules are to be organized into buckets by year or additional categories. Current buckets are		Modules are to be organized into buckets by year or additional categories. Current buckets are

	* legacy		* legacy - old software that is no longer maintained or updated, but it is still used in active research.
	* 2023		* 2023 - software built using the 2023 compilers and toolchain. It is meant to contain a single version of each software.
	* GPU		* GPU - CUDA, cuDNN and related packages that are independent of toolchains

	~~The legacy bucket contains~~ old software that is no longer maintained or updated, but it is still used in active research.
	~~The~~ 2023 ~~bucket contains~~ software built using the 2023 toolchain. It is meant to contain a single version of each software.
	~~The~~ GPU ~~bucket contains~~ CUDA, cuDNN and related packages that are independent of toolchains.

	In order to access the modules of the 2023 bucket one needs to execute the following commands:		In order to access the modules of the 2023 bucket one needs to execute the following commands: