Filesystems: Difference between revisions
Jump to navigation
Jump to search
m (Dawes001 moved page Lustre PFS layout to Filesystems: Make more generic.) |
No edit summary |
||
| Line 1: | Line 1: | ||
The AgroGenomics HPC currently has multiple filesystem mounts that are available cluster-wide: | |||
* /home - This mount uses NFS to mount the home directories directly from nfs01. Each user has a 200G quota for this filesystem, as it is regularly backed up to tape, and can reliably be restored from up to a week's history. | |||
* /cm/shared - This mount provides a consistent set of binaries for the entire cluster. | |||
* /lustre - This large mount uses the Lustre filesystem to provide files from multiple redundant servers. Access is provided per group, thus: | |||
/lustre/[level]/[partner]/[unit] | |||
e.g. | e.g. | ||
/lustre/backup/WUR/ABGC/ | |||
It comprises of three major parts (and some minor): | |||
* /lustre/backup - In case of disaster, this data is stored a second time on a separate machine. Whilst this backup is purely in case of complete tragedy (such as some immense filesystem error, or multiple component failure), it can potentially be used to revert mistakes if you are very fast about reporting them. There is however no guarantee of this service. | |||
* /lustre/nobackup - This is the 'normal' filesystem for Lustre - no backups, just stored on the filesystem. Without having a backup needed, the cost of data here is not as much as under /lustre/backup, but in case of disaster cannot be recivered. | |||
* /lustre/scratch - Files here may be removed after some time if the filesystem gets too full (Typically 30 days). You should tidy up this data yourself once work is complete. | |||
* /lustre/shared - Same as /lustre/backup, except publicly available. This is where truly shared data lives that isn't assigned to a specific group. | |||
Specific to certain machines are some other filesystems that are available to you: | |||
* /archive - an archive mount only accessible from nfs01. Files here are sent to the Isilon for deeper storage. The cost of storing data here is much less than on the Lustre, but it cannot be used for compute work. This is only available to WUR users, as the Isilon is unable to resolve local groups (without additional work). | |||
* /tmp - On each worker node there is a (large) /tmp mount that can be used for temporary local caching. Be advised that you should clean this up, lest your files become accessible to other users. | |||
* /dev/shm - On each worker you may also create a virtual filesystem directly into memory, for extremely fast data access. Be advised that this will count against the memory used for your job, but it is also the fastest available filesystem if needed. | |||
== See also == | == See also == | ||
Revision as of 15:07, 12 July 2017
The AgroGenomics HPC currently has multiple filesystem mounts that are available cluster-wide:
- /home - This mount uses NFS to mount the home directories directly from nfs01. Each user has a 200G quota for this filesystem, as it is regularly backed up to tape, and can reliably be restored from up to a week's history.
- /cm/shared - This mount provides a consistent set of binaries for the entire cluster.
- /lustre - This large mount uses the Lustre filesystem to provide files from multiple redundant servers. Access is provided per group, thus:
/lustre/[level]/[partner]/[unit]
e.g.
/lustre/backup/WUR/ABGC/
It comprises of three major parts (and some minor):
- /lustre/backup - In case of disaster, this data is stored a second time on a separate machine. Whilst this backup is purely in case of complete tragedy (such as some immense filesystem error, or multiple component failure), it can potentially be used to revert mistakes if you are very fast about reporting them. There is however no guarantee of this service.
- /lustre/nobackup - This is the 'normal' filesystem for Lustre - no backups, just stored on the filesystem. Without having a backup needed, the cost of data here is not as much as under /lustre/backup, but in case of disaster cannot be recivered.
- /lustre/scratch - Files here may be removed after some time if the filesystem gets too full (Typically 30 days). You should tidy up this data yourself once work is complete.
- /lustre/shared - Same as /lustre/backup, except publicly available. This is where truly shared data lives that isn't assigned to a specific group.
Specific to certain machines are some other filesystems that are available to you:
- /archive - an archive mount only accessible from nfs01. Files here are sent to the Isilon for deeper storage. The cost of storing data here is much less than on the Lustre, but it cannot be used for compute work. This is only available to WUR users, as the Isilon is unable to resolve local groups (without additional work).
- /tmp - On each worker node there is a (large) /tmp mount that can be used for temporary local caching. Be advised that you should clean this up, lest your files become accessible to other users.
- /dev/shm - On each worker you may also create a virtual filesystem directly into memory, for extremely fast data access. Be advised that this will count against the memory used for your job, but it is also the fastest available filesystem if needed.