|
|
| (2 intermediate revisions by 2 users not shown) |
| Line 1: |
Line 1: |
| | | #REDIRECT [[R#Parallel R]] |
| == Using R code on SLURM for embarrassingly parallel calculations ==
| |
| | |
| The most well-known R packages that provide parallel functionality, e.g. doParallel or doSNOW, do not work properly on the HPC. Using these packages will be particularly problematic when you try to run (array) jobs over multiple nodes. However, the [https://cran.r-project.org/web/packages/rslurm/vignettes/rslurm.html rslurm package] allows you to do [https://en.wikipedia.org/wiki/Embarrassingly_parallel embarrassingly parallel] calculations on SLURM. The package automatically divides the computation over multiple nodes and writes the necessary submission scripts. It also includes functions to retrieve and combine the output from different nodes, as well as wrappers for common SLURM commands.
| |
| | |
| == External links ==
| |
| [https://cran.r-project.org/web/packages/rslurm/vignettes/rslurm.html Vignette for the rslurm package]
| |