SLURM Compare: Difference between revisions
Jump to navigation
Jump to search
| (5 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
=== Rosetta Stone of Workload Managers === | === Rosetta Stone of Workload Managers === | ||
PBS/Torque, Slurm, LSF, SGE and LoadLeveler | PBS/Torque, Slurm, LSF, SGE and LoadLeveler [http://slurm.schedmd.com/rosetta.html Rosetta Stone] | ||
This table lists the most common command, environment variables, and job specification options used by the major workload management systems: PBS/Torque, Slurm, LSF, SGE and LoadLeveler. Each of these workload managers has unique features, but the most commonly used functionality is available in all of these environments as listed in the table. This should be considered a work in progress and contributions to improve the document are welcome. | This table lists the most common command, environment variables, and job specification options used by the major workload management systems: PBS/Torque, Slurm, LSF, SGE and LoadLeveler. Each of these workload managers has unique features, but the most commonly used functionality is available in all of these environments as listed in the table. This should be considered a work in progress and contributions to improve the document are welcome. | ||
| Line 11: | Line 11: | ||
||Job deletion ||qdel [job_id]|| scancel [job_id]|| bkill [job_id]|| qdel [job_id]|| llcancel [job_id] | ||Job deletion ||qdel [job_id]|| scancel [job_id]|| bkill [job_id]|| qdel [job_id]|| llcancel [job_id] | ||
|- | |- | ||
||Job status (by job)|| qstat [job_id]|| squeue [job_id]|| bjobs [job_id]|| qstat -u \* [-j job_id]|| llq -u [username] | ||Job status (by job)|| qstat [job_id]|| squeue --job [job_id]|| bjobs [job_id]|| qstat -u \* [-j job_id]|| llq -u [username] | ||
|- | |- | ||
||Job status (by user)|| qstat -u [user_name]|| squeue -u [user_name]|| bjobs -u [user_name]|| qstat [-u user_name]|| llq -u [user_name] | ||Job status (by user)|| qstat -u [user_name]|| squeue -u [user_name]|| bjobs -u [user_name]|| qstat [-u user_name]|| llq -u [user_name] | ||
| Line 17: | Line 17: | ||
||Job hold ||qhold [job_id]|| scontrol hold [job_id]|| bstop [job_id]|| qhold [job_id]|| llhold -r [job_id] | ||Job hold ||qhold [job_id]|| scontrol hold [job_id]|| bstop [job_id]|| qhold [job_id]|| llhold -r [job_id] | ||
|- | |- | ||
||Job release|| qrls [job_id]|| scontrol release [job_id]|| bresume [job_id] qrls [job_id] llhold -r [job_id] | ||Job release|| qrls [job_id]|| scontrol release [job_id]|| bresume [job_id]|| qrls [job_id]|| llhold -r [job_id] | ||
|- | |- | ||
||Queue list|| qstat -Q|| squeue ||bqueues ||qconf -sql|| llclass | ||Queue list|| qstat -Q|| squeue ||bqueues ||qconf -sql|| llclass | ||
| Line 23: | Line 23: | ||
||Node list ||pbsnodes -l|| sinfo -N OR scontrol show nodes|| bhosts|| qhost|| llstatus -L machine | ||Node list ||pbsnodes -l|| sinfo -N OR scontrol show nodes|| bhosts|| qhost|| llstatus -L machine | ||
|- | |- | ||
||Cluster status|| qstat -a|| sinfo|| bqueues|| qhost -q|| llstatus -L cluster | |||
|- | |||
||GUI|| xpbsmon|| sview|| xlsf OR xlsbatch|| qmon|| xload | |||
|- | |||
|- | |||
||'''Environment'''||'''PBS/Torque'''||'''Slurm'''||'''LSF'''||'''SGE'''||'''LoadLeveler''' | |||
|- | |||
||Job ID|| $PBS_JOBID|| $SLURM_JOBID|| $LSB_JOBID|| $JOB_ID|| $LOAD_STEP_ID | |||
|- | |||
||Submit Directory|| $PBS_O_WORKDIR|| $SLURM_SUBMIT_DIR|| $LSB_SUBCWD|| $SGE_O_WORKDIR|| $LOADL_STEP_INITDIR | |||
|- | |||
||Submit Host|| $PBS_O_HOST|| $SLURM_SUBMIT_HOST|| $LSB_SUB_HOST|| $SGE_O_HOST || | |||
|- | |||
||Node List|| $PBS_NODEFILE|| $SLURM_JOB_NODELIST|| $LSB_HOSTS/LSB_MCPU_HOST|| $PE_HOSTFILE|| $LOADL_PROCESSOR_LIST | |||
|- | |||
||Job Array Index|| $PBS_ARRAYID|| $SLURM_ARRAY_TASK_ID|| $LSB_JOBINDEX|| $SGE_TASK_ID || | |||
|- | |- | ||
|- | |- | ||
|- | |- | ||
|} | |} | ||
Latest revision as of 14:45, 1 August 2018
Rosetta Stone of Workload Managers
PBS/Torque, Slurm, LSF, SGE and LoadLeveler Rosetta Stone
This table lists the most common command, environment variables, and job specification options used by the major workload management systems: PBS/Torque, Slurm, LSF, SGE and LoadLeveler. Each of these workload managers has unique features, but the most commonly used functionality is available in all of these environments as listed in the table. This should be considered a work in progress and contributions to improve the document are welcome.
| User Commands | PBS/Torque | Slurm | LSF | SGE | LoadLeveler |
|---|---|---|---|---|---|
| Job submission | qsub [script_file] | sbatch [script_file] | bsub [script_file] | qsub [script_file] | llsubmit [script_file] |
| Job deletion | qdel [job_id] | scancel [job_id] | bkill [job_id] | qdel [job_id] | llcancel [job_id] |
| Job status (by job) | qstat [job_id] | squeue --job [job_id] | bjobs [job_id] | qstat -u \* [-j job_id] | llq -u [username] |
| Job status (by user) | qstat -u [user_name] | squeue -u [user_name] | bjobs -u [user_name] | qstat [-u user_name] | llq -u [user_name] |
| Job hold | qhold [job_id] | scontrol hold [job_id] | bstop [job_id] | qhold [job_id] | llhold -r [job_id] |
| Job release | qrls [job_id] | scontrol release [job_id] | bresume [job_id] | qrls [job_id] | llhold -r [job_id] |
| Queue list | qstat -Q | squeue | bqueues | qconf -sql | llclass |
| Node list | pbsnodes -l | sinfo -N OR scontrol show nodes | bhosts | qhost | llstatus -L machine |
| Cluster status | qstat -a | sinfo | bqueues | qhost -q | llstatus -L cluster |
| GUI | xpbsmon | sview | xlsf OR xlsbatch | qmon | xload |
| Environment | PBS/Torque | Slurm | LSF | SGE | LoadLeveler |
| Job ID | $PBS_JOBID | $SLURM_JOBID | $LSB_JOBID | $JOB_ID | $LOAD_STEP_ID |
| Submit Directory | $PBS_O_WORKDIR | $SLURM_SUBMIT_DIR | $LSB_SUBCWD | $SGE_O_WORKDIR | $LOADL_STEP_INITDIR |
| Submit Host | $PBS_O_HOST | $SLURM_SUBMIT_HOST | $LSB_SUB_HOST | $SGE_O_HOST | |
| Node List | $PBS_NODEFILE | $SLURM_JOB_NODELIST | $LSB_HOSTS/LSB_MCPU_HOST | $PE_HOSTFILE | $LOADL_PROCESSOR_LIST |
| Job Array Index | $PBS_ARRAYID | $SLURM_ARRAY_TASK_ID | $LSB_JOBINDEX | $SGE_TASK_ID |