Documentation/articles on setting up RSP with SLURM/LSF

Hello,
Can someone help me locate articles/documentation around implementing RSP on HPC (SLURM/LSF).
Another question I have is does it make more sense for Job Launcher to become generally available before exploring RSP on SLURM/LSF or we could still use SLURM without job launcher?

Thank you in advance.

1 Like

Installing RStudio Server Pro on an HPC cluster will be a similar process as installing to a regular server: https://docs.rstudio.com/ide/server-pro/index.html#installation

You can start with a single machine, and optionally add additional servers in a load-balanced setup if needed: https://docs.rstudio.com/ide/server-pro/load-balancing.html

You can also find some general advice on scaling and clusters at: https://support.rstudio.com/hc/en-us/articles/236226087-Scaling-R-and-RStudio, as well as some general advice online about using R with Slurm, but most of that content is around running R jobs on SLURM as opposed to interactive R sessions on Slurm via RSP.

One thing to be aware of is that sessions and jobs that are run via RSP are not aware of the workloads that are occurring on the node via Slurm/LSF, so you can set resource limits to help with resource contention.

You should also be aware of the upcoming Launcher functionality in RSP 1.2 (https://blog.rstudio.com/2018/11/05/rstudio-rsp-1.2-features/), which will allow you to run R sessions and jobs on Kubernetes for the initial release, and support for Slurm will be coming in a future release. This will allow you to install RSP outside of the Kubernetes or Slurm cluster, but spawn R sessions and run R jobs via those schedulers / resource managers.

1 Like

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.