Parallel Processing with RStudio Server Pro

Posit Professional products
1

We are working on computations using prophet ,xgboost and forecastxgb using RStudio Server. The process is slow and time consuming. We have 16 cores available. What options do we have for Parallel processing with RStudio Server that will enable us to improve the performance
We are looking for the following options

  • maximize the use of cores
    -cluster capability
    etc to enhance the Performance
2

This might help: https://www.r-bloggers.com/how-to-go-parallel-in-r-basics-tips/

1 Like
3

Hi, another way could be to install sparklyr and run it in "local" mode, which means that it will create a sort of single server Spark cluster in your machine. This will allow you to run Spark Machine Learning routines, which will use all available cores during execution, here are a couple of links that may help:

4 Likes