Your question is a little confusing, there is no RStudio embedded into shiny-server, not even R is embedded into shiny-server, they are all installed independently so if you want to update any of them you just have to do it as usual, download the installer and run it on your server.
If this is not what you meant, Can you please clarify?