In the RStudio Menu Bar, there's a Tools tab with the option to "check for package updates." That's generally the most reliable method.
If that doesn't work, your operating system, version, base R version, R Studio version and the error messages will be useful in taking this further.