If rmarkdown isn't installed in the project space, then creating an RMarkdown document via File -> New RMarkdown Document has components like stringi, yaml, and Rcpp building from source. I think this is because there is a pop up window where the package installation occurs from.
Though, typing the installation command manually into console seems to correctly pull packages from the prebuilt binaries.
install.packages("rmarkdown")