I am pretty sure this is the recommended way and you need to serve the site to preview it. It is even mentioned in the Hugo documentation for hugo website
blogdown::serve_site helps you do that.
However, I guess you can find some configuration to get correct path for all your ressources. This is by the way what blogdown::serve_site is doing : It replaces the base url configurations depending on the option relativeurls.