Typically, we just ask users to double-check whether they have a ~/.Rprofile or ~/.Renviron or similar and move those out-of-the-way as needed. Perhaps it would be useful to have some kind of gesture to restart R with --vanilla passed.
Still, some users set things like library paths in their user profile so disabling that by default doesn't always help in debugging situations.