Not in R, you need to enable it on Windows but have in mind that this might have unexpected repercussions like not being able to open existing xlsxm files
Another option would be to set your default package library in another folder without non-ASCII characters in its path.
You can change the default library folder by setting your
R_LIBS_SITE environmental variable in a .Reviron or .Rprofile file. For example:
# In a .Renviron file you can set it by adding a line like this one with the desired location
For a more detailed explanation, you can read this blog post