Not in R, you need to enable it on Windows but have in mind that this might have unexpected repercussions like not being able to open existing xlsxm files
https://helpcenter.nshift.com/hc/en-us/articles/360016886479-Errors-caused-by-Windows-10-Unicode-UTF-8-encoding#:~:text=Open%20Windows%20Control%20Panel%20->%20Region,OK%20and%20restart%20your%20computer.
Another option would be to set your default package library in another folder without non-ASCII characters in its path.
You can change the default library folder by setting your R_LIBS_SITE
environmental variable in a .Reviron or .Rprofile file. For example:
# In a .Renviron file you can set it by adding a line like this one with the desired location
R_LIBS_SITE="C:\\Program Files\\R\\R-4.1.2\\library"
For a more detailed explanation, you can read this blog post