I had the same encoding problems with RStudio-2021.09.2-382.
But @hbach solution didn't work for me.
So I fall back to an older version of R-Studio (Version 1.4.1717-3).
With this Version sessionInfo() output is without the system code page: 65001 line and the encoding troubles are gone.