This is a brew issue. I loved brew when I was on macOS, but never found it necessary to use it to install anything R related other than external libraries (which is a whole separate issue on macOS, because of its off-standard compile toolchain).
Caveat: Don't have an M1, only Big Sur
Recommendation: Use the canned version from RStudio