Yes, because it is compiled for that version, packages need to be compiled for an specific major version of R.
The only solution is to reinstall it for the latest R version.
I don't know what you mean with this, you just have to install the needed tools (i.e. Rtools) in your system.
Alternatively, you could wait a few days for the binary to become available and install from it to avoid compilation.