No, there is no need to upgrade R because of this error. Just restart your session and continue doing what you are doing.
If R crashes again, it might be that you are doing something to cause this behaviour (e.g., using too much compute or something similar). In that case you'll need to debug when this happens to understand the root cause.