Hello!
I thought I just read another post about this. So what I learned is this:
Rmarkdown needs to be re-knitted everytime you want to see the changes to the document.
Rnotebook caches the document and you can see changes in real time for the chunk that your are working on.
So the advantage comes if your document takes a long time to knit. Otherwise, I believe they are the same.