If you are referring to inside single ticks (`) then yes, but inside the R chunks, which is inside triple ticks (``` ) the auto complete works as good as a R source file.
The single tick is meant to fill in a single value inline so usually it is a small line of code. But I agree if autocomplete was available here also it would be useful. Let's see other answers.