This sort of nested folding is supported in R Markdown documents; e.g. try folding a document containing:
# Section 1
## Section 1.1
## Section 1.2
# Section 2
However, we don't have anything for defining a hierarchy of sections in plain R documents (other than nested functions). We'll have to think about this a bit more.