Using latest on Linux/Ubuntu Jammy download version. It seems odd there are no icons next to the menu bar items (drop downs). There's a placeholder for them, but no icons at all for any menu item.
I notice in the docs there certainly are icons visible: RStudio User Guide - Managing Files