With HTML, to modify the styling, you need to look into how CSS works.
rmarkdown allows custom CSS
This R book about shiny have an intro to CSS
You could find plenty other resource online.
You then need to find how to justify text in CSS and on which element of the page to apply
Also, you can play with CSS in your browser. For example:
Hope it helps