Custom fonts not showing on Shiny apps when run on compiled shiny-server

I have a weird issue where fonts are not shown in plots made with ggplot2 when the apps run on a compiled installation of shiny-server (arm architecture), the fonts seem to be correctly installed on the system since it works with plotly (even with ggplotly()) and it also works with ggplot2 on RStudio server. Also, the same apps (cloned from a GitHub repo) show the fonts correctly when run on a server with a normal installation of shiny-server.

I don't know where to start debugging this issue, any idea?