There was some discussion about this here.
I set up a shiny server (open source) with an Auth0 authentication proxy. It's running on a Digital Ocean Ubuntu server, but you should be able to do the same on AWS.
Requires a bit of knowledge about Nginx, but Auth0 have a pretty good tutorial on how to get it up and running.