There is nothing built in to the docker file to make this easy. You will have to manage it yourself.
I believe the simplest way is to set up a second docker deployment and adjust a load balancer to point to the new deployment. (Plumber does not provide these tools.) A load balancer should still respect the old deployment and you can shut down the older docker deployment when you feel it is safe.