I'm not sure I understand your issue but if it is what I think it is if you don't hard code the axis limits, the limits are going to be set "dynamically" as you are expecting
If you need more specific help, please provide a proper REPRoducible EXample (reprex) illustrating your issue.
.