Can you provide a reproducible example? It will make it easier for us to figure out what you are doing and make it more likely that you'll get an answer.
A minimal reproducible example consists of the following items:
A minimal dataset, necessary to reproduce the issue
The minimal runnable code necessary to reproduce the issue, which can be run
on the given dataset, and including the necessary information on the used packages.
Let's quickly go over each one of these with examples: