You can’t gradually go from one to the other.
Absent some mechanism we don’t know about, conception simply doesn’t work when the sperm and eggs have different numbers of chromosomes.
To be clear, the concept of chromosome isn’t as objective as one might think… nevertheless, it’s an example of the type of genetic difference that simply precludes reproduction.