Perhaps there was a long time where people with slightly better eyesight could tell them apart while others couldn't, or when atmospheric conditions would obscure it. That might seed stories of the last sister being missing or coming and going.