For me, this happens less often than once a year. And then it is a good idea to change all passwords anyway.
The alternative is to store passwords somewhere in a password manager. However if this storage gets somehow lost/compromised ALL of your passwords get lost/compromised.