You might still want to write that one down somewhere and store it somewhere safe (and probably hard to get to). A friend of mine recently forgot his PIN. A four-number code used regularly for over ten years. Just gone like that.
Your memory is a SPOF, and while generally robust for this sort of thing, it's not bulletproof.