Well, if you cannot trust your leaving employee to keep his confidentiality agreement - you have one, right - than you will need to change all password.
I do not see how this has anything to do with how you store the passwords in the first place.
If the problem is, that he sees more passwords than necessary, why not have multiple keypass databases?