The trouble that you’ve probably felt is CRM are sold to sales exec and as such, focus on sales exec needs.

You’d be better served not with CRM, but a personal contact management system.

Something like https://www.monicahq.com/