In a consulting agreement, you may find "Non-use" terms along with "Non-disclosure" terms in the IP language; technically, this would prevent a consultant from stealing the sales rolodex and then using it to contact customers.
Otherwise, you violate an NDA by disclosing to someone not bound under the same NDA actual confidential information. Nothing prevents you from using confidential information to compete "unfairly" with your employer.
You can add whatever terms you'd like to whatever you call a "confidentiality" or IP agreement, but now you're on a slippery slope that leads to de facto noncompetes.