Do you also ask them for permission when you want to go biking? Visit your mother? Throw a party? Draw a picture? Contribute to an open-source project? Smoke a cigarette? Build a gadget? Buy a house? Have a child?

What an employee does in their own time is 0 business of the employer, none of the above is different from the others in kind.