Sure, in the same way I can always quit being an engineer and become a farmer. It can work for some, but not everyone.
FWIW I do client work on the side. Full time client work has always been more draining than just having a regular job IME. Maybe I just can't find the right clients, but that's not something I have to worry about when I work for a company.