Sure they do, but the big labs spend many, many, worker-hours suppressing it with RLHF.
My GPT-2 discord bot from 2021 possessed clear intent. Sure, unpredictable and short-lived, but if it decided it didn't like you it would continuously cuss and attempt ban commands until its context window became distracted by something else.