Yeah, but then your car might as well have a "start" button, keys aren't necessarily.
Lots of cars let you take out the keys when the ignition is in "armed" state for this reason exactly. No need to leave the keys in the ignition while you aren't there.