Your skull is vulnerable to impacts at speeds that are relatively low compared to full-speed cycling.
On a few occasions I've witnessed a cyclist panic and wobble after being passed far too closely by a car traveling far too fast for such a manoeuvre. This has caused such cyclists to wobble, inadvertently clip the curb and mount the pavement, fall off sideways and subsequently strike their head on a nearby wall whilst falling.
The resulting injury can be very harmful.
Another example of slow-speed head injury: off-road biking down a very steep incline with a loose surface. I've seen people fall and tumble at almost stationary speeds.