Research in focusing on just a few datasets in that case because they need labelling.
In this case, what you need is mostly "what would most humans do?"
There would be things to refine about that (e.g. prevent speeding; analyse how humans reacted right before crashes etc. and improve on responses), but as a starting point it is immensely useful.