> Besides, I imagine many of the issues with vision (e.g. adverse weather)

LIDAR is bad in rain, fog and snow.