As an additional safeguard, you can make your trucks go into 'safety' mode when connection becomes spotty or when too many operators become too busy with other trucks.
'Safety mode' could mean slowing down the trucks or even stopping some of them. And in general, letting the autonomous systems err on the side of caution more often.