The model encodes some generalities that may still hold true, given that it was fit on a lot of scenarios, and a lot of brainpower went into it.
But sure, it might completely miss some novel phenomenon. It is up to the humans running the model to be aware of its limitations and accuracy.
In any case, the more heads thinking about the problem the better, and the model is an approximation of a lot of heads. And the equations can show why it thinks what it thinks.
