I think the relevant question is: can a statistical model (or a transformer, in particular) generalize to general reasoning ability?