> If you run an open source model from the same seed on the same hardware they are completely deterministic.
Are you sure of that? Parallel scatter/gather operations may still be at the mercy of scheduling variances, due to some forms of computer math not being associative.