So... are you saying Statistical Mechanics (to give an example) is not part of Physics?
In real life, the amount of information you have (and can have) about a physical process is limited. You can either throw your hands up and say "we can't know for sure", or you can use probabilities to try to get somewhere.
How do you define the position of an electron without using probabilities?