Where did I say not to try to understand the math behind it? I say its not required to tune hyperparameters.
To me, its doubtful that someone whose first impulse is to generate strawman arguments is doing a good job in analyzing data. Thats the basis for NHST, which ml tools like this are trying to get away from...