Knowing the inner working of a complex system is a hard requirement of its testing.

Testing is not a proof a software system is correct. Also, if tests are generated as well, there's no trust in how anything works or if the tests are covering important aspects.