Yes. But just like we automate tests instead of manually testing -- that's what computers are for after all: automation -- we can automate the tests of tests!
Also, tests that once made sense might have become useless, so it seems relevant to have a way of automatically detecting obsolete "this doesn't test anything" tests even though they could have been useful once. Without relying too much on human intervention, that is.