Sometimes you are looking for deeper insights in some equations that can only be achieved by finding symbolic solutions.
You would never figure out that black holes are a solution to the Einstein field equations of you just threw a numerical solver at it, for example. (Bad example because that's arguably the easiest solution to them but I hope you get my point.)