Deep networks have more layers than the previous generation. They seem to work better in engineering practice than mathematically equivalent short wide networks.