All applications are upgradable, even Play Services are upgradable, and developers get the support library to get all the new things to all devices.
So I believe they did a great job at reducing fragmentation in the sense that it no longer really matters what version you have, you still get all the newest stuff. Just look at every iOS version announcement: 3/4 of the new features are in the apps: iMessages, maps, home screen...