Yeah, the average program will see no benefits - the one area which it will make a huge difference is games/graphics/simulation. There are so many problems in graphics that are fairly trivial to parallelize (especially with the rising interest in voxels and raytracing). The main thing is it needs to be very easy to program, and cross-platform (neither is an easy feat). Right now we are kind of stuck in a rut with current graphics APIs - you can do a lot with them, but they are also very limiting when compared to a general purpose CPU - back in the days of DOOM, the Build Engine, etc, one used to be able to write a rendering from the ground up; now (for better or worse) we are limited to one way of pushing polygons onto the screen, and there are a magnitude less of ways to be creative. Note that I used to be a huge GPU proponent, but after about a decade of working with them I am turning back to software rendering.