GPU mostly does SIMD. This would enable to do independent workloads. If your simple single threaded webserver only requires 20MB of RAM, you could just run it in its tiny chunk of RAM; and it would sometimes ask the CPU to coordinate with the NIC.

Also, a GPU requires transport of data to it. PIM lets the CPU do concurrent work at very low latencies.