Not to mention heat pumps require somewhere to pump to/from, you can't just put one in your basement, plug it into the wall, and heat up the basement. Also heat pumps work best with mild differences, like say 40F inside and 60F inside if you want to heat.
Heat pumps reduce to space heater efficiency if it's sub-zero Fahrenheit outside I believe.