SPA + restful endpoints makes it easy to pick a library centric approach vs. a framework approach but it certainly does not preclude you from using a framework.
I guess people who disable javascript don't get to use your site...but I don't really care about that segment of the population.