Well, politicians are responsible for progress only in so far as they're responsible for allocating budget and legal support for research. They do not do the work, but they control large amounts of resources that help make it happen[0].
As for questioning the kind of technological advancement and the reactions to it, I think the defensive comments come from a combination of the following:
1. Questioning spending on space exploration in the topic about space exploration is like questioning the existence of football on a football match. You're talking to an audience who loves it and telling them that it takes resources away from More Important Things. Except that space is at the same time much more underfunded and much more important than football, baseball, basketball, movies, concerts, celebrity gossip and all the other stuff people like[1]. So it kind of feels unfair to single it out here.
2. Basic research is increasingly becoming underfunded. The funny thing about solving the world problems with technology is that, more often than not, what enables those technologies is pie-in-the-sky research with no expected immediate results. This doesn't fly well with the markets, and as countries increasingly treat science in the same way market economy does, the funding for long-term research is in ever greater jeopardy. Attacking space exploration through arguments of other more immediate problems is in a big way attacking basic research.
3. People need to dream about better future. Space exploration is somewhat unique that it captures and nourishes the imagination and hope for a better world.
4. We have enough resources to solve the more important problems like clean water and food for all. And yet they are not solved. Taking the meagre few $B from space research will most likely not help in solving those problems, but it will shut down space research.
--
[0] - Note that in that they're not unique - theoretically, a private institution with large amounts of resources can do the same thing too. Still, to date, it's usually governments that are willing to spend money on actual research.
[1] - Also, there's plenty of money in wasted military spending that could be taken first, even without reducing the actual military capabilities of a country.