I agree, except when the amount of debt gets so large, and goes way beyond the immediate. Then it becomes much more clear that it is a problem.
There is a case to be made that in 2008-2009, a big, debt financed, short term stimulus could have been helpful. But when that metastasizes into long term spending that doesn't look like it is going anywhere soon, and doesn't seem to be accomplishing anything, then it is worthwhile to sound the alarm.