You can't say "you're not a scotsman because I don't like your actions or opinions". You can say "you're not a scotsman because you're neither from scotland, nor have any particular tie to it."
Similarly fiscal conservatism has an actual definition, and it's totally vaild to say "you don't adhere to the definition", as long as you're not applying spurious constraints.