What you're actually saying is "I have enough freelance / contract work and am not looking for a full time job." I said similar things when I was freelancing.
If you were actually looking for a full time position you'd do the interview. It's completely reasonable to require an unpaid interview from a candidate.