Usually a keynote speaker is invited, and gets his travel and hotel costs reimbursed. Without reimbursement you usually think twice if you visit a conference or not. And I never heard of downgrading a speaker before, even if I heard of plenty of conference drama before.
