It’s not just “rich people,” it’s “wealth.” Speculation in there housing market is a widely accepted contributor to rising housing prices: https://www.princeton.edu/~wxiong/papers/Speculation.pdf