Consumers can't consume if they don't have the money. Every time you fire someone and he can't get job for time X, you are reducing overall consumption during that time X.
Instead the money if concentrated in fewer hands and there is an upper limit to what a human can consume (e.g. a single rich person can't eat more than hundred middle class people).
