Yes, working at a factory production line is utterly mind-numbing (I speak from experience) even if one is bored enough to use the spare brainpower to perform all sorts of microoptimizations, but at the end of the day, one provides people with goods and the other uses up electricity to provide entertainment, so the value to everyone else isn't the same.
And we do need to provide each other with value, or there won't be enough things to buy no matter how many dollars we have.