Also, you are painting a false dichotomy between "rich" and "poor". A lot of middle and lower class people can raise healthy and happy children unless they have problems with mental health / violence / substance abuse & so on.
> taking away the only joy in some people's lives
Looking at children as a source of joy instead of a recipient of unconditional care and effort sounds very narcissistic.