Yes, we don't really know what a good social environment for children looks like.
But it does seem obvious that being forced to associate with brutes is unpleasant, demoralising and inconducive to academic learning. By the same token why not teach people to deal with pain by tapping them daily with hammers?
We also have to factor in also that many people will become brutes as a result of this forced association, like the way criminality incubates in prisons.