You had a caste system in these civilizations. Warrior/hunters, farmers, priests, etc.
Neolithic civilization wasn’t just a band of 50 and a few yurts. There were complex societies, but they had scale limits due to technology and knowledge constraints.
ggggtez is not disagreeing with that. He is saying that when one society beats others at warfare, it is not because its males had more testosterone and larger muscles, rather because it had better agriculture and so on.