That's why "rules are just constructs we humans created" rings stupid/horrifying. Obviously they were created by humans but that is also why they matter. I prefer "rules were written by humans, mostly in blood". It took years for OP to get the first part, here's to them getting the second part faster.
One doing something wrong to another would get families into an infinite loop of mutual revenge--until we got around precisely to create rules and put up a trusted authority to ensure justice without the need for vengeance. Rules is how our civilization functions and its only hope.