I have ~12k karma and never experienced anything getting dicey. I’ve never been affiliated with YC or the mods.

In my experience it’s a pretty fair community and I’ve been downvoted many times.